[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:04:50 dist-test-slave-bndk krb5kdc[4911](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:04:50 dist-test-slave-bndk krb5kdc[4911](info): set up 2 sockets
Aug 12 01:04:50 dist-test-slave-bndk krb5kdc[4911](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260812 01:04:51.379590 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.318s user 0.001s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:04:51 dist-test-slave-bndk krb5kdc[4911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496691, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:04:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:04:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.201.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
I20260812 01:04:51.558936 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:33277
--webserver_interface=127.4.201.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:35689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:33277
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:04:51.922885 4930 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:04:51.923239 4930 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:04:51.923424 4930 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:04:51.930887 4930 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:04:51.931006 4930 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:04:51.931083 4930 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:04:51.931159 4930 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:04:51.931221 4930 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:04:51.941450 4930 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:35689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:33277
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:33277
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:04:51.943188 4930 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:04:51.945101 4930 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:04:51.969147 4935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:04:51.969192 4936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:04:51.972178 4943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:04:51.973196 4930 server_base.cc:1034] running on GCE node
I20260812 01:04:51.974326 4930 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:04:51.976611 4930 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:04:51.977814 4930 hybrid_clock.cc:648] HybridClock initialized: now 1786496691977723 us; error 86 us; skew 500 ppm
I20260812 01:04:51.978407 4930 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:04:51 dist-test-slave-bndk krb5kdc[4911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496691, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:04:51.981815 4930 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:04:51.984443 4930 webserver.cc:460] Webserver started at http://127.4.201.126:40901/ using document root <none> and password file <none>
I20260812 01:04:51.985378 4930 fs_manager.cc:359] Metadata directory not provided
I20260812 01:04:51.985491 4930 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:04:51.985746 4930 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:04:51.989440 4930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "a4ac09ae05e441dbba824394628dedc2"
format_stamp: "Formatted at 2026-08-12 01:04:51 on dist-test-slave-bndk"
server_key: "b0bbea99c82976b9eae7371bc649ca42"
server_key_iv: "e37fa370a741d4057f5e68235c3d8865"
server_key_version: "encryptionkey@0"
I20260812 01:04:51.990250 4930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "a4ac09ae05e441dbba824394628dedc2"
format_stamp: "Formatted at 2026-08-12 01:04:51 on dist-test-slave-bndk"
server_key: "b0bbea99c82976b9eae7371bc649ca42"
server_key_iv: "e37fa370a741d4057f5e68235c3d8865"
server_key_version: "encryptionkey@0"
I20260812 01:04:51.996718 4930 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.005s
I20260812 01:04:52.000603 4956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:04:52.002076 4930 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:04:52.002341 4930 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "a4ac09ae05e441dbba824394628dedc2"
format_stamp: "Formatted at 2026-08-12 01:04:51 on dist-test-slave-bndk"
server_key: "b0bbea99c82976b9eae7371bc649ca42"
server_key_iv: "e37fa370a741d4057f5e68235c3d8865"
server_key_version: "encryptionkey@0"
I20260812 01:04:52.002535 4930 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:04:52.023303 4930 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:04:52.027740 4930 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:04:52.028211 4930 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:04:52.060485 4930 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:33277
I20260812 01:04:52.060535 5046 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:33277 every 8 connection(s)
I20260812 01:04:52.063657 4930 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:04:52.066711 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 4930
I20260812 01:04:52.067135 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:04:52.069916 4901 external_mini_cluster.cc:1428] Setting key 9a91c0b3e2035c93c0cd1d31ec63e068
I20260812 01:04:52.071389 5049 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:04:52.095781 5049 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4ac09ae05e441dbba824394628dedc2: Bootstrap starting.
I20260812 01:04:52.100999 5049 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a4ac09ae05e441dbba824394628dedc2: Neither blocks nor log segments found. Creating new log.
I20260812 01:04:52.103206 5049 log.cc:824] T 00000000000000000000000000000000 P a4ac09ae05e441dbba824394628dedc2: Log is configured to *not* fsync() on all Append() calls
I20260812 01:04:52.108239 5049 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4ac09ae05e441dbba824394628dedc2: No bootstrap required, opened a new log
Aug 12 01:04:52 dist-test-slave-bndk krb5kdc[4911](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496691, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:04:52.119910 5049 raft_consensus.cc:348] T 00000000000000000000000000000000 P a4ac09ae05e441dbba824394628dedc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4ac09ae05e441dbba824394628dedc2" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33277 } }
I20260812 01:04:52.120513 5049 raft_consensus.cc:374] T 00000000000000000000000000000000 P a4ac09ae05e441dbba824394628dedc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:04:52.120730 5049 raft_consensus.cc:729] T 00000000000000000000000000000000 P a4ac09ae05e441dbba824394628dedc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4ac09ae05e441dbba824394628dedc2, State: Initialized, Role: FOLLOWER
I20260812 01:04:52.122148 5049 consensus_queue.cc:260] T 00000000000000000000000000000000 P a4ac09ae05e441dbba824394628dedc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4ac09ae05e441dbba824394628dedc2" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33277 } }
I20260812 01:04:52.122522 5049 raft_consensus.cc:388] T 00000000000000000000000000000000 P a4ac09ae05e441dbba824394628dedc2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:04:52.122814 5049 raft_consensus.cc:482] T 00000000000000000000000000000000 P a4ac09ae05e441dbba824394628dedc2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:04:52.123078 5049 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a4ac09ae05e441dbba824394628dedc2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:04:52.125962 5049 raft_consensus.cc:504] T 00000000000000000000000000000000 P a4ac09ae05e441dbba824394628dedc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4ac09ae05e441dbba824394628dedc2" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33277 } }
I20260812 01:04:52.127023 5049 leader_election.cc:302] T 00000000000000000000000000000000 P a4ac09ae05e441dbba824394628dedc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a4ac09ae05e441dbba824394628dedc2; no voters:
I20260812 01:04:52.127876 5049 leader_election.cc:288] T 00000000000000000000000000000000 P a4ac09ae05e441dbba824394628dedc2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:04:52.128165 5058 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a4ac09ae05e441dbba824394628dedc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:04:52.131736 5058 raft_consensus.cc:686] T 00000000000000000000000000000000 P a4ac09ae05e441dbba824394628dedc2 [term 1 LEADER]: Becoming Leader. State: Replica: a4ac09ae05e441dbba824394628dedc2, State: Running, Role: LEADER
I20260812 01:04:52.132057 5049 sys_catalog.cc:564] T 00000000000000000000000000000000 P a4ac09ae05e441dbba824394628dedc2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:04:52.132274 5052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:52.076125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46238 (local address 127.4.201.126:33277)
0812 01:04:52.101868 (+ 25743us) server_negotiation.cc:206] Beginning negotiation
0812 01:04:52.101880 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 01:04:52.101929 (+ 49us) server_negotiation.cc:407] Connection header received
0812 01:04:52.104535 (+ 2606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:04:52.104563 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:04:52.105057 (+ 494us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:04:52.105396 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:04:52.109904 (+ 4508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:52.111237 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:52.113782 (+ 2545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:52.114495 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:52.114642 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:52.122072 (+ 7430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:04:52.122081 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:04:52.122096 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:04:52.122144 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:04:52.125469 (+ 3325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:52.126511 (+ 1042us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:52.126519 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:52.126525 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:52.126753 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:52.127334 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:52.127339 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:52.127343 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:52.128447 (+ 1104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:04:52.129890 (+ 1443us) server_negotiation.cc:1035] Waiting for connection context
0812 01:04:52.130216 (+ 326us) server_negotiation.cc:299] Negotiation successful
0812 01:04:52.130655 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25448,"thread_start_us":25072,"threads_started":1}
I20260812 01:04:52.132539 5058 consensus_queue.cc:237] T 00000000000000000000000000000000 P a4ac09ae05e441dbba824394628dedc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4ac09ae05e441dbba824394628dedc2" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33277 } }
I20260812 01:04:52.137625 5060 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4ac09ae05e441dbba824394628dedc2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a4ac09ae05e441dbba824394628dedc2. Latest consensus state: current_term: 1 leader_uuid: "a4ac09ae05e441dbba824394628dedc2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4ac09ae05e441dbba824394628dedc2" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33277 } } }
I20260812 01:04:52.138060 5060 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4ac09ae05e441dbba824394628dedc2 [sys.catalog]: This master's current role is: LEADER
I20260812 01:04:52.138648 5059 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4ac09ae05e441dbba824394628dedc2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a4ac09ae05e441dbba824394628dedc2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4ac09ae05e441dbba824394628dedc2" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33277 } } }
I20260812 01:04:52.139092 5059 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4ac09ae05e441dbba824394628dedc2 [sys.catalog]: This master's current role is: LEADER
I20260812 01:04:52.139459 5067 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:04:52.146459 5067 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:04:52.147442 5092 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 01:04:52.158535 5067 catalog_manager.cc:1347] Generated new cluster ID: 75734cdfde8e443e9152da910aaf63df
I20260812 01:04:52.158646 5067 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:04:52.175189 5067 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:04:52.176893 5067 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:04:52.189049 5067 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a4ac09ae05e441dbba824394628dedc2: Generated new TSK 0
I20260812 01:04:52.190052 5067 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.201.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
I20260812 01:04:52.240543 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:0
--local_ip_for_outbound_sockets=127.4.201.65
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:33277
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:35689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:04:52.585377 5101 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:04:52.585633 5101 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:04:52.585769 5101 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:04:52.593108 5101 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:04:52.593206 5101 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:04:52.593386 5101 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:04:52.602986 5101 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:35689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:33277
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:04:52.604188 5101 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:04:52.605636 5101 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:04:52.619410 5109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:04:52.619441 5110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:04:52.619839 5112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:04:52.620273 5101 server_base.cc:1034] running on GCE node
I20260812 01:04:52.620878 5101 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:04:52.621821 5101 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:04:52.623031 5101 hybrid_clock.cc:648] HybridClock initialized: now 1786496692622976 us; error 43 us; skew 500 ppm
I20260812 01:04:52.623338 5101 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:04:52 dist-test-slave-bndk krb5kdc[4911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496692, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:04:52.626457 5101 init.cc:377] Logged in from keytab as kudu/127.4.201.65@KRBTEST.COM (short username kudu)
I20260812 01:04:52.628033 5101 webserver.cc:460] Webserver started at http://127.4.201.65:45453/ using document root <none> and password file <none>
I20260812 01:04:52.628664 5101 fs_manager.cc:359] Metadata directory not provided
I20260812 01:04:52.628764 5101 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:04:52.629027 5101 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:04:52.632038 5101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-0/data/instance:
uuid: "da1f4500f7ed4488859080b9c785e091"
format_stamp: "Formatted at 2026-08-12 01:04:52 on dist-test-slave-bndk"
server_key: "2dda2f275fb034b1e0fd6bcb4fc9dd40"
server_key_iv: "82fcd391483b5253edd53f5462c8ea51"
server_key_version: "encryptionkey@0"
I20260812 01:04:52.632958 5101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance:
uuid: "da1f4500f7ed4488859080b9c785e091"
format_stamp: "Formatted at 2026-08-12 01:04:52 on dist-test-slave-bndk"
server_key: "2dda2f275fb034b1e0fd6bcb4fc9dd40"
server_key_iv: "82fcd391483b5253edd53f5462c8ea51"
server_key_version: "encryptionkey@0"
I20260812 01:04:52.638198 5101 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260812 01:04:52.641552 5130 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:04:52.642872 5101 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260812 01:04:52.643006 5101 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "da1f4500f7ed4488859080b9c785e091"
format_stamp: "Formatted at 2026-08-12 01:04:52 on dist-test-slave-bndk"
server_key: "2dda2f275fb034b1e0fd6bcb4fc9dd40"
server_key_iv: "82fcd391483b5253edd53f5462c8ea51"
server_key_version: "encryptionkey@0"
I20260812 01:04:52.643160 5101 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:04:52.673398 5101 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:04:52.677246 5101 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:04:52.677505 5101 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:04:52.678500 5101 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:04:52.679829 5101 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:04:52.679909 5101 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:04:52.680006 5101 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:04:52.680061 5101 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:04:52.717648 5101 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:34965
I20260812 01:04:52.717717 5327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:34965 every 8 connection(s)
I20260812 01:04:52.718999 5101 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:04:52.726660 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 5101
I20260812 01:04:52.726866 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance
I20260812 01:04:52.727465 4901 external_mini_cluster.cc:1428] Setting key 07f0050d759a1e9bcad741e165e3f76a
Aug 12 01:04:52 dist-test-slave-bndk krb5kdc[4911](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496692, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:04:52.740082 5332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:52.722016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:54831 (local address 127.4.201.126:33277)
0812 01:04:52.722547 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0812 01:04:52.722552 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:04:52.723347 (+ 795us) server_negotiation.cc:407] Connection header received
0812 01:04:52.725244 (+ 1897us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:04:52.725250 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:04:52.725345 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:04:52.725443 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:04:52.727112 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:52.727902 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:52.730006 (+ 2104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:52.730495 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:52.730620 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:52.734461 (+ 3841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:04:52.734466 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:04:52.734469 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:04:52.734501 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:04:52.737090 (+ 2589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:52.737826 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:52.737832 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:52.737835 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:52.737982 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:52.738384 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:52.738388 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:52.738391 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:52.738722 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:04:52.738859 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 01:04:52.739511 (+ 652us) server_negotiation.cc:299] Negotiation successful
0812 01:04:52.739727 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":309,"threads_started":1}
I20260812 01:04:52.740756 5333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:52.722424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33277 (local address 127.4.201.65:54831)
0812 01:04:52.723139 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0812 01:04:52.723185 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 01:04:52.724947 (+ 1762us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:04:52.725696 (+ 749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:04:52.725704 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:04:52.726201 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:04:52.726870 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:04:52.726892 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:04:52.728072 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:04:52.728076 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:04:52.729870 (+ 1794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:04:52.729883 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:04:52.730727 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:04:52.730736 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:04:52.731022 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:52.731650 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:04:52.731673 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:04:52.734221 (+ 2548us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:04:52.737274 (+ 3053us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:04:52.737281 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:04:52.737294 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:04:52.737711 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:04:52.738083 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:04:52.738086 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:04:52.738089 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:04:52.738270 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:04:52.738848 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:04:52.738854 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:04:52.739149 (+ 295us) client_negotiation.cc:769] Sending connection context
0812 01:04:52.739369 (+ 220us) client_negotiation.cc:240] Negotiation successful
0812 01:04:52.739731 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":266,"threads_started":1}
I20260812 01:04:52.742403 5328 heartbeater.cc:347] Connected to a master server at 127.4.201.126:33277
I20260812 01:04:52.742821 5328 heartbeater.cc:464] Registering TS with master...
I20260812 01:04:52.743732 5328 heartbeater.cc:511] Master 127.4.201.126:33277 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.4.201.66@KRBTEST.COM; defaulting to no policy
I20260812 01:04:52.747712 4990 ts_manager.cc:194] Registered new tserver with Master: da1f4500f7ed4488859080b9c785e091 (127.4.201.65:34965)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.66@KRBTEST.COM" created.
I20260812 01:04:52.749934 4990 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.65@KRBTEST.COM'} at 127.4.201.65:54831
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
I20260812 01:04:52.770129 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:0
--local_ip_for_outbound_sockets=127.4.201.66
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:33277
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:35689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:04:53.114778 5337 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:04:53.115046 5337 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:04:53.115150 5337 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:04:53.122673 5337 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:04:53.122781 5337 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:04:53.122897 5337 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:04:53.133121 5337 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:35689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:33277
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:04:53.134359 5337 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:04:53.135591 5337 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:04:53.148623 5347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:04:53.148676 5345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:04:53.148886 5344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:04:53.149734 5337 server_base.cc:1034] running on GCE node
I20260812 01:04:53.150315 5337 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:04:53.151263 5337 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:04:53.152487 5337 hybrid_clock.cc:648] HybridClock initialized: now 1786496693152434 us; error 46 us; skew 500 ppm
I20260812 01:04:53.152791 5337 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:04:53 dist-test-slave-bndk krb5kdc[4911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496693, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:04:53.155860 5337 init.cc:377] Logged in from keytab as kudu/127.4.201.66@KRBTEST.COM (short username kudu)
I20260812 01:04:53.157420 5337 webserver.cc:460] Webserver started at http://127.4.201.66:44587/ using document root <none> and password file <none>
I20260812 01:04:53.158100 5337 fs_manager.cc:359] Metadata directory not provided
I20260812 01:04:53.158216 5337 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:04:53.158521 5337 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:04:53.161463 5337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-1/data/instance:
uuid: "8ece1cee256f4124a3a11e7609472a41"
format_stamp: "Formatted at 2026-08-12 01:04:53 on dist-test-slave-bndk"
server_key: "dd20b419c9fba5005ae20a65afea7963"
server_key_iv: "8a934d388bb4c58b4470ab34d11b20a9"
server_key_version: "encryptionkey@0"
I20260812 01:04:53.162264 5337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance:
uuid: "8ece1cee256f4124a3a11e7609472a41"
format_stamp: "Formatted at 2026-08-12 01:04:53 on dist-test-slave-bndk"
server_key: "dd20b419c9fba5005ae20a65afea7963"
server_key_iv: "8a934d388bb4c58b4470ab34d11b20a9"
server_key_version: "encryptionkey@0"
I20260812 01:04:53.167419 5337 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 01:04:53.171023 5358 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:04:53.172315 5337 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 01:04:53.172468 5337 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "8ece1cee256f4124a3a11e7609472a41"
format_stamp: "Formatted at 2026-08-12 01:04:53 on dist-test-slave-bndk"
server_key: "dd20b419c9fba5005ae20a65afea7963"
server_key_iv: "8a934d388bb4c58b4470ab34d11b20a9"
server_key_version: "encryptionkey@0"
I20260812 01:04:53.172677 5337 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:04:53.205773 5337 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:04:53.209878 5337 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:04:53.210143 5337 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:04:53.211180 5337 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:04:53.212656 5337 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:04:53.212740 5337 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:04:53.212870 5337 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:04:53.212926 5337 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:04:53.246783 5337 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:34583
I20260812 01:04:53.246829 5534 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:34583 every 8 connection(s)
I20260812 01:04:53.248114 5337 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:04:53.255869 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 5337
I20260812 01:04:53.256052 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance
I20260812 01:04:53.256450 4901 external_mini_cluster.cc:1428] Setting key f70a9e33e3d18f2a70c8204f85c05349
Aug 12 01:04:53 dist-test-slave-bndk krb5kdc[4911](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496693, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:04:53.268152 5540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:53.250637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:45087 (local address 127.4.201.126:33277)
0812 01:04:53.251110 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0812 01:04:53.251115 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:04:53.252077 (+ 962us) server_negotiation.cc:407] Connection header received
0812 01:04:53.254009 (+ 1932us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:04:53.254015 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:04:53.254095 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:04:53.254192 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:04:53.255664 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:53.256434 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:53.258358 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:53.258779 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:53.258895 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:53.262373 (+ 3478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:04:53.262378 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:04:53.262382 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:04:53.262415 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:04:53.265121 (+ 2706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:53.265871 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:53.265877 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:53.265880 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:53.266039 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:53.266424 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:53.266428 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:53.266431 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:53.266755 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:04:53.266907 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0812 01:04:53.267557 (+ 650us) server_negotiation.cc:299] Negotiation successful
0812 01:04:53.267790 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":262,"threads_started":1}
I20260812 01:04:53.268838 5541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:53.251169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33277 (local address 127.4.201.66:45087)
0812 01:04:53.251895 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0812 01:04:53.251938 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 01:04:53.253736 (+ 1798us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:04:53.254441 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:04:53.254448 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:04:53.254942 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:04:53.255491 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:04:53.255509 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:04:53.256616 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:04:53.256622 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:04:53.258162 (+ 1540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:04:53.258180 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:04:53.259007 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:04:53.259015 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:04:53.259232 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:53.259839 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:04:53.259867 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:04:53.262116 (+ 2249us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:04:53.265302 (+ 3186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:04:53.265309 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:04:53.265321 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:04:53.265734 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:04:53.266133 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:04:53.266136 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:04:53.266138 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:04:53.266308 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:04:53.266872 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:04:53.266878 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:04:53.267198 (+ 320us) client_negotiation.cc:769] Sending connection context
0812 01:04:53.267414 (+ 216us) client_negotiation.cc:240] Negotiation successful
0812 01:04:53.267788 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":293,"threads_started":1}
I20260812 01:04:53.270244 5536 heartbeater.cc:347] Connected to a master server at 127.4.201.126:33277
I20260812 01:04:53.270587 5536 heartbeater.cc:464] Registering TS with master...
I20260812 01:04:53.271485 5536 heartbeater.cc:511] Master 127.4.201.126:33277 requested a full tablet report, sending...
I20260812 01:04:53.273159 4990 ts_manager.cc:194] Registered new tserver with Master: 8ece1cee256f4124a3a11e7609472a41 (127.4.201.66:34583)
I20260812 01:04:53.273993 4990 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.66@KRBTEST.COM'} at 127.4.201.66:45087
WARNING: no policy specified for kudu/127.4.201.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
I20260812 01:04:53.301203 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:0
--local_ip_for_outbound_sockets=127.4.201.67
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:33277
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:35689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:04:53.634793 5547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:04:53.635063 5547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:04:53.635197 5547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:04:53.642325 5547 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:04:53.642438 5547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:04:53.642591 5547 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:04:53.652284 5547 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:35689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:33277
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:04:53.653744 5547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:04:53.655038 5547 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:04:53.668299 5563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:04:53.668345 5559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:04:53.668381 5561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:04:53.669206 5547 server_base.cc:1034] running on GCE node
I20260812 01:04:53.669832 5547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:04:53.670753 5547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:04:53.671949 5547 hybrid_clock.cc:648] HybridClock initialized: now 1786496693671905 us; error 33 us; skew 500 ppm
I20260812 01:04:53.672228 5547 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:04:53 dist-test-slave-bndk krb5kdc[4911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496693, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:04:53.675352 5547 init.cc:377] Logged in from keytab as kudu/127.4.201.67@KRBTEST.COM (short username kudu)
I20260812 01:04:53.676772 5547 webserver.cc:460] Webserver started at http://127.4.201.67:40559/ using document root <none> and password file <none>
I20260812 01:04:53.677516 5547 fs_manager.cc:359] Metadata directory not provided
I20260812 01:04:53.677623 5547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:04:53.677899 5547 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:04:53.680838 5547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-2/data/instance:
uuid: "1ecac2634a5b495881a2cdf1a66eab22"
format_stamp: "Formatted at 2026-08-12 01:04:53 on dist-test-slave-bndk"
server_key: "0e6da750b589324c6f9428c7072e4c76"
server_key_iv: "7508d0bde72448e003813cff3284dcf2"
server_key_version: "encryptionkey@0"
I20260812 01:04:53.681613 5547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance:
uuid: "1ecac2634a5b495881a2cdf1a66eab22"
format_stamp: "Formatted at 2026-08-12 01:04:53 on dist-test-slave-bndk"
server_key: "0e6da750b589324c6f9428c7072e4c76"
server_key_iv: "7508d0bde72448e003813cff3284dcf2"
server_key_version: "encryptionkey@0"
I20260812 01:04:53.686676 5547 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 01:04:53.690037 5574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:04:53.691666 5547 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 01:04:53.691826 5547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "1ecac2634a5b495881a2cdf1a66eab22"
format_stamp: "Formatted at 2026-08-12 01:04:53 on dist-test-slave-bndk"
server_key: "0e6da750b589324c6f9428c7072e4c76"
server_key_iv: "7508d0bde72448e003813cff3284dcf2"
server_key_version: "encryptionkey@0"
I20260812 01:04:53.692050 5547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:04:53.720769 5547 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:04:53.724824 5547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:04:53.725143 5547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:04:53.726094 5547 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:04:53.727384 5547 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:04:53.727458 5547 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:04:53.727584 5547 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:04:53.727644 5547 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:04:53.753345 5328 heartbeater.cc:503] Master 127.4.201.126:33277 was elected leader, sending a full tablet report...
I20260812 01:04:53.764678 5547 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:44367
I20260812 01:04:53.764714 5767 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:44367 every 8 connection(s)
I20260812 01:04:53.766031 5547 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:04:53.769187 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 5547
I20260812 01:04:53.769409 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance
I20260812 01:04:53.769891 4901 external_mini_cluster.cc:1428] Setting key 24478d7a9fa3186645be02ed2d04665c
Aug 12 01:04:53 dist-test-slave-bndk krb5kdc[4911](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496693, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:04:53.785435 5772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:53.768593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:32769 (local address 127.4.201.126:33277)
0812 01:04:53.769061 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0812 01:04:53.769068 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:04:53.770140 (+ 1072us) server_negotiation.cc:407] Connection header received
0812 01:04:53.772239 (+ 2099us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:04:53.772244 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:04:53.772344 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:04:53.772436 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:04:53.773954 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:53.774749 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:53.776255 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:53.776687 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:53.776796 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:53.779996 (+ 3200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:04:53.780001 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:04:53.780004 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:04:53.780038 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:04:53.782364 (+ 2326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:53.783135 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:53.783139 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:53.783141 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:53.783263 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:53.783678 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:53.783681 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:53.783684 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:53.783948 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:04:53.784092 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 01:04:53.784791 (+ 699us) server_negotiation.cc:299] Negotiation successful
0812 01:04:53.785013 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":195,"threads_started":1}
I20260812 01:04:53.786341 5773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:53.769118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33277 (local address 127.4.201.67:32769)
0812 01:04:53.769962 (+ 844us) negotiation.cc:107] Waiting for socket to connect
0812 01:04:53.770010 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 01:04:53.771975 (+ 1965us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:04:53.772682 (+ 707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:04:53.772690 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:04:53.773192 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:04:53.773789 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:04:53.773807 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:04:53.774897 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:04:53.774901 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:04:53.776112 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:04:53.776127 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:04:53.776915 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:04:53.776923 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:04:53.777149 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:53.777752 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:04:53.777773 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:04:53.779809 (+ 2036us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:04:53.782503 (+ 2694us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:04:53.782512 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:04:53.782527 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:04:53.783002 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:04:53.783367 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:04:53.783372 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:04:53.783376 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:04:53.783562 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:04:53.784092 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:04:53.784100 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:04:53.784401 (+ 301us) client_negotiation.cc:769] Sending connection context
0812 01:04:53.784633 (+ 232us) client_negotiation.cc:240] Negotiation successful
0812 01:04:53.785151 (+ 518us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":340,"threads_started":1}
I20260812 01:04:53.787638 5770 heartbeater.cc:347] Connected to a master server at 127.4.201.126:33277
I20260812 01:04:53.787958 5770 heartbeater.cc:464] Registering TS with master...
I20260812 01:04:53.788656 5770 heartbeater.cc:511] Master 127.4.201.126:33277 requested a full tablet report, sending...
I20260812 01:04:53.790000 4990 ts_manager.cc:194] Registered new tserver with Master: 1ecac2634a5b495881a2cdf1a66eab22 (127.4.201.67:44367)
I20260812 01:04:53.790762 4990 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.67@KRBTEST.COM'} at 127.4.201.67:32769
I20260812 01:04:53.797899 4901 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 01:04:53 dist-test-slave-bndk krb5kdc[4911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496693, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 01:04:53 dist-test-slave-bndk krb5kdc[4911](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496693, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.4.201.65@KRBTEST.COM
I20260812 01:04:53.852268 5782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:53.837370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41022 (local address 127.4.201.65:34965)
0812 01:04:53.838076 (+ 706us) server_negotiation.cc:206] Beginning negotiation
0812 01:04:53.838084 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:04:53.838116 (+ 32us) server_negotiation.cc:407] Connection header received
0812 01:04:53.838274 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:04:53.838281 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:04:53.838514 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:04:53.838649 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:04:53.840089 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:53.841126 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:53.842607 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:53.843202 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:53.843301 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:53.847166 (+ 3865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:04:53.847178 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:04:53.847195 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:04:53.847229 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:04:53.849926 (+ 2697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:53.850488 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:53.850494 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:53.850496 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:53.850617 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:53.850921 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:53.850924 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:53.850926 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:53.851267 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:04:53.851518 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0812 01:04:53.851703 (+ 185us) server_negotiation.cc:299] Negotiation successful
0812 01:04:53.851904 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":538,"thread_start_us":364,"threads_started":1}
W20260812 01:04:53.853513 5181 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41022
Aug 12 01:04:53 dist-test-slave-bndk krb5kdc[4911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496693, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 01:04:53 dist-test-slave-bndk krb5kdc[4911](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496693, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.65@KRBTEST.COM
I20260812 01:04:53.902505 5782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:53.889314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41032 (local address 127.4.201.65:34965)
0812 01:04:53.889545 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0812 01:04:53.889552 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:04:53.889692 (+ 140us) server_negotiation.cc:407] Connection header received
0812 01:04:53.889846 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:04:53.889850 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:04:53.889948 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:04:53.890039 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:04:53.891524 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:53.892432 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:53.893690 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:53.894110 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:53.894201 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:53.897852 (+ 3651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:04:53.897858 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:04:53.897861 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:04:53.897894 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:04:53.900364 (+ 2470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:53.900949 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:53.900952 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:53.900955 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:53.901076 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:53.901407 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:53.901410 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:53.901412 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:53.901659 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:04:53.901835 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0812 01:04:53.902042 (+ 207us) server_negotiation.cc:299] Negotiation successful
0812 01:04:53.902205 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 01:04:53.904215 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 5101
I20260812 01:04:53.916347 5782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:53.905200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41040 (local address 127.4.201.65:34965)
0812 01:04:53.905393 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 01:04:53.905399 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:04:53.905677 (+ 278us) server_negotiation.cc:407] Connection header received
0812 01:04:53.905775 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:04:53.905778 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:04:53.905831 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:04:53.905916 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:04:53.907083 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:53.907828 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:53.909476 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:53.909886 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:53.909975 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:53.911978 (+ 2003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:04:53.911985 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:04:53.911988 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:04:53.912015 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:04:53.914273 (+ 2258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:53.914822 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:53.914825 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:53.914828 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:53.914948 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:53.915282 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:53.915285 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:53.915287 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:53.915529 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:04:53.915703 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0812 01:04:53.915894 (+ 191us) server_negotiation.cc:299] Negotiation successful
0812 01:04:53.916037 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 01:04:53.917112 5317 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:04:54.003827 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 5101
I20260812 01:04:54.028791 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 5337
Aug 12 01:04:54 dist-test-slave-bndk krb5kdc[4911](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496693, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.66@KRBTEST.COM
I20260812 01:04:54.044236 5796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:54.029745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36450 (local address 127.4.201.66:34583)
0812 01:04:54.030258 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0812 01:04:54.030266 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:04:54.030292 (+ 26us) server_negotiation.cc:407] Connection header received
0812 01:04:54.030356 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:04:54.030362 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:04:54.030590 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:04:54.030720 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:04:54.031989 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:54.033183 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:54.034512 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:54.035084 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:54.035191 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:54.039128 (+ 3937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:04:54.039140 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:04:54.039155 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:04:54.039194 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:04:54.041826 (+ 2632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:54.042460 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:54.042467 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:54.042470 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:54.042599 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:54.042919 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:54.042922 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:54.042924 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:54.043251 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:04:54.043477 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0812 01:04:54.043713 (+ 236us) server_negotiation.cc:299] Negotiation successful
0812 01:04:54.043908 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":235,"threads_started":1}
I20260812 01:04:54.045548 5529 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:04:54.127084 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 5337
I20260812 01:04:54.148332 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 5547
Aug 12 01:04:54 dist-test-slave-bndk krb5kdc[4911](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496693, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.67@KRBTEST.COM
I20260812 01:04:54.164225 5798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:54.149351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47820 (local address 127.4.201.67:44367)
0812 01:04:54.150005 (+ 654us) server_negotiation.cc:206] Beginning negotiation
0812 01:04:54.150012 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:04:54.150042 (+ 30us) server_negotiation.cc:407] Connection header received
0812 01:04:54.150104 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:04:54.150111 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:04:54.150324 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:04:54.150489 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:04:54.151797 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:54.152823 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:54.154252 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:54.154837 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:54.154965 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:54.159036 (+ 4071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:04:54.159047 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:04:54.159063 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:04:54.159099 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:04:54.161907 (+ 2808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:54.162535 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:54.162542 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:54.162545 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:54.162672 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:54.162945 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:54.162948 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:54.162950 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:54.163273 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:04:54.163539 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0812 01:04:54.163729 (+ 190us) server_negotiation.cc:299] Negotiation successful
0812 01:04:54.163932 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":491,"thread_start_us":318,"threads_started":1}
I20260812 01:04:54.165584 5761 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:04:54.246299 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 5547
I20260812 01:04:54.269698 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 4930
I20260812 01:04:54.270841 5041 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:04:54.374169 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 4930
2026-08-12T01:04:54Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4375 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:04:54 dist-test-slave-bndk krb5kdc[5804](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:04:54 dist-test-slave-bndk krb5kdc[5804](info): set up 2 sockets
Aug 12 01:04:54 dist-test-slave-bndk krb5kdc[5804](info): commencing operation
krb5kdc: starting...
W20260812 01:04:55.577505 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.153s user 0.001s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:04:55 dist-test-slave-bndk krb5kdc[5804](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496695, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:04:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:04:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.201.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
I20260812 01:04:55.753679 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:44333
--webserver_interface=127.4.201.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:34373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:44333
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:04:56.069280 5824 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:04:56.069602 5824 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:04:56.069773 5824 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:04:56.076956 5824 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:04:56.077059 5824 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:04:56.077132 5824 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:04:56.077210 5824 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:04:56.077294 5824 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:04:56.087045 5824 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:34373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:44333
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:44333
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:04:56.088341 5824 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:04:56.089632 5824 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:04:56.100878 5833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:04:56.100900 5835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:04:56.101008 5832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:04:56.101595 5824 server_base.cc:1034] running on GCE node
I20260812 01:04:56.102298 5824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:04:56.103744 5824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:04:56.104986 5824 hybrid_clock.cc:648] HybridClock initialized: now 1786496696104928 us; error 37 us; skew 500 ppm
I20260812 01:04:56.105369 5824 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:04:56 dist-test-slave-bndk krb5kdc[5804](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496696, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:04:56.113675 5824 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:04:56.115103 5824 webserver.cc:460] Webserver started at http://127.4.201.126:37101/ using document root <none> and password file <none>
I20260812 01:04:56.115783 5824 fs_manager.cc:359] Metadata directory not provided
I20260812 01:04:56.115902 5824 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:04:56.116196 5824 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:04:56.119153 5824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "b418cd798f6d4ddba550e438f42e00ae"
format_stamp: "Formatted at 2026-08-12 01:04:56 on dist-test-slave-bndk"
server_key: "4ab5a0ac80b87fa8df78beb634b112f6"
server_key_iv: "74911fd971da124a202d44a9781d27dc"
server_key_version: "encryptionkey@0"
I20260812 01:04:56.119880 5824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "b418cd798f6d4ddba550e438f42e00ae"
format_stamp: "Formatted at 2026-08-12 01:04:56 on dist-test-slave-bndk"
server_key: "4ab5a0ac80b87fa8df78beb634b112f6"
server_key_iv: "74911fd971da124a202d44a9781d27dc"
server_key_version: "encryptionkey@0"
I20260812 01:04:56.124799 5824 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 01:04:56.128021 5843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:04:56.129282 5824 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 01:04:56.129447 5824 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "b418cd798f6d4ddba550e438f42e00ae"
format_stamp: "Formatted at 2026-08-12 01:04:56 on dist-test-slave-bndk"
server_key: "4ab5a0ac80b87fa8df78beb634b112f6"
server_key_iv: "74911fd971da124a202d44a9781d27dc"
server_key_version: "encryptionkey@0"
I20260812 01:04:56.129634 5824 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:04:56.162889 5824 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:04:56.166749 5824 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:04:56.167014 5824 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:04:56.184115 5824 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:44333
I20260812 01:04:56.184139 5943 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:44333 every 8 connection(s)
I20260812 01:04:56.185499 5824 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:04:56.187743 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 5824
I20260812 01:04:56.187939 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:04:56.188584 4901 external_mini_cluster.cc:1428] Setting key 609f8a86aa925582f552949c1e9b38dc
I20260812 01:04:56.189244 5944 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:04:56.203112 5944 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b418cd798f6d4ddba550e438f42e00ae: Bootstrap starting.
Aug 12 01:04:56 dist-test-slave-bndk krb5kdc[5804](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496695, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:04:56.206235 5944 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b418cd798f6d4ddba550e438f42e00ae: Neither blocks nor log segments found. Creating new log.
I20260812 01:04:56.207253 5944 log.cc:824] T 00000000000000000000000000000000 P b418cd798f6d4ddba550e438f42e00ae: Log is configured to *not* fsync() on all Append() calls
I20260812 01:04:56.209908 5944 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b418cd798f6d4ddba550e438f42e00ae: No bootstrap required, opened a new log
I20260812 01:04:56.211197 5947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:56.190540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54912 (local address 127.4.201.126:44333)
0812 01:04:56.191395 (+ 855us) server_negotiation.cc:206] Beginning negotiation
0812 01:04:56.191406 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:04:56.191446 (+ 40us) server_negotiation.cc:407] Connection header received
0812 01:04:56.193726 (+ 2280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:04:56.193748 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:04:56.194129 (+ 381us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:04:56.194444 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:04:56.196192 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:56.197513 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:56.199163 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:56.199825 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:56.199960 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:56.204427 (+ 4467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:04:56.204436 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:04:56.204449 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:04:56.204497 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:04:56.207392 (+ 2895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:56.208017 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:56.208023 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:56.208034 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:56.208198 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:56.208552 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:56.208556 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:56.208558 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:56.209046 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:04:56.209356 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0812 01:04:56.209862 (+ 506us) server_negotiation.cc:299] Negotiation successful
0812 01:04:56.210282 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":638,"thread_start_us":384,"threads_started":1}
I20260812 01:04:56.217144 5944 raft_consensus.cc:348] T 00000000000000000000000000000000 P b418cd798f6d4ddba550e438f42e00ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b418cd798f6d4ddba550e438f42e00ae" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44333 } }
I20260812 01:04:56.217548 5944 raft_consensus.cc:374] T 00000000000000000000000000000000 P b418cd798f6d4ddba550e438f42e00ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:04:56.217639 5944 raft_consensus.cc:729] T 00000000000000000000000000000000 P b418cd798f6d4ddba550e438f42e00ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b418cd798f6d4ddba550e438f42e00ae, State: Initialized, Role: FOLLOWER
I20260812 01:04:56.218137 5944 consensus_queue.cc:260] T 00000000000000000000000000000000 P b418cd798f6d4ddba550e438f42e00ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b418cd798f6d4ddba550e438f42e00ae" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44333 } }
I20260812 01:04:56.218343 5944 raft_consensus.cc:388] T 00000000000000000000000000000000 P b418cd798f6d4ddba550e438f42e00ae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:04:56.218467 5944 raft_consensus.cc:482] T 00000000000000000000000000000000 P b418cd798f6d4ddba550e438f42e00ae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:04:56.218626 5944 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b418cd798f6d4ddba550e438f42e00ae [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:04:56.220697 5944 raft_consensus.cc:504] T 00000000000000000000000000000000 P b418cd798f6d4ddba550e438f42e00ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b418cd798f6d4ddba550e438f42e00ae" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44333 } }
I20260812 01:04:56.221153 5944 leader_election.cc:302] T 00000000000000000000000000000000 P b418cd798f6d4ddba550e438f42e00ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b418cd798f6d4ddba550e438f42e00ae; no voters:
I20260812 01:04:56.221771 5944 leader_election.cc:288] T 00000000000000000000000000000000 P b418cd798f6d4ddba550e438f42e00ae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:04:56.221881 5949 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b418cd798f6d4ddba550e438f42e00ae [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:04:56.222515 5949 raft_consensus.cc:686] T 00000000000000000000000000000000 P b418cd798f6d4ddba550e438f42e00ae [term 1 LEADER]: Becoming Leader. State: Replica: b418cd798f6d4ddba550e438f42e00ae, State: Running, Role: LEADER
I20260812 01:04:56.223045 5949 consensus_queue.cc:237] T 00000000000000000000000000000000 P b418cd798f6d4ddba550e438f42e00ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b418cd798f6d4ddba550e438f42e00ae" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44333 } }
I20260812 01:04:56.223742 5944 sys_catalog.cc:564] T 00000000000000000000000000000000 P b418cd798f6d4ddba550e438f42e00ae [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:04:56.225878 5952 sys_catalog.cc:455] T 00000000000000000000000000000000 P b418cd798f6d4ddba550e438f42e00ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader b418cd798f6d4ddba550e438f42e00ae. Latest consensus state: current_term: 1 leader_uuid: "b418cd798f6d4ddba550e438f42e00ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b418cd798f6d4ddba550e438f42e00ae" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44333 } } }
I20260812 01:04:56.226291 5952 sys_catalog.cc:458] T 00000000000000000000000000000000 P b418cd798f6d4ddba550e438f42e00ae [sys.catalog]: This master's current role is: LEADER
I20260812 01:04:56.226841 5950 sys_catalog.cc:455] T 00000000000000000000000000000000 P b418cd798f6d4ddba550e438f42e00ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b418cd798f6d4ddba550e438f42e00ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b418cd798f6d4ddba550e438f42e00ae" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44333 } } }
I20260812 01:04:56.227259 5950 sys_catalog.cc:458] T 00000000000000000000000000000000 P b418cd798f6d4ddba550e438f42e00ae [sys.catalog]: This master's current role is: LEADER
I20260812 01:04:56.229419 5961 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:04:56.234012 5961 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:04:56.241727 5961 catalog_manager.cc:1347] Generated new cluster ID: 9ae5e2e8917045c7939bbd422740572e
I20260812 01:04:56.241864 5961 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:04:56.255357 5961 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:04:56.257256 5961 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:04:56.265383 5961 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b418cd798f6d4ddba550e438f42e00ae: Generated new TSK 0
I20260812 01:04:56.266348 5961 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.201.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
I20260812 01:04:56.329018 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:0
--local_ip_for_outbound_sockets=127.4.201.65
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:44333
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:34373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:04:56.671504 5982 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:04:56.671794 5982 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:04:56.671909 5982 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:04:56.679023 5982 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:04:56.679122 5982 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:04:56.679243 5982 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:04:56.688678 5982 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:34373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:44333
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:04:56.689949 5982 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:04:56.691198 5982 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:04:56.703962 5995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:04:56.703920 6000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:04:56.703923 5998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:04:56.704619 5982 server_base.cc:1034] running on GCE node
I20260812 01:04:56.705197 5982 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:04:56.706122 5982 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:04:56.707314 5982 hybrid_clock.cc:648] HybridClock initialized: now 1786496696707256 us; error 52 us; skew 500 ppm
I20260812 01:04:56.707603 5982 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:04:56 dist-test-slave-bndk krb5kdc[5804](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496696, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:04:56.710723 5982 init.cc:377] Logged in from keytab as kudu/127.4.201.65@KRBTEST.COM (short username kudu)
I20260812 01:04:56.712117 5982 webserver.cc:460] Webserver started at http://127.4.201.65:39183/ using document root <none> and password file <none>
I20260812 01:04:56.712754 5982 fs_manager.cc:359] Metadata directory not provided
I20260812 01:04:56.712848 5982 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:04:56.713099 5982 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:04:56.715811 5982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-0/data/instance:
uuid: "71bd7cb871304c47aa1a38f9b80847de"
format_stamp: "Formatted at 2026-08-12 01:04:56 on dist-test-slave-bndk"
server_key: "5dc4c06681d5b752f8b3c6027821d935"
server_key_iv: "c6c68c9d1339535cb5e67d32133d9893"
server_key_version: "encryptionkey@0"
I20260812 01:04:56.716523 5982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance:
uuid: "71bd7cb871304c47aa1a38f9b80847de"
format_stamp: "Formatted at 2026-08-12 01:04:56 on dist-test-slave-bndk"
server_key: "5dc4c06681d5b752f8b3c6027821d935"
server_key_iv: "c6c68c9d1339535cb5e67d32133d9893"
server_key_version: "encryptionkey@0"
I20260812 01:04:56.721298 5982 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.004s
I20260812 01:04:56.724509 6011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:04:56.725800 5982 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:04:56.725942 5982 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "71bd7cb871304c47aa1a38f9b80847de"
format_stamp: "Formatted at 2026-08-12 01:04:56 on dist-test-slave-bndk"
server_key: "5dc4c06681d5b752f8b3c6027821d935"
server_key_iv: "c6c68c9d1339535cb5e67d32133d9893"
server_key_version: "encryptionkey@0"
I20260812 01:04:56.726110 5982 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:04:56.741752 5982 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:04:56.745579 5982 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:04:56.745831 5982 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:04:56.746778 5982 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:04:56.748031 5982 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:04:56.748101 5982 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:04:56.748215 5982 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:04:56.748266 5982 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:04:56.778187 5982 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:42441
I20260812 01:04:56.778234 6198 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:42441 every 8 connection(s)
I20260812 01:04:56.779419 5982 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:04:56.780211 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 5982
I20260812 01:04:56.780431 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance
I20260812 01:04:56.781121 4901 external_mini_cluster.cc:1428] Setting key 77eeea4cabff9d78d299ec28520bf31f
Aug 12 01:04:56 dist-test-slave-bndk krb5kdc[5804](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496696, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:04:56.800973 6202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:56.782103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:53471 (local address 127.4.201.126:44333)
0812 01:04:56.782546 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0812 01:04:56.782551 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:04:56.783663 (+ 1112us) server_negotiation.cc:407] Connection header received
0812 01:04:56.786171 (+ 2508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:04:56.786175 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:04:56.786240 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:04:56.786331 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:04:56.788241 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:56.788944 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:56.790765 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:56.791354 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:56.791530 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:56.794914 (+ 3384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:04:56.794920 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:04:56.794924 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:04:56.794962 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:04:56.797974 (+ 3012us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:56.798628 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:56.798634 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:56.798638 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:56.798797 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:56.799194 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:56.799199 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:56.799202 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:56.799550 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:04:56.799701 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 01:04:56.800378 (+ 677us) server_negotiation.cc:299] Negotiation successful
0812 01:04:56.800615 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":224,"threads_started":1}
WARNING: no policy specified for kudu/127.4.201.66@KRBTEST.COM; defaulting to no policy
I20260812 01:04:56.801688 6203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:56.782652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:44333 (local address 127.4.201.65:53471)
0812 01:04:56.783488 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0812 01:04:56.783539 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 01:04:56.785890 (+ 2351us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:04:56.786609 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:04:56.786622 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:04:56.787316 (+ 694us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:04:56.788067 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:04:56.788091 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:04:56.789098 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:04:56.789103 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:04:56.790619 (+ 1516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:04:56.790632 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:04:56.791597 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:04:56.791602 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:04:56.791798 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:56.792409 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:04:56.792433 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:04:56.794695 (+ 2262us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:04:56.798100 (+ 3405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:04:56.798107 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:04:56.798118 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:04:56.798504 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:04:56.798890 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:04:56.798893 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:04:56.798895 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:04:56.799082 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:04:56.799676 (+ 594us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:04:56.799681 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:04:56.799991 (+ 310us) client_negotiation.cc:769] Sending connection context
0812 01:04:56.800209 (+ 218us) client_negotiation.cc:240] Negotiation successful
0812 01:04:56.800571 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":325,"threads_started":1}
I20260812 01:04:56.803119 6199 heartbeater.cc:347] Connected to a master server at 127.4.201.126:44333
I20260812 01:04:56.803421 6199 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.66@KRBTEST.COM" created.
I20260812 01:04:56.804203 6199 heartbeater.cc:511] Master 127.4.201.126:44333 requested a full tablet report, sending...
I20260812 01:04:56.806322 5871 ts_manager.cc:194] Registered new tserver with Master: 71bd7cb871304c47aa1a38f9b80847de (127.4.201.65:42441)
I20260812 01:04:56.807708 5871 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.65@KRBTEST.COM'} at 127.4.201.65:53471
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
I20260812 01:04:56.824245 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:0
--local_ip_for_outbound_sockets=127.4.201.66
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:44333
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:34373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:04:57.139371 6212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:04:57.139642 6212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:04:57.139786 6212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:04:57.146989 6212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:04:57.147113 6212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:04:57.147267 6212 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:04:57.156716 6212 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:34373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:44333
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:04:57.157997 6212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:04:57.159343 6212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:04:57.171983 6223 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:04:57.172008 6226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:04:57.172657 6220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:04:57.172659 6212 server_base.cc:1034] running on GCE node
I20260812 01:04:57.173381 6212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:04:57.174237 6212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:04:57.175432 6212 hybrid_clock.cc:648] HybridClock initialized: now 1786496697175384 us; error 36 us; skew 500 ppm
I20260812 01:04:57.175724 6212 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:04:57 dist-test-slave-bndk krb5kdc[5804](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496697, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:04:57.178689 6212 init.cc:377] Logged in from keytab as kudu/127.4.201.66@KRBTEST.COM (short username kudu)
I20260812 01:04:57.180080 6212 webserver.cc:460] Webserver started at http://127.4.201.66:39289/ using document root <none> and password file <none>
I20260812 01:04:57.180716 6212 fs_manager.cc:359] Metadata directory not provided
I20260812 01:04:57.180843 6212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:04:57.181142 6212 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:04:57.184131 6212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-1/data/instance:
uuid: "b6b2a7f1fac54a229848b32370bd821e"
format_stamp: "Formatted at 2026-08-12 01:04:57 on dist-test-slave-bndk"
server_key: "7a18e1fbcbee4e70b5805a8f5ba17bfe"
server_key_iv: "86c4a85ea633bdc8dabdcf9d9aa8c08d"
server_key_version: "encryptionkey@0"
I20260812 01:04:57.184942 6212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance:
uuid: "b6b2a7f1fac54a229848b32370bd821e"
format_stamp: "Formatted at 2026-08-12 01:04:57 on dist-test-slave-bndk"
server_key: "7a18e1fbcbee4e70b5805a8f5ba17bfe"
server_key_iv: "86c4a85ea633bdc8dabdcf9d9aa8c08d"
server_key_version: "encryptionkey@0"
I20260812 01:04:57.189782 6212 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260812 01:04:57.193137 6238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:04:57.194499 6212 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 01:04:57.194648 6212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "b6b2a7f1fac54a229848b32370bd821e"
format_stamp: "Formatted at 2026-08-12 01:04:57 on dist-test-slave-bndk"
server_key: "7a18e1fbcbee4e70b5805a8f5ba17bfe"
server_key_iv: "86c4a85ea633bdc8dabdcf9d9aa8c08d"
server_key_version: "encryptionkey@0"
I20260812 01:04:57.194828 6212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:04:57.211690 6212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:04:57.215273 6212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:04:57.215530 6212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:04:57.216428 6212 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:04:57.217854 6212 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:04:57.217931 6212 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:04:57.218055 6212 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:04:57.218111 6212 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:04:57.249092 6212 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:46563
I20260812 01:04:57.249135 6428 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:46563 every 8 connection(s)
I20260812 01:04:57.250351 6212 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:04:57.260661 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 6212
I20260812 01:04:57.260828 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance
I20260812 01:04:57.261319 4901 external_mini_cluster.cc:1428] Setting key 5032cbd1e1c4645a9faa70a5718b51d4
Aug 12 01:04:57 dist-test-slave-bndk krb5kdc[5804](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496697, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:04:57.270248 6202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:57.252833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:40597 (local address 127.4.201.126:44333)
0812 01:04:57.253014 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 01:04:57.253019 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:04:57.254192 (+ 1173us) server_negotiation.cc:407] Connection header received
0812 01:04:57.255979 (+ 1787us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:04:57.255984 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:04:57.256069 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:04:57.256156 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:04:57.257693 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:57.258439 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:57.259932 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:57.260339 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:57.260450 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:57.264287 (+ 3837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:04:57.264292 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:04:57.264295 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:04:57.264327 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:04:57.266965 (+ 2638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:57.267808 (+ 843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:57.267812 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:57.267815 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:57.267958 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:57.268408 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:57.268412 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:57.268414 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:57.268709 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:04:57.268821 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 01:04:57.269688 (+ 867us) server_negotiation.cc:299] Negotiation successful
0812 01:04:57.269911 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 01:04:57.271006 6432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:57.253323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:44333 (local address 127.4.201.66:40597)
0812 01:04:57.254034 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0812 01:04:57.254071 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 01:04:57.255716 (+ 1645us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:04:57.256390 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:04:57.256398 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:04:57.256910 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:04:57.257525 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:04:57.257544 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:04:57.258585 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:04:57.258589 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:04:57.259778 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:04:57.259791 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:04:57.260565 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:04:57.260573 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:04:57.260814 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:57.261509 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:04:57.261536 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:04:57.264052 (+ 2516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:04:57.267105 (+ 3053us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:04:57.267114 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:04:57.267131 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:04:57.267657 (+ 526us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:04:57.268081 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:04:57.268085 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:04:57.268088 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:04:57.268311 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:04:57.268834 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:04:57.268843 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:04:57.269264 (+ 421us) client_negotiation.cc:769] Sending connection context
0812 01:04:57.269561 (+ 297us) client_negotiation.cc:240] Negotiation successful
0812 01:04:57.269962 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":258,"threads_started":1}
I20260812 01:04:57.272323 6429 heartbeater.cc:347] Connected to a master server at 127.4.201.126:44333
I20260812 01:04:57.272619 6429 heartbeater.cc:464] Registering TS with master...
I20260812 01:04:57.273346 6429 heartbeater.cc:511] Master 127.4.201.126:44333 requested a full tablet report, sending...
I20260812 01:04:57.274760 5871 ts_manager.cc:194] Registered new tserver with Master: b6b2a7f1fac54a229848b32370bd821e (127.4.201.66:46563)
I20260812 01:04:57.275542 5871 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.66@KRBTEST.COM'} at 127.4.201.66:40597
WARNING: no policy specified for kudu/127.4.201.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
I20260812 01:04:57.301694 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:0
--local_ip_for_outbound_sockets=127.4.201.67
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:44333
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:34373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:04:57.618978 6436 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:04:57.619232 6436 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:04:57.619365 6436 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:04:57.626508 6436 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:04:57.626614 6436 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:04:57.626775 6436 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:04:57.636272 6436 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:34373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:44333
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:04:57.637486 6436 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:04:57.638788 6436 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:04:57.650940 6445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:04:57.651062 6447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:04:57.651000 6449 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:04:57.651927 6436 server_base.cc:1034] running on GCE node
I20260812 01:04:57.652565 6436 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:04:57.653506 6436 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:04:57.654709 6436 hybrid_clock.cc:648] HybridClock initialized: now 1786496697654661 us; error 40 us; skew 500 ppm
I20260812 01:04:57.655012 6436 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:04:57 dist-test-slave-bndk krb5kdc[5804](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496697, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:04:57.658005 6436 init.cc:377] Logged in from keytab as kudu/127.4.201.67@KRBTEST.COM (short username kudu)
I20260812 01:04:57.659401 6436 webserver.cc:460] Webserver started at http://127.4.201.67:46301/ using document root <none> and password file <none>
I20260812 01:04:57.660073 6436 fs_manager.cc:359] Metadata directory not provided
I20260812 01:04:57.660195 6436 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:04:57.660486 6436 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:04:57.663440 6436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-2/data/instance:
uuid: "c712562db8f24a13a805be378828cddc"
format_stamp: "Formatted at 2026-08-12 01:04:57 on dist-test-slave-bndk"
server_key: "7fc7b8a325a3d75db94ba95f7347c56b"
server_key_iv: "fa57c903616d79a4aec15d1f33a36703"
server_key_version: "encryptionkey@0"
I20260812 01:04:57.664248 6436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance:
uuid: "c712562db8f24a13a805be378828cddc"
format_stamp: "Formatted at 2026-08-12 01:04:57 on dist-test-slave-bndk"
server_key: "7fc7b8a325a3d75db94ba95f7347c56b"
server_key_iv: "fa57c903616d79a4aec15d1f33a36703"
server_key_version: "encryptionkey@0"
I20260812 01:04:57.669375 6436 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.006s
I20260812 01:04:57.672746 6459 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:04:57.674091 6436 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:04:57.674247 6436 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "c712562db8f24a13a805be378828cddc"
format_stamp: "Formatted at 2026-08-12 01:04:57 on dist-test-slave-bndk"
server_key: "7fc7b8a325a3d75db94ba95f7347c56b"
server_key_iv: "fa57c903616d79a4aec15d1f33a36703"
server_key_version: "encryptionkey@0"
I20260812 01:04:57.674427 6436 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:04:57.686609 6436 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:04:57.690510 6436 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:04:57.690815 6436 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:04:57.692008 6436 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:04:57.693735 6436 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:04:57.693828 6436 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:04:57.693945 6436 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:04:57.694003 6436 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:04:57.726181 6436 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:44525
I20260812 01:04:57.726233 6636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:44525 every 8 connection(s)
I20260812 01:04:57.727535 6436 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:04:57.737154 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 6436
I20260812 01:04:57.737366 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance
I20260812 01:04:57.737886 4901 external_mini_cluster.cc:1428] Setting key 55ed92890f89fd7793618375596def41
Aug 12 01:04:57 dist-test-slave-bndk krb5kdc[5804](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496697, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:04:57.746630 6202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:57.730116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:49181 (local address 127.4.201.126:44333)
0812 01:04:57.730290 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 01:04:57.730295 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:04:57.731558 (+ 1263us) server_negotiation.cc:407] Connection header received
0812 01:04:57.733390 (+ 1832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:04:57.733395 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:04:57.733522 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:04:57.733612 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:04:57.735134 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:57.735876 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:57.737734 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:57.738189 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:57.738303 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:57.741859 (+ 3556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:04:57.741863 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:04:57.741867 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:04:57.741898 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:04:57.744114 (+ 2216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:57.744752 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:57.744755 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:57.744757 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:57.744875 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:57.745201 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:57.745204 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:57.745206 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:57.745483 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:04:57.745594 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 01:04:57.746213 (+ 619us) server_negotiation.cc:299] Negotiation successful
0812 01:04:57.746375 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 01:04:57.747506 6641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:57.730679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:44333 (local address 127.4.201.67:49181)
0812 01:04:57.731399 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0812 01:04:57.731436 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 01:04:57.733110 (+ 1674us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:04:57.733868 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:04:57.733876 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:04:57.734408 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:04:57.734960 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:04:57.734989 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:04:57.736033 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:04:57.736037 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:04:57.737579 (+ 1542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:04:57.737595 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:04:57.738423 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:04:57.738431 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:04:57.738672 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:57.739277 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:04:57.739301 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:04:57.741668 (+ 2367us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:04:57.744243 (+ 2575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:04:57.744250 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:04:57.744262 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:04:57.744662 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:04:57.744948 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:04:57.744951 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:04:57.744954 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:04:57.745123 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:04:57.745592 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:04:57.745598 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:04:57.745893 (+ 295us) client_negotiation.cc:769] Sending connection context
0812 01:04:57.746107 (+ 214us) client_negotiation.cc:240] Negotiation successful
0812 01:04:57.746481 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":276,"threads_started":1}
I20260812 01:04:57.748689 6638 heartbeater.cc:347] Connected to a master server at 127.4.201.126:44333
I20260812 01:04:57.748955 6638 heartbeater.cc:464] Registering TS with master...
I20260812 01:04:57.749770 6638 heartbeater.cc:511] Master 127.4.201.126:44333 requested a full tablet report, sending...
I20260812 01:04:57.751149 5871 ts_manager.cc:194] Registered new tserver with Master: c712562db8f24a13a805be378828cddc (127.4.201.67:44525)
I20260812 01:04:57.752166 5871 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.67@KRBTEST.COM'} at 127.4.201.67:49181
I20260812 01:04:57.753157 4901 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:04:57.770733 6202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:57.759351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43330 (local address 127.4.201.126:44333)
0812 01:04:57.759504 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0812 01:04:57.759508 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:04:57.759994 (+ 486us) server_negotiation.cc:407] Connection header received
0812 01:04:57.760123 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:04:57.760126 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:04:57.760181 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:04:57.760258 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:04:57.761706 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:57.762381 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:57.763578 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:57.763946 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:57.764031 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:57.766198 (+ 2167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:04:57.766203 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:04:57.766207 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:04:57.766236 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:04:57.768616 (+ 2380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:57.769167 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:57.769170 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:57.769172 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:57.769324 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:57.769629 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:57.769632 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:57.769634 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:57.769925 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:04:57.770103 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0812 01:04:57.770338 (+ 235us) server_negotiation.cc:299] Negotiation successful
0812 01:04:57.770501 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 01:04:57.778473 5871 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43330:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:04:57.787743 5871 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:04:57.810503 6199 heartbeater.cc:503] Master 127.4.201.126:44333 was elected leader, sending a full tablet report...
I20260812 01:04:57.813522 6655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:57.801753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51330 (local address 127.4.201.66:46563)
0812 01:04:57.804201 (+ 2448us) server_negotiation.cc:206] Beginning negotiation
0812 01:04:57.804209 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:04:57.804231 (+ 22us) server_negotiation.cc:407] Connection header received
0812 01:04:57.804337 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:04:57.804344 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:04:57.804605 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:04:57.805566 (+ 961us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:04:57.805783 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:57.807316 (+ 1533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:57.810120 (+ 2804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:57.811581 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:57.811714 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:57.811928 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0812 01:04:57.813017 (+ 1089us) server_negotiation.cc:299] Negotiation successful
0812 01:04:57.813183 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2303,"thread_start_us":2200,"threads_started":1}
I20260812 01:04:57.814056 6660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:57.802346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60080 (local address 127.4.201.67:44525)
0812 01:04:57.803804 (+ 1458us) server_negotiation.cc:206] Beginning negotiation
0812 01:04:57.803813 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:04:57.804180 (+ 367us) server_negotiation.cc:407] Connection header received
0812 01:04:57.804491 (+ 311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:04:57.804499 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:04:57.804670 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:04:57.804823 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:04:57.805885 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:57.807424 (+ 1539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:57.811141 (+ 3717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:57.812494 (+ 1353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:57.812595 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:57.812809 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0812 01:04:57.813493 (+ 684us) server_negotiation.cc:299] Negotiation successful
0812 01:04:57.813653 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1291,"thread_start_us":1134,"threads_started":1}
I20260812 01:04:57.814108 6654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:57.801729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:44525 (local address 127.0.0.1:60080)
0812 01:04:57.804069 (+ 2340us) negotiation.cc:107] Waiting for socket to connect
0812 01:04:57.804086 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:04:57.804285 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:04:57.805160 (+ 875us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:04:57.805165 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:04:57.805189 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:04:57.805674 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:04:57.805687 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:04:57.807600 (+ 1913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:04:57.807605 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:04:57.810922 (+ 3317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:04:57.810945 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:04:57.813024 (+ 2079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:04:57.813036 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:04:57.813204 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:57.813294 (+ 90us) client_negotiation.cc:769] Sending connection context
0812 01:04:57.813389 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 01:04:57.813542 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2212,"mutex_wait_us":1175,"thread_start_us":936,"threads_started":1}
I20260812 01:04:57.814194 6656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:57.801588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:46563 (local address 127.0.0.1:51330)
0812 01:04:57.802918 (+ 1330us) negotiation.cc:107] Waiting for socket to connect
0812 01:04:57.802956 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 01:04:57.803144 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:04:57.804858 (+ 1714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:04:57.804866 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:04:57.804895 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:04:57.805345 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:04:57.805359 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:04:57.807494 (+ 2135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:04:57.807499 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:04:57.809949 (+ 2450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:04:57.809963 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:04:57.812376 (+ 2413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:04:57.812385 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:04:57.812596 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:57.812649 (+ 53us) client_negotiation.cc:769] Sending connection context
0812 01:04:57.812781 (+ 132us) client_negotiation.cc:240] Negotiation successful
0812 01:04:57.813824 (+ 1043us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1093,"mutex_wait_us":2,"thread_start_us":2204,"threads_started":1}
I20260812 01:04:57.817093 6661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:57.804410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:42441 (local address 127.0.0.1:47112)
0812 01:04:57.809072 (+ 4662us) negotiation.cc:107] Waiting for socket to connect
0812 01:04:57.809089 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:04:57.809196 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:04:57.810558 (+ 1362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:04:57.810563 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:04:57.810587 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:04:57.810996 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:04:57.811012 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:04:57.812827 (+ 1815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:04:57.812832 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:04:57.814874 (+ 2042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:04:57.814888 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:04:57.816552 (+ 1664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:04:57.816556 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:04:57.816669 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:57.816691 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 01:04:57.816750 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 01:04:57.816829 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4515,"mutex_wait_us":1,"thread_start_us":4371,"threads_started":1}
I20260812 01:04:57.817497 6664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:57.804565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47112 (local address 127.4.201.65:42441)
0812 01:04:57.809737 (+ 5172us) server_negotiation.cc:206] Beginning negotiation
0812 01:04:57.809744 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:04:57.809772 (+ 28us) server_negotiation.cc:407] Connection header received
0812 01:04:57.809865 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:04:57.809872 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:04:57.810128 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:04:57.810287 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:04:57.811194 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:57.812678 (+ 1484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:57.815024 (+ 2346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:57.816356 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:57.816513 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:57.816741 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0812 01:04:57.816817 (+ 76us) server_negotiation.cc:299] Negotiation successful
0812 01:04:57.816979 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5018,"thread_start_us":4880,"threads_started":1}
I20260812 01:04:57.818713 6321 tablet_service.cc:1467] Processing CreateTablet for tablet 5f36bb5589f443e891d8bf5a6978b65f (DEFAULT_TABLE table=test-table [id=6467e40b8cda41cca59742bdb961fd62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:04:57.820297 6321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f36bb5589f443e891d8bf5a6978b65f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:04:57.820174 6543 tablet_service.cc:1467] Processing CreateTablet for tablet 5f36bb5589f443e891d8bf5a6978b65f (DEFAULT_TABLE table=test-table [id=6467e40b8cda41cca59742bdb961fd62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:04:57.821738 6543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f36bb5589f443e891d8bf5a6978b65f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:04:57.823491 6077 tablet_service.cc:1467] Processing CreateTablet for tablet 5f36bb5589f443e891d8bf5a6978b65f (DEFAULT_TABLE table=test-table [id=6467e40b8cda41cca59742bdb961fd62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:04:57.825139 6077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f36bb5589f443e891d8bf5a6978b65f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:04:57.832903 6665 tablet_bootstrap.cc:492] T 5f36bb5589f443e891d8bf5a6978b65f P b6b2a7f1fac54a229848b32370bd821e: Bootstrap starting.
I20260812 01:04:57.836213 6666 tablet_bootstrap.cc:492] T 5f36bb5589f443e891d8bf5a6978b65f P c712562db8f24a13a805be378828cddc: Bootstrap starting.
I20260812 01:04:57.836443 6665 tablet_bootstrap.cc:654] T 5f36bb5589f443e891d8bf5a6978b65f P b6b2a7f1fac54a229848b32370bd821e: Neither blocks nor log segments found. Creating new log.
I20260812 01:04:57.837929 6665 log.cc:824] T 5f36bb5589f443e891d8bf5a6978b65f P b6b2a7f1fac54a229848b32370bd821e: Log is configured to *not* fsync() on all Append() calls
I20260812 01:04:57.839771 6666 tablet_bootstrap.cc:654] T 5f36bb5589f443e891d8bf5a6978b65f P c712562db8f24a13a805be378828cddc: Neither blocks nor log segments found. Creating new log.
I20260812 01:04:57.840780 6668 tablet_bootstrap.cc:492] T 5f36bb5589f443e891d8bf5a6978b65f P 71bd7cb871304c47aa1a38f9b80847de: Bootstrap starting.
I20260812 01:04:57.840947 6666 log.cc:824] T 5f36bb5589f443e891d8bf5a6978b65f P c712562db8f24a13a805be378828cddc: Log is configured to *not* fsync() on all Append() calls
I20260812 01:04:57.842355 6665 tablet_bootstrap.cc:492] T 5f36bb5589f443e891d8bf5a6978b65f P b6b2a7f1fac54a229848b32370bd821e: No bootstrap required, opened a new log
I20260812 01:04:57.842653 6665 ts_tablet_manager.cc:1397] T 5f36bb5589f443e891d8bf5a6978b65f P b6b2a7f1fac54a229848b32370bd821e: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260812 01:04:57.843955 6668 tablet_bootstrap.cc:654] T 5f36bb5589f443e891d8bf5a6978b65f P 71bd7cb871304c47aa1a38f9b80847de: Neither blocks nor log segments found. Creating new log.
I20260812 01:04:57.844077 6666 tablet_bootstrap.cc:492] T 5f36bb5589f443e891d8bf5a6978b65f P c712562db8f24a13a805be378828cddc: No bootstrap required, opened a new log
I20260812 01:04:57.844339 6666 ts_tablet_manager.cc:1397] T 5f36bb5589f443e891d8bf5a6978b65f P c712562db8f24a13a805be378828cddc: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260812 01:04:57.844920 6668 log.cc:824] T 5f36bb5589f443e891d8bf5a6978b65f P 71bd7cb871304c47aa1a38f9b80847de: Log is configured to *not* fsync() on all Append() calls
I20260812 01:04:57.851280 6668 tablet_bootstrap.cc:492] T 5f36bb5589f443e891d8bf5a6978b65f P 71bd7cb871304c47aa1a38f9b80847de: No bootstrap required, opened a new log
I20260812 01:04:57.851536 6668 ts_tablet_manager.cc:1397] T 5f36bb5589f443e891d8bf5a6978b65f P 71bd7cb871304c47aa1a38f9b80847de: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.006s
I20260812 01:04:57.852932 6665 raft_consensus.cc:348] T 5f36bb5589f443e891d8bf5a6978b65f P b6b2a7f1fac54a229848b32370bd821e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b2a7f1fac54a229848b32370bd821e" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46563 } } peers { permanent_uuid: "c712562db8f24a13a805be378828cddc" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 44525 } } peers { permanent_uuid: "71bd7cb871304c47aa1a38f9b80847de" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42441 } }
I20260812 01:04:57.853479 6665 raft_consensus.cc:374] T 5f36bb5589f443e891d8bf5a6978b65f P b6b2a7f1fac54a229848b32370bd821e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:04:57.853593 6665 raft_consensus.cc:729] T 5f36bb5589f443e891d8bf5a6978b65f P b6b2a7f1fac54a229848b32370bd821e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6b2a7f1fac54a229848b32370bd821e, State: Initialized, Role: FOLLOWER
I20260812 01:04:57.854231 6665 consensus_queue.cc:260] T 5f36bb5589f443e891d8bf5a6978b65f P b6b2a7f1fac54a229848b32370bd821e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b2a7f1fac54a229848b32370bd821e" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46563 } } peers { permanent_uuid: "c712562db8f24a13a805be378828cddc" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 44525 } } peers { permanent_uuid: "71bd7cb871304c47aa1a38f9b80847de" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42441 } }
I20260812 01:04:57.854738 6666 raft_consensus.cc:348] T 5f36bb5589f443e891d8bf5a6978b65f P c712562db8f24a13a805be378828cddc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b2a7f1fac54a229848b32370bd821e" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46563 } } peers { permanent_uuid: "c712562db8f24a13a805be378828cddc" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 44525 } } peers { permanent_uuid: "71bd7cb871304c47aa1a38f9b80847de" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42441 } }
I20260812 01:04:57.855175 6666 raft_consensus.cc:374] T 5f36bb5589f443e891d8bf5a6978b65f P c712562db8f24a13a805be378828cddc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:04:57.855278 6666 raft_consensus.cc:729] T 5f36bb5589f443e891d8bf5a6978b65f P c712562db8f24a13a805be378828cddc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c712562db8f24a13a805be378828cddc, State: Initialized, Role: FOLLOWER
I20260812 01:04:57.855767 6429 heartbeater.cc:503] Master 127.4.201.126:44333 was elected leader, sending a full tablet report...
I20260812 01:04:57.856251 6665 ts_tablet_manager.cc:1428] T 5f36bb5589f443e891d8bf5a6978b65f P b6b2a7f1fac54a229848b32370bd821e: Time spent starting tablet: real 0.013s user 0.014s sys 0.001s
I20260812 01:04:57.856096 6666 consensus_queue.cc:260] T 5f36bb5589f443e891d8bf5a6978b65f P c712562db8f24a13a805be378828cddc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b2a7f1fac54a229848b32370bd821e" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46563 } } peers { permanent_uuid: "c712562db8f24a13a805be378828cddc" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 44525 } } peers { permanent_uuid: "71bd7cb871304c47aa1a38f9b80847de" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42441 } }
I20260812 01:04:57.857301 6638 heartbeater.cc:503] Master 127.4.201.126:44333 was elected leader, sending a full tablet report...
I20260812 01:04:57.861162 6666 ts_tablet_manager.cc:1428] T 5f36bb5589f443e891d8bf5a6978b65f P c712562db8f24a13a805be378828cddc: Time spent starting tablet: real 0.017s user 0.011s sys 0.004s
I20260812 01:04:57.863173 6668 raft_consensus.cc:348] T 5f36bb5589f443e891d8bf5a6978b65f P 71bd7cb871304c47aa1a38f9b80847de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b2a7f1fac54a229848b32370bd821e" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46563 } } peers { permanent_uuid: "c712562db8f24a13a805be378828cddc" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 44525 } } peers { permanent_uuid: "71bd7cb871304c47aa1a38f9b80847de" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42441 } }
I20260812 01:04:57.863634 6668 raft_consensus.cc:374] T 5f36bb5589f443e891d8bf5a6978b65f P 71bd7cb871304c47aa1a38f9b80847de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:04:57.863734 6668 raft_consensus.cc:729] T 5f36bb5589f443e891d8bf5a6978b65f P 71bd7cb871304c47aa1a38f9b80847de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71bd7cb871304c47aa1a38f9b80847de, State: Initialized, Role: FOLLOWER
I20260812 01:04:57.864305 6668 consensus_queue.cc:260] T 5f36bb5589f443e891d8bf5a6978b65f P 71bd7cb871304c47aa1a38f9b80847de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b2a7f1fac54a229848b32370bd821e" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46563 } } peers { permanent_uuid: "c712562db8f24a13a805be378828cddc" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 44525 } } peers { permanent_uuid: "71bd7cb871304c47aa1a38f9b80847de" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42441 } }
I20260812 01:04:57.865760 6668 ts_tablet_manager.cc:1428] T 5f36bb5589f443e891d8bf5a6978b65f P 71bd7cb871304c47aa1a38f9b80847de: Time spent starting tablet: real 0.014s user 0.008s sys 0.005s
W20260812 01:04:57.979197 6640 tablet.cc:2369] T 5f36bb5589f443e891d8bf5a6978b65f P c712562db8f24a13a805be378828cddc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:04:58.002204 6431 tablet.cc:2369] T 5f36bb5589f443e891d8bf5a6978b65f P b6b2a7f1fac54a229848b32370bd821e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:04:58.004804 6676 raft_consensus.cc:482] T 5f36bb5589f443e891d8bf5a6978b65f P 71bd7cb871304c47aa1a38f9b80847de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:04:58.005108 6676 raft_consensus.cc:504] T 5f36bb5589f443e891d8bf5a6978b65f P 71bd7cb871304c47aa1a38f9b80847de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b2a7f1fac54a229848b32370bd821e" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46563 } } peers { permanent_uuid: "c712562db8f24a13a805be378828cddc" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 44525 } } peers { permanent_uuid: "71bd7cb871304c47aa1a38f9b80847de" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42441 } }
I20260812 01:04:58.006891 6676 leader_election.cc:288] T 5f36bb5589f443e891d8bf5a6978b65f P 71bd7cb871304c47aa1a38f9b80847de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6b2a7f1fac54a229848b32370bd821e (127.4.201.66:46563), c712562db8f24a13a805be378828cddc (127.4.201.67:44525)
I20260812 01:04:58.013461 6655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:58.007375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:57037 (local address 127.4.201.66:46563)
0812 01:04:58.007589 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 01:04:58.007596 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:04:58.008241 (+ 645us) server_negotiation.cc:407] Connection header received
0812 01:04:58.008433 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:04:58.008437 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:04:58.008504 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:04:58.008578 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:04:58.009263 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:58.009949 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:58.011731 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:58.012515 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:58.012655 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:58.012728 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 01:04:58.013073 (+ 345us) server_negotiation.cc:299] Negotiation successful
0812 01:04:58.013199 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 01:04:58.013563 6660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:58.007363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:36909 (local address 127.4.201.67:44525)
0812 01:04:58.007573 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0812 01:04:58.007580 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:04:58.008316 (+ 736us) server_negotiation.cc:407] Connection header received
0812 01:04:58.008478 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:04:58.008489 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:04:58.008551 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:04:58.008626 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:04:58.009392 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:58.010127 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:58.011875 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:58.012633 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:58.012791 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:58.012864 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 01:04:58.013158 (+ 294us) server_negotiation.cc:299] Negotiation successful
0812 01:04:58.013310 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 01:04:58.013669 6678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:58.007117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:46563 (local address 127.4.201.65:57037)
0812 01:04:58.008133 (+ 1016us) negotiation.cc:107] Waiting for socket to connect
0812 01:04:58.008148 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 01:04:58.008300 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:04:58.008606 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:04:58.008610 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:04:58.008634 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:04:58.009101 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:04:58.009112 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:04:58.010073 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:04:58.010079 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:04:58.011570 (+ 1491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:04:58.011583 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:04:58.012712 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:04:58.012719 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:04:58.012869 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:58.012934 (+ 65us) client_negotiation.cc:769] Sending connection context
0812 01:04:58.013031 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 01:04:58.013155 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":886,"mutex_wait_us":37,"thread_start_us":783,"threads_started":1}
I20260812 01:04:58.014091 6677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:58.007364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:44525 (local address 127.4.201.65:36909)
0812 01:04:58.008207 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0812 01:04:58.008221 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 01:04:58.008351 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:04:58.008653 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:04:58.008657 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:04:58.008681 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:04:58.009202 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:04:58.009245 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:04:58.010281 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:04:58.010285 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:04:58.011723 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:04:58.011737 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:04:58.012859 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:04:58.012865 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:04:58.013011 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:58.013035 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 01:04:58.013115 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 01:04:58.013257 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":749,"mutex_wait_us":44,"thread_start_us":404,"threads_started":1}
I20260812 01:04:58.013995 6675 raft_consensus.cc:482] T 5f36bb5589f443e891d8bf5a6978b65f P c712562db8f24a13a805be378828cddc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:04:58.014504 6675 raft_consensus.cc:504] T 5f36bb5589f443e891d8bf5a6978b65f P c712562db8f24a13a805be378828cddc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b2a7f1fac54a229848b32370bd821e" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46563 } } peers { permanent_uuid: "c712562db8f24a13a805be378828cddc" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 44525 } } peers { permanent_uuid: "71bd7cb871304c47aa1a38f9b80847de" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42441 } }
I20260812 01:04:58.014878 6357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f36bb5589f443e891d8bf5a6978b65f" candidate_uuid: "71bd7cb871304c47aa1a38f9b80847de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6b2a7f1fac54a229848b32370bd821e" is_pre_election: true
I20260812 01:04:58.015139 6567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f36bb5589f443e891d8bf5a6978b65f" candidate_uuid: "71bd7cb871304c47aa1a38f9b80847de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c712562db8f24a13a805be378828cddc" is_pre_election: true
I20260812 01:04:58.015373 6357 raft_consensus.cc:2454] T 5f36bb5589f443e891d8bf5a6978b65f P b6b2a7f1fac54a229848b32370bd821e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71bd7cb871304c47aa1a38f9b80847de in term 0.
I20260812 01:04:58.015609 6567 raft_consensus.cc:2454] T 5f36bb5589f443e891d8bf5a6978b65f P c712562db8f24a13a805be378828cddc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71bd7cb871304c47aa1a38f9b80847de in term 0.
I20260812 01:04:58.016160 6012 leader_election.cc:302] T 5f36bb5589f443e891d8bf5a6978b65f P 71bd7cb871304c47aa1a38f9b80847de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71bd7cb871304c47aa1a38f9b80847de, b6b2a7f1fac54a229848b32370bd821e; no voters:
I20260812 01:04:58.016566 6675 leader_election.cc:288] T 5f36bb5589f443e891d8bf5a6978b65f P c712562db8f24a13a805be378828cddc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6b2a7f1fac54a229848b32370bd821e (127.4.201.66:46563), 71bd7cb871304c47aa1a38f9b80847de (127.4.201.65:42441)
I20260812 01:04:58.016722 6676 raft_consensus.cc:2781] T 5f36bb5589f443e891d8bf5a6978b65f P 71bd7cb871304c47aa1a38f9b80847de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:04:58.016877 6676 raft_consensus.cc:482] T 5f36bb5589f443e891d8bf5a6978b65f P 71bd7cb871304c47aa1a38f9b80847de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:04:58.017045 6676 raft_consensus.cc:3037] T 5f36bb5589f443e891d8bf5a6978b65f P 71bd7cb871304c47aa1a38f9b80847de [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:04:58.020383 6676 raft_consensus.cc:504] T 5f36bb5589f443e891d8bf5a6978b65f P 71bd7cb871304c47aa1a38f9b80847de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b2a7f1fac54a229848b32370bd821e" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46563 } } peers { permanent_uuid: "c712562db8f24a13a805be378828cddc" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 44525 } } peers { permanent_uuid: "71bd7cb871304c47aa1a38f9b80847de" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42441 } }
I20260812 01:04:58.021064 6676 leader_election.cc:288] T 5f36bb5589f443e891d8bf5a6978b65f P 71bd7cb871304c47aa1a38f9b80847de [CANDIDATE]: Term 1 election: Requested vote from peers b6b2a7f1fac54a229848b32370bd821e (127.4.201.66:46563), c712562db8f24a13a805be378828cddc (127.4.201.67:44525)
I20260812 01:04:58.021580 6357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f36bb5589f443e891d8bf5a6978b65f" candidate_uuid: "71bd7cb871304c47aa1a38f9b80847de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6b2a7f1fac54a229848b32370bd821e"
I20260812 01:04:58.021790 6357 raft_consensus.cc:3037] T 5f36bb5589f443e891d8bf5a6978b65f P b6b2a7f1fac54a229848b32370bd821e [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:04:58.022819 6641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:58.016764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:46563 (local address 127.4.201.67:51729)
0812 01:04:58.017011 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0812 01:04:58.017029 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 01:04:58.017135 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:04:58.017796 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:04:58.017801 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:04:58.017842 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:04:58.018021 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:04:58.018032 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:04:58.019375 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:04:58.019380 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:04:58.020790 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:04:58.020803 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:04:58.022086 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:04:58.022091 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:04:58.022280 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:58.022313 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 01:04:58.022394 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 01:04:58.022530 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"mutex_wait_us":3,"spinlock_wait_cycles":4352}
I20260812 01:04:58.022830 6655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:58.016834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:51729 (local address 127.4.201.66:46563)
0812 01:04:58.016992 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 01:04:58.016997 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:04:58.017262 (+ 265us) server_negotiation.cc:407] Connection header received
0812 01:04:58.017325 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:04:58.017330 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:04:58.017399 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:04:58.017490 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:04:58.018163 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:58.019225 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:58.020932 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:58.021926 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:58.022090 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:58.022165 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 01:04:58.022432 (+ 267us) server_negotiation.cc:299] Negotiation successful
0812 01:04:58.022555 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 01:04:58.023618 6355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f36bb5589f443e891d8bf5a6978b65f" candidate_uuid: "c712562db8f24a13a805be378828cddc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6b2a7f1fac54a229848b32370bd821e" is_pre_election: true
I20260812 01:04:58.024238 6664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:58.017678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:57875 (local address 127.4.201.65:42441)
0812 01:04:58.017853 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 01:04:58.017859 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:04:58.017876 (+ 17us) server_negotiation.cc:407] Connection header received
0812 01:04:58.017990 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:04:58.017999 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:04:58.018063 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:04:58.018140 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:04:58.018644 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:58.019388 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:58.022110 (+ 2722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:58.023239 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:58.023360 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:58.023422 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 01:04:58.023903 (+ 481us) server_negotiation.cc:299] Negotiation successful
0812 01:04:58.024029 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 01:04:58.024576 6681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:58.017114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:42441 (local address 127.4.201.67:57875)
0812 01:04:58.017718 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0812 01:04:58.017736 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 01:04:58.017867 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:04:58.018190 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:04:58.018194 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:04:58.018218 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:04:58.018505 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:04:58.018513 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:04:58.019557 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:04:58.019563 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:04:58.021916 (+ 2353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:04:58.021932 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:04:58.023549 (+ 1617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:04:58.023555 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:04:58.023724 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:58.023765 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 01:04:58.023862 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 01:04:58.024113 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"mutex_wait_us":26,"spinlock_wait_cycles":11648,"thread_start_us":280,"threads_started":1}
I20260812 01:04:58.024879 6567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f36bb5589f443e891d8bf5a6978b65f" candidate_uuid: "71bd7cb871304c47aa1a38f9b80847de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c712562db8f24a13a805be378828cddc"
I20260812 01:04:58.025075 6567 raft_consensus.cc:3037] T 5f36bb5589f443e891d8bf5a6978b65f P c712562db8f24a13a805be378828cddc [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:04:58.025092 6357 raft_consensus.cc:2454] T 5f36bb5589f443e891d8bf5a6978b65f P b6b2a7f1fac54a229848b32370bd821e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71bd7cb871304c47aa1a38f9b80847de in term 1.
I20260812 01:04:58.025480 6012 leader_election.cc:302] T 5f36bb5589f443e891d8bf5a6978b65f P 71bd7cb871304c47aa1a38f9b80847de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71bd7cb871304c47aa1a38f9b80847de, b6b2a7f1fac54a229848b32370bd821e; no voters:
I20260812 01:04:58.025799 6676 raft_consensus.cc:2781] T 5f36bb5589f443e891d8bf5a6978b65f P 71bd7cb871304c47aa1a38f9b80847de [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:04:58.025821 6117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f36bb5589f443e891d8bf5a6978b65f" candidate_uuid: "c712562db8f24a13a805be378828cddc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71bd7cb871304c47aa1a38f9b80847de" is_pre_election: true
I20260812 01:04:58.026463 6676 raft_consensus.cc:686] T 5f36bb5589f443e891d8bf5a6978b65f P 71bd7cb871304c47aa1a38f9b80847de [term 1 LEADER]: Becoming Leader. State: Replica: 71bd7cb871304c47aa1a38f9b80847de, State: Running, Role: LEADER
I20260812 01:04:58.026965 6676 consensus_queue.cc:237] T 5f36bb5589f443e891d8bf5a6978b65f P 71bd7cb871304c47aa1a38f9b80847de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b2a7f1fac54a229848b32370bd821e" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46563 } } peers { permanent_uuid: "c712562db8f24a13a805be378828cddc" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 44525 } } peers { permanent_uuid: "71bd7cb871304c47aa1a38f9b80847de" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42441 } }
I20260812 01:04:58.027673 6567 raft_consensus.cc:2454] T 5f36bb5589f443e891d8bf5a6978b65f P c712562db8f24a13a805be378828cddc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71bd7cb871304c47aa1a38f9b80847de in term 1.
W20260812 01:04:58.031641 6201 tablet.cc:2369] T 5f36bb5589f443e891d8bf5a6978b65f P 71bd7cb871304c47aa1a38f9b80847de: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:04:58.031766 6461 leader_election.cc:302] T 5f36bb5589f443e891d8bf5a6978b65f P c712562db8f24a13a805be378828cddc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c712562db8f24a13a805be378828cddc; no voters: 71bd7cb871304c47aa1a38f9b80847de, b6b2a7f1fac54a229848b32370bd821e
I20260812 01:04:58.032148 6675 raft_consensus.cc:2726] T 5f36bb5589f443e891d8bf5a6978b65f P c712562db8f24a13a805be378828cddc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 01:04:58.033129 5871 catalog_manager.cc:5495] T 5f36bb5589f443e891d8bf5a6978b65f P 71bd7cb871304c47aa1a38f9b80847de reported cstate change: term changed from 0 to 1, leader changed from <none> to 71bd7cb871304c47aa1a38f9b80847de (127.4.201.65). New cstate: current_term: 1 leader_uuid: "71bd7cb871304c47aa1a38f9b80847de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b2a7f1fac54a229848b32370bd821e" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c712562db8f24a13a805be378828cddc" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 44525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71bd7cb871304c47aa1a38f9b80847de" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42441 } health_report { overall_health: HEALTHY } } }
Aug 12 01:04:58 dist-test-slave-bndk krb5kdc[5804](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496695, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.65@KRBTEST.COM
I20260812 01:04:58.059473 6664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:58.045557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47116 (local address 127.4.201.65:42441)
0812 01:04:58.045707 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 01:04:58.045712 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:04:58.046305 (+ 593us) server_negotiation.cc:407] Connection header received
0812 01:04:58.046441 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:04:58.046446 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:04:58.046546 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:04:58.046632 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:04:58.048005 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:58.048721 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:58.049920 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:58.050373 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:58.050466 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:58.054235 (+ 3769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:04:58.054249 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:04:58.054265 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:04:58.054311 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:04:58.057161 (+ 2850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:58.057802 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:58.057810 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:58.057812 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:58.057945 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:58.058213 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:58.058216 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:58.058218 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:58.058623 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:04:58.058845 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0812 01:04:58.059033 (+ 188us) server_negotiation.cc:299] Negotiation successful
0812 01:04:58.059215 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
Aug 12 01:04:58 dist-test-slave-bndk krb5kdc[5804](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496698, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 01:04:58 dist-test-slave-bndk krb5kdc[5804](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496698, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.4.201.65@KRBTEST.COM
I20260812 01:04:58.108855 6664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:58.095309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47126 (local address 127.4.201.65:42441)
0812 01:04:58.095532 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0812 01:04:58.095539 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:04:58.095863 (+ 324us) server_negotiation.cc:407] Connection header received
0812 01:04:58.096059 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:04:58.096064 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:04:58.096133 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:04:58.096221 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:04:58.097793 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:58.098597 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:58.100073 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:58.100675 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:58.100779 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:58.104357 (+ 3578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:04:58.104362 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:04:58.104365 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:04:58.104396 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:04:58.106779 (+ 2383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:58.107303 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:58.107307 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:58.107309 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:58.107416 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:58.107716 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:58.107719 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:58.107721 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:58.107969 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:04:58.108148 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0812 01:04:58.108370 (+ 222us) server_negotiation.cc:299] Negotiation successful
0812 01:04:58.108551 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
Aug 12 01:04:58 dist-test-slave-bndk krb5kdc[5804](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496698, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 01:04:58 dist-test-slave-bndk krb5kdc[5804](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496698, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.65@KRBTEST.COM
I20260812 01:04:58.156487 6664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:58.143786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47142 (local address 127.4.201.65:42441)
0812 01:04:58.144031 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0812 01:04:58.144038 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:04:58.144295 (+ 257us) server_negotiation.cc:407] Connection header received
0812 01:04:58.144449 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:04:58.144453 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:04:58.144533 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:04:58.144615 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:04:58.145900 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:58.146622 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:58.147788 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:58.148184 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:58.148268 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:58.151836 (+ 3568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:04:58.151841 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:04:58.151844 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:04:58.151877 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:04:58.154341 (+ 2464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:58.154878 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:58.154883 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:58.154885 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:58.155002 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:58.155300 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:58.155304 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:58.155306 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:58.155625 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:04:58.155845 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0812 01:04:58.156010 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 01:04:58.156177 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
W20260812 01:04:58.158320 6050 tablet_service.cc:2908] Rejecting scan request for tablet 5f36bb5589f443e891d8bf5a6978b65f: Uninitialized: clean time has not yet been initialized
I20260812 01:04:58.161489 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 5982
I20260812 01:04:58.173447 6664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:58.162563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47144 (local address 127.4.201.65:42441)
0812 01:04:58.162709 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0812 01:04:58.162715 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:04:58.163052 (+ 337us) server_negotiation.cc:407] Connection header received
0812 01:04:58.163198 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:04:58.163202 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:04:58.163285 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:04:58.163364 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:04:58.164451 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:58.165105 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:58.166320 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:58.166729 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:58.166844 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:58.168790 (+ 1946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:04:58.168794 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:04:58.168798 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:04:58.168826 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:04:58.171040 (+ 2214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:58.171643 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:58.171649 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:58.171652 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:58.171773 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:58.172164 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:58.172168 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:58.172170 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:58.172430 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:04:58.172676 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0812 01:04:58.172951 (+ 275us) server_negotiation.cc:299] Negotiation successful
0812 01:04:58.173125 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 01:04:58.174058 6192 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:04:58.263679 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 5982
I20260812 01:04:58.289847 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 6212
Aug 12 01:04:58 dist-test-slave-bndk krb5kdc[5804](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496698, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.66@KRBTEST.COM
I20260812 01:04:58.304304 6655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:58.290601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51332 (local address 127.4.201.66:46563)
0812 01:04:58.290775 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 01:04:58.290780 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:04:58.290989 (+ 209us) server_negotiation.cc:407] Connection header received
0812 01:04:58.291144 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:04:58.291148 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:04:58.291212 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:04:58.291308 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:04:58.292460 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:58.293334 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:58.294696 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:58.295122 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:58.295221 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:58.299305 (+ 4084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:04:58.299319 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:04:58.299337 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:04:58.299372 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:04:58.302141 (+ 2769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:58.302736 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:58.302743 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:58.302745 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:58.302876 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:58.303153 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:58.303156 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:58.303158 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:58.303482 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:04:58.303709 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0812 01:04:58.303897 (+ 188us) server_negotiation.cc:299] Negotiation successful
0812 01:04:58.304072 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 01:04:58.304950 6423 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:04:58.392135 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 6212
I20260812 01:04:58.415115 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 6436
Aug 12 01:04:58 dist-test-slave-bndk krb5kdc[5804](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496698, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.67@KRBTEST.COM
I20260812 01:04:58.428988 6660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:04:58.415864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60096 (local address 127.4.201.67:44525)
0812 01:04:58.416047 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 01:04:58.416052 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:04:58.416071 (+ 19us) server_negotiation.cc:407] Connection header received
0812 01:04:58.416218 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:04:58.416222 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:04:58.416285 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:04:58.416381 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:04:58.417567 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:58.418273 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:58.419466 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:04:58.419833 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:04:58.419922 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:04:58.424047 (+ 4125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:04:58.424062 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:04:58.424083 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:04:58.424123 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:04:58.426716 (+ 2593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:58.427297 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:58.427304 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:58.427307 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:58.427429 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:04:58.427726 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:04:58.427729 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:04:58.427731 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:04:58.428076 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:04:58.428286 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0812 01:04:58.428511 (+ 225us) server_negotiation.cc:299] Negotiation successful
0812 01:04:58.428668 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 01:04:58.429636 6631 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:04:58.516461 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 6436
I20260812 01:04:58.538964 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 5824
I20260812 01:04:58.540094 5930 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:04:58.647614 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 5824
2026-08-12T01:04:58Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4273 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:04:58 dist-test-slave-bndk krb5kdc[6720](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:04:58 dist-test-slave-bndk krb5kdc[6720](info): set up 2 sockets
Aug 12 01:04:58 dist-test-slave-bndk krb5kdc[6720](info): commencing operation
krb5kdc: starting...
W20260812 01:04:59.851097 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.154s user 0.002s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:04:59 dist-test-slave-bndk krb5kdc[6720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:04:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:04:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.201.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
I20260812 01:05:00.030922 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:44869
--webserver_interface=127.4.201.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:45589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:44869
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:00.348197 6744 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:00.348482 6744 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:00.348614 6744 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:00.355588 6744 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:05:00.355680 6744 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 01:05:00.355746 6744 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:00.355825 6744 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:00.355897 6744 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:05:00.355983 6744 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:05:00.365533 6744 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:45589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:44869
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:44869
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:00.366786 6744 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:00.368134 6744 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:00.379938 6752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:00.379869 6753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:00.379907 6760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:00.380649 6744 server_base.cc:1034] running on GCE node
I20260812 01:05:00.381546 6744 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:00.382997 6744 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:00.384214 6744 hybrid_clock.cc:648] HybridClock initialized: now 1786496700384149 us; error 35 us; skew 500 ppm
I20260812 01:05:00.384552 6744 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:00 dist-test-slave-bndk krb5kdc[6720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496700, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:00.387611 6744 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:05:00.389027 6744 webserver.cc:460] Webserver started at http://127.4.201.126:46477/ using document root <none> and password file <none>
I20260812 01:05:00.389766 6744 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:00.389871 6744 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:00.390190 6744 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:00.393281 6744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "f5104aab16eb43fab71cfc6d3e35236b"
format_stamp: "Formatted at 2026-08-12 01:05:00 on dist-test-slave-bndk"
server_key: "1147b9ad04ab4285ea16cbbfad837e33"
server_key_iv: "44cb0e8184b64ba102c2c72e1b7f5d5f"
server_key_version: "encryptionkey@0"
I20260812 01:05:00.394096 6744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "f5104aab16eb43fab71cfc6d3e35236b"
format_stamp: "Formatted at 2026-08-12 01:05:00 on dist-test-slave-bndk"
server_key: "1147b9ad04ab4285ea16cbbfad837e33"
server_key_iv: "44cb0e8184b64ba102c2c72e1b7f5d5f"
server_key_version: "encryptionkey@0"
I20260812 01:05:00.399223 6744 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260812 01:05:00.402658 6768 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:00.403995 6744 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 01:05:00.404173 6744 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "f5104aab16eb43fab71cfc6d3e35236b"
format_stamp: "Formatted at 2026-08-12 01:05:00 on dist-test-slave-bndk"
server_key: "1147b9ad04ab4285ea16cbbfad837e33"
server_key_iv: "44cb0e8184b64ba102c2c72e1b7f5d5f"
server_key_version: "encryptionkey@0"
I20260812 01:05:00.404382 6744 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:00.419320 6744 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:00.423044 6744 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:00.423287 6744 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:00.443856 6744 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:44869
I20260812 01:05:00.443897 6873 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:44869 every 8 connection(s)
I20260812 01:05:00.445190 6744 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:05:00.446563 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 6744
I20260812 01:05:00.446798 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:05:00.447633 4901 external_mini_cluster.cc:1428] Setting key 3b6d93872e8168afc03ce19587a95419
I20260812 01:05:00.449889 6881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:00.461273 6881 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5104aab16eb43fab71cfc6d3e35236b: Bootstrap starting.
Aug 12 01:05:00 dist-test-slave-bndk krb5kdc[6720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:00.464490 6881 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f5104aab16eb43fab71cfc6d3e35236b: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:00.465561 6881 log.cc:824] T 00000000000000000000000000000000 P f5104aab16eb43fab71cfc6d3e35236b: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:00.468153 6881 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5104aab16eb43fab71cfc6d3e35236b: No bootstrap required, opened a new log
I20260812 01:05:00.469354 6886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:00.450532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60786 (local address 127.4.201.126:44869)
0812 01:05:00.451239 (+ 707us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:00.451251 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:00.451304 (+ 53us) server_negotiation.cc:407] Connection header received
0812 01:05:00.452878 (+ 1574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:00.452899 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:00.453343 (+ 444us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:00.453713 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:00.455140 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:00.456465 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:00.457679 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:00.458366 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:00.458539 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:00.462592 (+ 4053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:00.462600 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:00.462616 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:00.462655 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:00.465542 (+ 2887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:00.466189 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:00.466195 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:00.466205 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:00.466379 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:00.466741 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:00.466744 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:00.466747 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:00.467242 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:00.467520 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:00.467968 (+ 448us) server_negotiation.cc:299] Negotiation successful
0812 01:05:00.468380 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":513,"thread_start_us":321,"threads_started":1}
I20260812 01:05:00.476284 6881 raft_consensus.cc:348] T 00000000000000000000000000000000 P f5104aab16eb43fab71cfc6d3e35236b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5104aab16eb43fab71cfc6d3e35236b" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44869 } }
I20260812 01:05:00.476603 6881 raft_consensus.cc:374] T 00000000000000000000000000000000 P f5104aab16eb43fab71cfc6d3e35236b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:00.476697 6881 raft_consensus.cc:729] T 00000000000000000000000000000000 P f5104aab16eb43fab71cfc6d3e35236b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5104aab16eb43fab71cfc6d3e35236b, State: Initialized, Role: FOLLOWER
I20260812 01:05:00.477308 6881 consensus_queue.cc:260] T 00000000000000000000000000000000 P f5104aab16eb43fab71cfc6d3e35236b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5104aab16eb43fab71cfc6d3e35236b" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44869 } }
I20260812 01:05:00.477532 6881 raft_consensus.cc:388] T 00000000000000000000000000000000 P f5104aab16eb43fab71cfc6d3e35236b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:05:00.477659 6881 raft_consensus.cc:482] T 00000000000000000000000000000000 P f5104aab16eb43fab71cfc6d3e35236b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:05:00.477833 6881 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f5104aab16eb43fab71cfc6d3e35236b [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:00.480064 6881 raft_consensus.cc:504] T 00000000000000000000000000000000 P f5104aab16eb43fab71cfc6d3e35236b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5104aab16eb43fab71cfc6d3e35236b" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44869 } }
I20260812 01:05:00.480557 6881 leader_election.cc:302] T 00000000000000000000000000000000 P f5104aab16eb43fab71cfc6d3e35236b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f5104aab16eb43fab71cfc6d3e35236b; no voters:
I20260812 01:05:00.481115 6881 leader_election.cc:288] T 00000000000000000000000000000000 P f5104aab16eb43fab71cfc6d3e35236b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:05:00.481243 6889 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f5104aab16eb43fab71cfc6d3e35236b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:05:00.481881 6889 raft_consensus.cc:686] T 00000000000000000000000000000000 P f5104aab16eb43fab71cfc6d3e35236b [term 1 LEADER]: Becoming Leader. State: Replica: f5104aab16eb43fab71cfc6d3e35236b, State: Running, Role: LEADER
I20260812 01:05:00.482450 6889 consensus_queue.cc:237] T 00000000000000000000000000000000 P f5104aab16eb43fab71cfc6d3e35236b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5104aab16eb43fab71cfc6d3e35236b" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44869 } }
I20260812 01:05:00.483108 6881 sys_catalog.cc:564] T 00000000000000000000000000000000 P f5104aab16eb43fab71cfc6d3e35236b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:05:00.485131 6890 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5104aab16eb43fab71cfc6d3e35236b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f5104aab16eb43fab71cfc6d3e35236b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5104aab16eb43fab71cfc6d3e35236b" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44869 } } }
I20260812 01:05:00.485536 6890 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5104aab16eb43fab71cfc6d3e35236b [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:00.485069 6891 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5104aab16eb43fab71cfc6d3e35236b [sys.catalog]: SysCatalogTable state changed. Reason: New leader f5104aab16eb43fab71cfc6d3e35236b. Latest consensus state: current_term: 1 leader_uuid: "f5104aab16eb43fab71cfc6d3e35236b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5104aab16eb43fab71cfc6d3e35236b" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44869 } } }
I20260812 01:05:00.485950 6891 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5104aab16eb43fab71cfc6d3e35236b [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:00.487820 6897 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:05:00.492362 6897 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:05:00.500192 6897 catalog_manager.cc:1347] Generated new cluster ID: ab9a2641df944e80a2583bbae5bf5eef
I20260812 01:05:00.500301 6897 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:05:00.513144 6897 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:05:00.515050 6897 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:05:00.522687 6897 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f5104aab16eb43fab71cfc6d3e35236b: Generated new TSK 0
I20260812 01:05:00.523659 6897 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.201.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
I20260812 01:05:00.574400 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:0
--local_ip_for_outbound_sockets=127.4.201.65
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:44869
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:45589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:00.899611 6919 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:00.899892 6919 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:00.900022 6919 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:00.907267 6919 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:00.907378 6919 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:00.907502 6919 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 01:05:00.907611 6919 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:05:00.917187 6919 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:45589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.201.126:44869
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:00.918448 6919 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:00.919725 6919 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:00.932410 6932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:00.932448 6935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:00.932492 6929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:00.934118 6919 server_base.cc:1034] running on GCE node
I20260812 01:05:00.934659 6919 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:00.935462 6919 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:00.936676 6919 hybrid_clock.cc:648] HybridClock initialized: now 1786496700936609 us; error 44 us; skew 500 ppm
I20260812 01:05:00.936956 6919 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:00 dist-test-slave-bndk krb5kdc[6720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496700, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:00.939919 6919 init.cc:377] Logged in from keytab as kudu/127.4.201.65@KRBTEST.COM (short username kudu)
I20260812 01:05:00.941368 6919 webserver.cc:460] Webserver started at http://127.4.201.65:39523/ using document root <none> and password file <none>
I20260812 01:05:00.942051 6919 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:00.942152 6919 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:00.942505 6919 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:00.945382 6919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-0/data/instance:
uuid: "29cb95bf04ef4d74bb6cf355272c8214"
format_stamp: "Formatted at 2026-08-12 01:05:00 on dist-test-slave-bndk"
server_key: "1a03ccf534a6ee7a1508c34782d2c40f"
server_key_iv: "60289cda45d595437e6fabb651c39fe7"
server_key_version: "encryptionkey@0"
I20260812 01:05:00.946151 6919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance:
uuid: "29cb95bf04ef4d74bb6cf355272c8214"
format_stamp: "Formatted at 2026-08-12 01:05:00 on dist-test-slave-bndk"
server_key: "1a03ccf534a6ee7a1508c34782d2c40f"
server_key_iv: "60289cda45d595437e6fabb651c39fe7"
server_key_version: "encryptionkey@0"
I20260812 01:05:00.950996 6919 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 01:05:00.954300 6950 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:00.955480 6919 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 01:05:00.955626 6919 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "29cb95bf04ef4d74bb6cf355272c8214"
format_stamp: "Formatted at 2026-08-12 01:05:00 on dist-test-slave-bndk"
server_key: "1a03ccf534a6ee7a1508c34782d2c40f"
server_key_iv: "60289cda45d595437e6fabb651c39fe7"
server_key_version: "encryptionkey@0"
I20260812 01:05:00.955817 6919 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:00.979974 6919 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:00.984203 6919 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:00.984462 6919 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:00.987262 6919 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:00.987357 6919 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:00.987498 6919 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:00.987557 6919 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 01:05:01 dist-test-slave-bndk krb5kdc[6720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496700, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:01.010051 6962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:00.987854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:42405 (local address 127.4.201.126:44869)
0812 01:05:00.990168 (+ 2314us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:00.990174 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:00.990198 (+ 24us) server_negotiation.cc:407] Connection header received
0812 01:05:00.991780 (+ 1582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:00.991787 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:00.991873 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:00.991970 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:00.994332 (+ 2362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:00.995228 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:00.997772 (+ 2544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:00.998183 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:00.998280 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:01.003177 (+ 4897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:01.003184 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:01.003189 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:01.003229 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:01.006348 (+ 3119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:01.007325 (+ 977us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:01.007331 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:01.007335 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:01.007513 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:01.008104 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:01.008111 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:01.008115 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:01.008513 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:01.008692 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:01.009374 (+ 682us) server_negotiation.cc:299] Negotiation successful
0812 01:05:01.009609 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2191,"thread_start_us":2095,"threads_started":1}
I20260812 01:05:01.010967 6963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:00.988452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:44869 (local address 127.4.201.65:42405)
0812 01:05:00.989390 (+ 938us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:00.989440 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:00.991507 (+ 2067us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:00.992243 (+ 736us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:00.992250 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:00.993001 (+ 751us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:00.994103 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:00.994125 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:00.995430 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:00.995435 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:00.997575 (+ 2140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:00.997592 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:00.998632 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:00.998637 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:00.998926 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:00.999622 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:00.999657 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:01.002893 (+ 3236us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:01.006479 (+ 3586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:01.006492 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:01.006511 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:01.007158 (+ 647us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:01.007632 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:01.007637 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:01.007641 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:01.007950 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:01.008641 (+ 691us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:01.008647 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:01.009014 (+ 367us) client_negotiation.cc:769] Sending connection context
0812 01:05:01.009273 (+ 259us) client_negotiation.cc:240] Negotiation successful
0812 01:05:01.009804 (+ 531us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":641,"thread_start_us":416,"threads_started":1}
I20260812 01:05:01.036263 6919 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:34419
I20260812 01:05:01.036293 7158 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:34419 every 8 connection(s)
I20260812 01:05:01.037086 7119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:01.024394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:44869 (local address 127.4.201.65:51185)
0812 01:05:01.025073 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:01.025090 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:01.025243 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:01.025582 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:01.025587 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:01.026027 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:01.026317 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:01.026327 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:01.027246 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:01.027251 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:01.028254 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:01.028267 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:01.028986 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:01.028992 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:01.029133 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:01.029811 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:01.029844 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:01.031153 (+ 1309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:01.034383 (+ 3230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:01.034388 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:01.034392 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:01.034911 (+ 519us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:01.035352 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:01.035357 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:01.035361 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:01.035545 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:01.036160 (+ 615us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:01.036165 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:01.036359 (+ 194us) client_negotiation.cc:769] Sending connection context
0812 01:05:01.036505 (+ 146us) client_negotiation.cc:240] Negotiation successful
0812 01:05:01.036751 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":342,"threads_started":1}
I20260812 01:05:01.037628 6919 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:05:01.037832 6962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:01.024395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:51185 (local address 127.4.201.126:44869)
0812 01:05:01.024588 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:01.024594 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:01.025173 (+ 579us) server_negotiation.cc:407] Connection header received
0812 01:05:01.025365 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:01.025370 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:01.025451 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:01.025532 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:01.026462 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:01.027118 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:01.028390 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:01.028801 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:01.028905 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:01.031367 (+ 2462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:01.031373 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:01.031378 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:01.031417 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:01.034255 (+ 2838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:01.035040 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:01.035045 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:01.035049 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:01.035231 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:01.035672 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:01.035677 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:01.035681 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:01.036038 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:01.036173 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:01.037409 (+ 1236us) server_negotiation.cc:299] Negotiation successful
0812 01:05:01.037587 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 01:05:01.039503 7159 heartbeater.cc:347] Connected to a master server at 127.4.201.126:44869
I20260812 01:05:01.040035 7159 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:01.040840 7159 heartbeater.cc:511] Master 127.4.201.126:44869 requested a full tablet report, sending...
I20260812 01:05:01.043144 6799 ts_manager.cc:194] Registered new tserver with Master: 29cb95bf04ef4d74bb6cf355272c8214 (127.4.201.65:34419)
I20260812 01:05:01.044080 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 6919
I20260812 01:05:01.044269 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance
I20260812 01:05:01.044730 6799 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.65@KRBTEST.COM'} at 127.4.201.65:42405
I20260812 01:05:01.044961 4901 external_mini_cluster.cc:1428] Setting key 3029e6df1e8cc4503f22e96da8f8ee25
WARNING: no policy specified for kudu/127.4.201.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
I20260812 01:05:01.085724 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:0
--local_ip_for_outbound_sockets=127.4.201.66
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:44869
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:45589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:01.410357 7166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:01.410638 7166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:01.410744 7166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:01.417850 7166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:01.417949 7166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:01.418038 7166 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 01:05:01.418116 7166 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:05:01.427561 7166 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:45589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.201.126:44869
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:01.428772 7166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:01.430066 7166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:01.442453 7174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:01.442498 7175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:01.442544 7181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:01.443519 7166 server_base.cc:1034] running on GCE node
I20260812 01:05:01.444099 7166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:01.444975 7166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:01.446228 7166 hybrid_clock.cc:648] HybridClock initialized: now 1786496701446110 us; error 54 us; skew 500 ppm
I20260812 01:05:01.446529 7166 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:01 dist-test-slave-bndk krb5kdc[6720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496701, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:01.455097 7166 init.cc:377] Logged in from keytab as kudu/127.4.201.66@KRBTEST.COM (short username kudu)
I20260812 01:05:01.456591 7166 webserver.cc:460] Webserver started at http://127.4.201.66:36839/ using document root <none> and password file <none>
I20260812 01:05:01.457307 7166 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:01.457412 7166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:01.457734 7166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:01.460881 7166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-1/data/instance:
uuid: "9bf85593faaa440fbcc015dfcb6ecadc"
format_stamp: "Formatted at 2026-08-12 01:05:01 on dist-test-slave-bndk"
server_key: "e3d872677e1daabbb048f48bc8c84327"
server_key_iv: "296130055160df563676c6e4060ad7b7"
server_key_version: "encryptionkey@0"
I20260812 01:05:01.461854 7166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance:
uuid: "9bf85593faaa440fbcc015dfcb6ecadc"
format_stamp: "Formatted at 2026-08-12 01:05:01 on dist-test-slave-bndk"
server_key: "e3d872677e1daabbb048f48bc8c84327"
server_key_iv: "296130055160df563676c6e4060ad7b7"
server_key_version: "encryptionkey@0"
I20260812 01:05:01.466640 7166 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260812 01:05:01.469900 7192 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:01.471130 7166 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 01:05:01.471278 7166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "9bf85593faaa440fbcc015dfcb6ecadc"
format_stamp: "Formatted at 2026-08-12 01:05:01 on dist-test-slave-bndk"
server_key: "e3d872677e1daabbb048f48bc8c84327"
server_key_iv: "296130055160df563676c6e4060ad7b7"
server_key_version: "encryptionkey@0"
I20260812 01:05:01.471496 7166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:01.500887 7166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:01.505081 7166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:01.505383 7166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:01.508121 7166 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:01.508224 7166 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:01.508383 7166 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:01.508466 7166 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 01:05:01 dist-test-slave-bndk krb5kdc[6720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496701, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:01.529655 6962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:01.508649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:41685 (local address 127.4.201.126:44869)
0812 01:05:01.508841 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:01.508848 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:01.510361 (+ 1513us) server_negotiation.cc:407] Connection header received
0812 01:05:01.512338 (+ 1977us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:01.512344 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:01.512447 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:01.512544 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:01.514744 (+ 2200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:01.515728 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:01.517323 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:01.517908 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:01.518026 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:01.522739 (+ 4713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:01.522747 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:01.522751 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:01.522793 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:01.526069 (+ 3276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:01.527061 (+ 992us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:01.527066 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:01.527068 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:01.527204 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:01.527755 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:01.527761 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:01.527765 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:01.528138 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:01.528277 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:01.529066 (+ 789us) server_negotiation.cc:299] Negotiation successful
0812 01:05:01.529329 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 01:05:01.530622 7215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:01.509342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:44869 (local address 127.4.201.66:41685)
0812 01:05:01.510200 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:01.510240 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:01.512049 (+ 1809us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:01.512861 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:01.512871 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:01.513594 (+ 723us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:01.514497 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:01.514528 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:01.515890 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:01.515896 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:01.517160 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:01.517173 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:01.518146 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:01.518153 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:01.518450 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:01.519236 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:01.519270 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:01.522417 (+ 3147us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:01.526227 (+ 3810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:01.526237 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:01.526253 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:01.526890 (+ 637us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:01.527349 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:01.527354 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:01.527358 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:01.527634 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:01.528281 (+ 647us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:01.528289 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:01.528659 (+ 370us) client_negotiation.cc:769] Sending connection context
0812 01:05:01.528890 (+ 231us) client_negotiation.cc:240] Negotiation successful
0812 01:05:01.529418 (+ 528us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":616,"thread_start_us":372,"threads_started":1}
I20260812 01:05:01.553846 6962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:01.540053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:44289 (local address 127.4.201.126:44869)
0812 01:05:01.540245 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:01.540251 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:01.540735 (+ 484us) server_negotiation.cc:407] Connection header received
0812 01:05:01.540863 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:01.540868 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:01.540944 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:01.541059 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:01.542343 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:01.543067 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:01.544346 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:01.544945 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:01.545076 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:01.547510 (+ 2434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:01.547517 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:01.547522 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:01.547561 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:01.550559 (+ 2998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:01.551573 (+ 1014us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:01.551578 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:01.551582 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:01.551743 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:01.552220 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:01.552226 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:01.552229 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:01.552604 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:01.552758 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:01.553305 (+ 547us) server_negotiation.cc:299] Negotiation successful
0812 01:05:01.553534 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 01:05:01.554147 7343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:01.540050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:44869 (local address 127.4.201.66:44289)
0812 01:05:01.540645 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:01.540664 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:01.540770 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:01.541068 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:01.541071 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:01.541543 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:01.542140 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:01.542156 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:01.543222 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:01.543226 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:01.544208 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:01.544219 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:01.545171 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:01.545180 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:01.545394 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:01.546051 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:01.546077 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:01.547282 (+ 1205us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:01.550704 (+ 3422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:01.550710 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:01.550715 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:01.551432 (+ 717us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:01.551877 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:01.551882 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:01.551887 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:01.552090 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:01.552726 (+ 636us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:01.552732 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:01.552968 (+ 236us) client_negotiation.cc:769] Sending connection context
0812 01:05:01.553172 (+ 204us) client_negotiation.cc:240] Negotiation successful
0812 01:05:01.553595 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":310,"threads_started":1}
I20260812 01:05:01.556785 7166 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:42017
I20260812 01:05:01.556788 7402 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:42017 every 8 connection(s)
I20260812 01:05:01.558353 7166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:05:01.560348 7403 heartbeater.cc:347] Connected to a master server at 127.4.201.126:44869
I20260812 01:05:01.560537 7403 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:01.561098 7403 heartbeater.cc:511] Master 127.4.201.126:44869 requested a full tablet report, sending...
I20260812 01:05:01.562353 6799 ts_manager.cc:194] Registered new tserver with Master: 9bf85593faaa440fbcc015dfcb6ecadc (127.4.201.66:42017)
I20260812 01:05:01.562485 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 7166
I20260812 01:05:01.562662 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance
I20260812 01:05:01.563156 4901 external_mini_cluster.cc:1428] Setting key c9f2584d543780919a62dea1e2e2690d
I20260812 01:05:01.563169 6799 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.66@KRBTEST.COM'} at 127.4.201.66:41685
WARNING: no policy specified for kudu/127.4.201.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
I20260812 01:05:01.603904 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:0
--local_ip_for_outbound_sockets=127.4.201.67
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:44869
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:45589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:01.926640 7409 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:01.926910 7409 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:01.927047 7409 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:01.934397 7409 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:01.934494 7409 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:01.934619 7409 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 01:05:01.934721 7409 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:05:01.944020 7409 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:45589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.201.126:44869
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:01.945261 7409 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:01.946650 7409 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:01.959282 7417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:01.959317 7422 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:01.959350 7418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:01.960307 7409 server_base.cc:1034] running on GCE node
I20260812 01:05:01.960930 7409 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:01.961887 7409 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:01.963101 7409 hybrid_clock.cc:648] HybridClock initialized: now 1786496701963042 us; error 35 us; skew 500 ppm
I20260812 01:05:01.963375 7409 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:01 dist-test-slave-bndk krb5kdc[6720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496701, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:01.966427 7409 init.cc:377] Logged in from keytab as kudu/127.4.201.67@KRBTEST.COM (short username kudu)
I20260812 01:05:01.967778 7409 webserver.cc:460] Webserver started at http://127.4.201.67:41455/ using document root <none> and password file <none>
I20260812 01:05:01.968446 7409 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:01.968534 7409 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:01.968783 7409 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:01.971657 7409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-2/data/instance:
uuid: "6fea9b808d7c46ee8edc09b87c6990ce"
format_stamp: "Formatted at 2026-08-12 01:05:01 on dist-test-slave-bndk"
server_key: "9aca3c00c93c4df00651ec68e2c23d8b"
server_key_iv: "a407467dcc6c63d25cbf266a71c93748"
server_key_version: "encryptionkey@0"
I20260812 01:05:01.972411 7409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance:
uuid: "6fea9b808d7c46ee8edc09b87c6990ce"
format_stamp: "Formatted at 2026-08-12 01:05:01 on dist-test-slave-bndk"
server_key: "9aca3c00c93c4df00651ec68e2c23d8b"
server_key_iv: "a407467dcc6c63d25cbf266a71c93748"
server_key_version: "encryptionkey@0"
I20260812 01:05:01.977684 7409 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260812 01:05:01.980894 7433 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:01.982169 7409 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:05:01.982304 7409 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "6fea9b808d7c46ee8edc09b87c6990ce"
format_stamp: "Formatted at 2026-08-12 01:05:01 on dist-test-slave-bndk"
server_key: "9aca3c00c93c4df00651ec68e2c23d8b"
server_key_iv: "a407467dcc6c63d25cbf266a71c93748"
server_key_version: "encryptionkey@0"
I20260812 01:05:01.982477 7409 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:02.000348 7409 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:02.004189 7409 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:02.004410 7409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:02.007064 7409 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:02.007159 7409 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:02.007308 7409 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:02.007411 7409 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
Aug 12 01:05:02 dist-test-slave-bndk krb5kdc[6720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496701, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:02.029635 6962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.007513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:44657 (local address 127.4.201.126:44869)
0812 01:05:02.007746 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:02.007753 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:02.009185 (+ 1432us) server_negotiation.cc:407] Connection header received
0812 01:05:02.011937 (+ 2752us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:02.011942 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:02.012015 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:02.012098 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:02.014543 (+ 2445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.015499 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.018293 (+ 2794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.018712 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.018811 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.023117 (+ 4306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:02.023122 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:02.023125 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:02.023158 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:02.025851 (+ 2693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:02.026792 (+ 941us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:02.026798 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:02.026802 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:02.026977 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:02.027549 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:02.027555 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:02.027559 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:02.027969 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:02.028128 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:02.028928 (+ 800us) server_negotiation.cc:299] Negotiation successful
0812 01:05:02.029202 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 01:05:02.030382 7452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.008074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:44869 (local address 127.4.201.67:44657)
0812 01:05:02.008982 (+ 908us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:02.009034 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:02.011642 (+ 2608us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:02.012380 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:02.012390 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:02.013258 (+ 868us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:02.014317 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:02.014349 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.015674 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.015680 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:02.018111 (+ 2431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:02.018133 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.018958 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.018965 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:02.019269 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.020058 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:02.020090 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:02.022907 (+ 2817us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:02.025991 (+ 3084us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:02.025999 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:02.026018 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:02.026650 (+ 632us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:02.027124 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:02.027129 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:02.027133 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:02.027393 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:02.028092 (+ 699us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:02.028098 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:02.028425 (+ 327us) client_negotiation.cc:769] Sending connection context
0812 01:05:02.028751 (+ 326us) client_negotiation.cc:240] Negotiation successful
0812 01:05:02.029164 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":329,"threads_started":1}
I20260812 01:05:02.047577 7159 heartbeater.cc:503] Master 127.4.201.126:44869 was elected leader, sending a full tablet report...
I20260812 01:05:02.054229 6962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.035664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:38293 (local address 127.4.201.126:44869)
0812 01:05:02.035834 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:02.035840 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:02.041419 (+ 5579us) server_negotiation.cc:407] Connection header received
0812 01:05:02.041590 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:02.041595 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:02.041680 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:02.041772 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:02.043258 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.044339 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.046040 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.046633 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.046757 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.049081 (+ 2324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:02.049086 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:02.049089 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:02.049125 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:02.051725 (+ 2600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:02.052351 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:02.052357 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:02.052360 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:02.052488 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:02.052824 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:02.052829 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:02.052833 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:02.053078 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:02.053207 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:02.053663 (+ 456us) server_negotiation.cc:299] Negotiation successful
0812 01:05:02.053870 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 01:05:02.054656 7546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.035683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:44869 (local address 127.4.201.67:38293)
0812 01:05:02.041298 (+ 5615us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:02.041321 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:02.041464 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:02.041951 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:02.041959 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:02.042624 (+ 665us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:02.043082 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:02.043105 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.044481 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.044486 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:02.045901 (+ 1415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:02.045920 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.047072 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.047080 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:02.047207 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.047858 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:02.047879 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:02.048905 (+ 1026us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:02.051847 (+ 2942us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:02.051852 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:02.051857 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:02.052243 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:02.052593 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:02.052598 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:02.052602 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:02.052722 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:02.053192 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:02.053197 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:02.053401 (+ 204us) client_negotiation.cc:769] Sending connection context
0812 01:05:02.053537 (+ 136us) client_negotiation.cc:240] Negotiation successful
0812 01:05:02.053938 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5422,"thread_start_us":5283,"threads_started":1}
I20260812 01:05:02.064795 7409 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:39811
I20260812 01:05:02.064817 7631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:39811 every 8 connection(s)
I20260812 01:05:02.066004 7409 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:05:02.067821 7632 heartbeater.cc:347] Connected to a master server at 127.4.201.126:44869
I20260812 01:05:02.068040 7632 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:02.068638 7632 heartbeater.cc:511] Master 127.4.201.126:44869 requested a full tablet report, sending...
I20260812 01:05:02.069852 6799 ts_manager.cc:194] Registered new tserver with Master: 6fea9b808d7c46ee8edc09b87c6990ce (127.4.201.67:39811)
I20260812 01:05:02.070613 6799 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.67@KRBTEST.COM'} at 127.4.201.67:44657
I20260812 01:05:02.070947 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 7409
I20260812 01:05:02.071172 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance
I20260812 01:05:02.071604 4901 external_mini_cluster.cc:1428] Setting key b0e0162ae31667da2c7bc642c8e817a1
I20260812 01:05:02.074379 4901 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 01:05:02 dist-test-slave-bndk krb5kdc[6720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496702, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 01:05:02 dist-test-slave-bndk krb5kdc[6720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496702, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:02.133812 6962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.115760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60798 (local address 127.4.201.126:44869)
0812 01:05:02.116051 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:02.116057 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:02.116083 (+ 26us) server_negotiation.cc:407] Connection header received
0812 01:05:02.116163 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:02.116169 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:02.116265 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:02.116522 (+ 257us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:02.118679 (+ 2157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.119819 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.121692 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.122464 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.122627 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.127680 (+ 5053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:02.127686 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:02.127689 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:02.127726 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:02.130967 (+ 3241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:02.131643 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:02.131649 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:02.131653 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:02.131809 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:02.132213 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:02.132218 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:02.132222 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:02.132594 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:02.132850 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:02.133189 (+ 339us) server_negotiation.cc:299] Negotiation successful
0812 01:05:02.133443 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260812 01:05:02.139834 6799 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60798:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:05:02.148778 6799 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:05:02.182051 7661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.161600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:34419 (local address 127.0.0.1:44562)
0812 01:05:02.162415 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:02.162450 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:02.162630 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:02.174879 (+ 12249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:02.174911 (+ 32us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:02.174935 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:02.175423 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:02.175435 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.177322 (+ 1887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.177331 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:02.179244 (+ 1913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:02.179258 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.180985 (+ 1727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.180993 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:02.181255 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.181315 (+ 60us) client_negotiation.cc:769] Sending connection context
0812 01:05:02.181423 (+ 108us) client_negotiation.cc:240] Negotiation successful
0812 01:05:02.181586 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":564,"mutex_wait_us":39,"thread_start_us":11767,"threads_started":1}
I20260812 01:05:02.182118 7667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.163333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53642 (local address 127.4.201.66:42017)
0812 01:05:02.169805 (+ 6472us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:02.169814 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:02.173709 (+ 3895us) server_negotiation.cc:407] Connection header received
0812 01:05:02.174034 (+ 325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:02.174042 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:02.174262 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:02.174430 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:02.175364 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.176786 (+ 1422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.179665 (+ 2879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.180978 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.181126 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.181372 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:02.181664 (+ 292us) server_negotiation.cc:299] Negotiation successful
0812 01:05:02.181839 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6301,"thread_start_us":6417,"threads_started":1}
I20260812 01:05:02.182132 7657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.162869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:42017 (local address 127.0.0.1:53642)
0812 01:05:02.173588 (+ 10719us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:02.173602 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:02.173802 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:02.174689 (+ 887us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:02.174693 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:02.174717 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:02.175209 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:02.175226 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.176953 (+ 1727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.176958 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:02.179522 (+ 2564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:02.179534 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.181182 (+ 1648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.181188 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:02.181466 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.181498 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 01:05:02.181595 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 01:05:02.181723 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10625,"mutex_wait_us":93,"thread_start_us":6412,"threads_started":1}
I20260812 01:05:02.182781 7664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.161739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:39811 (local address 127.0.0.1:44858)
0812 01:05:02.169560 (+ 7821us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:02.169579 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:02.169695 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:02.173730 (+ 4035us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:02.173738 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:02.173771 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:02.174220 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:02.174234 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.176657 (+ 2423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.176662 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:02.179417 (+ 2755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:02.179434 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.181157 (+ 1723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.181168 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:02.181434 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.181806 (+ 372us) client_negotiation.cc:769] Sending connection context
0812 01:05:02.181900 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 01:05:02.182021 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7687,"mutex_wait_us":367,"thread_start_us":395,"threads_started":1}
I20260812 01:05:02.183219 7662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.162085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44562 (local address 127.4.201.65:34419)
0812 01:05:02.174355 (+ 12270us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:02.174364 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:02.174391 (+ 27us) server_negotiation.cc:407] Connection header received
0812 01:05:02.174498 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:02.174504 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:02.174698 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:02.174891 (+ 193us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:02.175631 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.177134 (+ 1503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.179407 (+ 2273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.180760 (+ 1353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.182557 (+ 1797us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.182748 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:02.182809 (+ 61us) server_negotiation.cc:299] Negotiation successful
0812 01:05:02.182956 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12103,"thread_start_us":12367,"threads_started":1}
I20260812 01:05:02.184406 7663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.162128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44858 (local address 127.4.201.67:39811)
0812 01:05:02.173033 (+ 10905us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:02.173042 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:02.173080 (+ 38us) server_negotiation.cc:407] Connection header received
0812 01:05:02.173190 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:02.173198 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:02.173481 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:02.173706 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:02.174474 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.176494 (+ 2020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.179625 (+ 3131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.180916 (+ 1291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.181495 (+ 579us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.181726 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:02.183067 (+ 1341us) server_negotiation.cc:299] Negotiation successful
0812 01:05:02.183215 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10722,"thread_start_us":12893,"threads_started":1}
I20260812 01:05:02.186141 7292 tablet_service.cc:1467] Processing CreateTablet for tablet b5743befcfb54ba6a0f0acd341714b04 (DEFAULT_TABLE table=test-table [id=1cf98980721349178d8925455fe536a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:02.186574 7033 tablet_service.cc:1467] Processing CreateTablet for tablet b5743befcfb54ba6a0f0acd341714b04 (DEFAULT_TABLE table=test-table [id=1cf98980721349178d8925455fe536a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:02.187536 7292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5743befcfb54ba6a0f0acd341714b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:02.187945 7033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5743befcfb54ba6a0f0acd341714b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:02.187829 7530 tablet_service.cc:1467] Processing CreateTablet for tablet b5743befcfb54ba6a0f0acd341714b04 (DEFAULT_TABLE table=test-table [id=1cf98980721349178d8925455fe536a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:02.189188 7530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5743befcfb54ba6a0f0acd341714b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:02.199361 7668 tablet_bootstrap.cc:492] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc: Bootstrap starting.
I20260812 01:05:02.201944 7669 tablet_bootstrap.cc:492] T b5743befcfb54ba6a0f0acd341714b04 P 29cb95bf04ef4d74bb6cf355272c8214: Bootstrap starting.
I20260812 01:05:02.203018 7668 tablet_bootstrap.cc:654] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:02.203944 7670 tablet_bootstrap.cc:492] T b5743befcfb54ba6a0f0acd341714b04 P 6fea9b808d7c46ee8edc09b87c6990ce: Bootstrap starting.
I20260812 01:05:02.204298 7668 log.cc:824] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:02.205274 7669 tablet_bootstrap.cc:654] T b5743befcfb54ba6a0f0acd341714b04 P 29cb95bf04ef4d74bb6cf355272c8214: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:02.206434 7669 log.cc:824] T b5743befcfb54ba6a0f0acd341714b04 P 29cb95bf04ef4d74bb6cf355272c8214: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:02.207041 7670 tablet_bootstrap.cc:654] T b5743befcfb54ba6a0f0acd341714b04 P 6fea9b808d7c46ee8edc09b87c6990ce: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:02.207615 7668 tablet_bootstrap.cc:492] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc: No bootstrap required, opened a new log
I20260812 01:05:02.207890 7668 ts_tablet_manager.cc:1397] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.008s
I20260812 01:05:02.208288 7670 log.cc:824] T b5743befcfb54ba6a0f0acd341714b04 P 6fea9b808d7c46ee8edc09b87c6990ce: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:02.209556 7669 tablet_bootstrap.cc:492] T b5743befcfb54ba6a0f0acd341714b04 P 29cb95bf04ef4d74bb6cf355272c8214: No bootstrap required, opened a new log
I20260812 01:05:02.209838 7669 ts_tablet_manager.cc:1397] T b5743befcfb54ba6a0f0acd341714b04 P 29cb95bf04ef4d74bb6cf355272c8214: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260812 01:05:02.215152 7670 tablet_bootstrap.cc:492] T b5743befcfb54ba6a0f0acd341714b04 P 6fea9b808d7c46ee8edc09b87c6990ce: No bootstrap required, opened a new log
I20260812 01:05:02.215464 7670 ts_tablet_manager.cc:1397] T b5743befcfb54ba6a0f0acd341714b04 P 6fea9b808d7c46ee8edc09b87c6990ce: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.005s
I20260812 01:05:02.215595 7668 raft_consensus.cc:348] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } }
I20260812 01:05:02.215929 7668 raft_consensus.cc:374] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:02.216024 7668 raft_consensus.cc:729] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf85593faaa440fbcc015dfcb6ecadc, State: Initialized, Role: FOLLOWER
I20260812 01:05:02.217787 7668 consensus_queue.cc:260] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } }
I20260812 01:05:02.218310 7678 raft_consensus.cc:482] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:05:02.220045 7669 raft_consensus.cc:348] T b5743befcfb54ba6a0f0acd341714b04 P 29cb95bf04ef4d74bb6cf355272c8214 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } }
I20260812 01:05:02.220460 7669 raft_consensus.cc:374] T b5743befcfb54ba6a0f0acd341714b04 P 29cb95bf04ef4d74bb6cf355272c8214 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:02.220561 7669 raft_consensus.cc:729] T b5743befcfb54ba6a0f0acd341714b04 P 29cb95bf04ef4d74bb6cf355272c8214 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29cb95bf04ef4d74bb6cf355272c8214, State: Initialized, Role: FOLLOWER
I20260812 01:05:02.221292 7669 consensus_queue.cc:260] T b5743befcfb54ba6a0f0acd341714b04 P 29cb95bf04ef4d74bb6cf355272c8214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } }
I20260812 01:05:02.218626 7678 raft_consensus.cc:504] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } }
I20260812 01:05:02.226059 7670 raft_consensus.cc:348] T b5743befcfb54ba6a0f0acd341714b04 P 6fea9b808d7c46ee8edc09b87c6990ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } }
I20260812 01:05:02.226505 7670 raft_consensus.cc:374] T b5743befcfb54ba6a0f0acd341714b04 P 6fea9b808d7c46ee8edc09b87c6990ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:02.226613 7670 raft_consensus.cc:729] T b5743befcfb54ba6a0f0acd341714b04 P 6fea9b808d7c46ee8edc09b87c6990ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fea9b808d7c46ee8edc09b87c6990ce, State: Initialized, Role: FOLLOWER
I20260812 01:05:02.227221 7670 consensus_queue.cc:260] T b5743befcfb54ba6a0f0acd341714b04 P 6fea9b808d7c46ee8edc09b87c6990ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } }
I20260812 01:05:02.228098 7668 ts_tablet_manager.cc:1428] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc: Time spent starting tablet: real 0.020s user 0.011s sys 0.000s
I20260812 01:05:02.228381 7403 heartbeater.cc:503] Master 127.4.201.126:44869 was elected leader, sending a full tablet report...
I20260812 01:05:02.229300 7669 ts_tablet_manager.cc:1428] T b5743befcfb54ba6a0f0acd341714b04 P 29cb95bf04ef4d74bb6cf355272c8214: Time spent starting tablet: real 0.019s user 0.018s sys 0.000s
I20260812 01:05:02.232187 7632 heartbeater.cc:503] Master 127.4.201.126:44869 was elected leader, sending a full tablet report...
I20260812 01:05:02.232631 7670 ts_tablet_manager.cc:1428] T b5743befcfb54ba6a0f0acd341714b04 P 6fea9b808d7c46ee8edc09b87c6990ce: Time spent starting tablet: real 0.017s user 0.014s sys 0.005s
I20260812 01:05:02.236140 7678 leader_election.cc:288] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29cb95bf04ef4d74bb6cf355272c8214 (127.4.201.65:34419), 6fea9b808d7c46ee8edc09b87c6990ce (127.4.201.67:39811)
I20260812 01:05:02.241878 7662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.230246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:48075 (local address 127.4.201.65:34419)
0812 01:05:02.230495 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:02.230501 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:02.235222 (+ 4721us) server_negotiation.cc:407] Connection header received
0812 01:05:02.235501 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:02.235507 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:02.235568 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:02.235638 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:02.236421 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.237451 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.239970 (+ 2519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.240934 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.241090 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.241163 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:02.241525 (+ 362us) server_negotiation.cc:299] Negotiation successful
0812 01:05:02.241646 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 01:05:02.242151 7686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.229838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:34419 (local address 127.4.201.66:48075)
0812 01:05:02.235125 (+ 5287us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:02.235152 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:02.235334 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:02.235669 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:02.235673 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:02.235699 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:02.236157 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:02.236173 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.237593 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.237599 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:02.239781 (+ 2182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:02.239797 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.241161 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.241167 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:02.241373 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.241398 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 01:05:02.241483 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 01:05:02.241602 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5105,"mutex_wait_us":1,"thread_start_us":6583,"threads_started":1}
I20260812 01:05:02.242913 7067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5743befcfb54ba6a0f0acd341714b04" candidate_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29cb95bf04ef4d74bb6cf355272c8214" is_pre_election: true
I20260812 01:05:02.243337 7663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.234913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:37287 (local address 127.4.201.67:39811)
0812 01:05:02.235094 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:02.235101 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:02.236876 (+ 1775us) server_negotiation.cc:407] Connection header received
0812 01:05:02.237577 (+ 701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:02.237583 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:02.237649 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:02.237741 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:02.238778 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.239800 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.241600 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.242504 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.242643 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.242709 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:02.242979 (+ 270us) server_negotiation.cc:299] Negotiation successful
0812 01:05:02.243096 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 01:05:02.243356 7684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.234426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:39811 (local address 127.4.201.66:37287)
0812 01:05:02.236717 (+ 2291us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:02.236734 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:02.237447 (+ 713us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:02.237778 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:02.237783 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:02.237822 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:02.238591 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:02.238609 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.239951 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.239957 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:02.241454 (+ 1497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:02.241467 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.242687 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.242693 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:02.242836 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.242859 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 01:05:02.242937 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 01:05:02.243054 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2172,"thread_start_us":1371,"threads_started":1}
I20260812 01:05:02.243346 7067 raft_consensus.cc:2454] T b5743befcfb54ba6a0f0acd341714b04 P 29cb95bf04ef4d74bb6cf355272c8214 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bf85593faaa440fbcc015dfcb6ecadc in term 0.
I20260812 01:05:02.244014 7198 leader_election.cc:302] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29cb95bf04ef4d74bb6cf355272c8214, 9bf85593faaa440fbcc015dfcb6ecadc; no voters:
I20260812 01:05:02.244360 7678 raft_consensus.cc:2781] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:05:02.244263 7568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5743befcfb54ba6a0f0acd341714b04" candidate_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" is_pre_election: true
I20260812 01:05:02.244480 7678 raft_consensus.cc:482] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:05:02.244585 7678 raft_consensus.cc:3037] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:02.244669 7568 raft_consensus.cc:2454] T b5743befcfb54ba6a0f0acd341714b04 P 6fea9b808d7c46ee8edc09b87c6990ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bf85593faaa440fbcc015dfcb6ecadc in term 0.
I20260812 01:05:02.246979 7678 raft_consensus.cc:504] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } }
I20260812 01:05:02.247609 7678 leader_election.cc:288] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc [CANDIDATE]: Term 1 election: Requested vote from peers 29cb95bf04ef4d74bb6cf355272c8214 (127.4.201.65:34419), 6fea9b808d7c46ee8edc09b87c6990ce (127.4.201.67:39811)
I20260812 01:05:02.247947 7067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5743befcfb54ba6a0f0acd341714b04" candidate_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29cb95bf04ef4d74bb6cf355272c8214"
I20260812 01:05:02.248112 7067 raft_consensus.cc:3037] T b5743befcfb54ba6a0f0acd341714b04 P 29cb95bf04ef4d74bb6cf355272c8214 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:02.248077 7568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5743befcfb54ba6a0f0acd341714b04" candidate_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fea9b808d7c46ee8edc09b87c6990ce"
I20260812 01:05:02.248257 7568 raft_consensus.cc:3037] T b5743befcfb54ba6a0f0acd341714b04 P 6fea9b808d7c46ee8edc09b87c6990ce [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:02.250413 7067 raft_consensus.cc:2454] T b5743befcfb54ba6a0f0acd341714b04 P 29cb95bf04ef4d74bb6cf355272c8214 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf85593faaa440fbcc015dfcb6ecadc in term 1.
I20260812 01:05:02.250455 7568 raft_consensus.cc:2454] T b5743befcfb54ba6a0f0acd341714b04 P 6fea9b808d7c46ee8edc09b87c6990ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf85593faaa440fbcc015dfcb6ecadc in term 1.
I20260812 01:05:02.250761 7198 leader_election.cc:302] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29cb95bf04ef4d74bb6cf355272c8214, 9bf85593faaa440fbcc015dfcb6ecadc; no voters:
I20260812 01:05:02.251024 7678 raft_consensus.cc:2781] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:05:02.251160 7678 raft_consensus.cc:686] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc [term 1 LEADER]: Becoming Leader. State: Replica: 9bf85593faaa440fbcc015dfcb6ecadc, State: Running, Role: LEADER
I20260812 01:05:02.251585 7678 consensus_queue.cc:237] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } }
I20260812 01:05:02.256270 6799 catalog_manager.cc:5495] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bf85593faaa440fbcc015dfcb6ecadc (127.4.201.66). New cstate: current_term: 1 leader_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } health_report { overall_health: HEALTHY } } }
W20260812 01:05:02.290789 7161 tablet.cc:2369] T b5743befcfb54ba6a0f0acd341714b04 P 29cb95bf04ef4d74bb6cf355272c8214: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:05:02.296188 7667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.290921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53658 (local address 127.4.201.66:42017)
0812 01:05:02.291263 (+ 342us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:02.291268 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:02.291286 (+ 18us) server_negotiation.cc:407] Connection header received
0812 01:05:02.291652 (+ 366us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:02.291657 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:02.291740 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:02.291861 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:05:02.292186 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.292907 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.294221 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.294637 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.294726 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.295130 (+ 404us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:05:02.295649 (+ 519us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:05:02.295762 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:02.295846 (+ 84us) server_negotiation.cc:299] Negotiation successful
0812 01:05:02.295917 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216}
I20260812 01:05:02.304473 7067 raft_consensus.cc:1261] T b5743befcfb54ba6a0f0acd341714b04 P 29cb95bf04ef4d74bb6cf355272c8214 [term 1 FOLLOWER]: Refusing update from remote peer 9bf85593faaa440fbcc015dfcb6ecadc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:02.304517 7568 raft_consensus.cc:1261] T b5743befcfb54ba6a0f0acd341714b04 P 6fea9b808d7c46ee8edc09b87c6990ce [term 1 FOLLOWER]: Refusing update from remote peer 9bf85593faaa440fbcc015dfcb6ecadc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:02.305404 7679 consensus_queue.cc:1035] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:02.305763 7678 consensus_queue.cc:1035] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc [LEADER]: Connected to new peer: Peer: permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 01:05:02.310142 7404 tablet.cc:2369] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:05:02.317472 7634 tablet.cc:2369] T b5743befcfb54ba6a0f0acd341714b04 P 6fea9b808d7c46ee8edc09b87c6990ce: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:05:02.321367 7697 mvcc.cc:205] Tried to move back new op lower bound from 7317490492629073920 to 7317490492426317824. Current Snapshot: MvccSnapshot[applied={T|T < 7317490492629073920}]
I20260812 01:05:02.340760 6798 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60798:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:05:02.341125 6798 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60798:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:05:02.345520 6798 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f5104aab16eb43fab71cfc6d3e35236b: Sending DeleteTablet for 3 replicas of tablet b5743befcfb54ba6a0f0acd341714b04
I20260812 01:05:02.346845 7033 tablet_service.cc:1514] Processing DeleteTablet for tablet b5743befcfb54ba6a0f0acd341714b04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:02 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:44562
I20260812 01:05:02.346880 7530 tablet_service.cc:1514] Processing DeleteTablet for tablet b5743befcfb54ba6a0f0acd341714b04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:02 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:44858
I20260812 01:05:02.347090 7292 tablet_service.cc:1514] Processing DeleteTablet for tablet b5743befcfb54ba6a0f0acd341714b04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:02 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:53642
I20260812 01:05:02.350853 6798 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60798:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:05:02.352473 6798 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:05:02.363191 7709 tablet_replica.cc:330] T b5743befcfb54ba6a0f0acd341714b04 P 6fea9b808d7c46ee8edc09b87c6990ce: stopping tablet replica
I20260812 01:05:02.363849 7709 raft_consensus.cc:2229] T b5743befcfb54ba6a0f0acd341714b04 P 6fea9b808d7c46ee8edc09b87c6990ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:05:02.363938 7288 tablet_service.cc:1467] Processing CreateTablet for tablet cec48b75c57b48d4a7c4099296da4f83 (DEFAULT_TABLE table=test-table [id=c21109f803c9437fb094a5c2f1ec71dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:02.363958 7527 tablet_service.cc:1467] Processing CreateTablet for tablet cec48b75c57b48d4a7c4099296da4f83 (DEFAULT_TABLE table=test-table [id=c21109f803c9437fb094a5c2f1ec71dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:02.364454 7709 raft_consensus.cc:2258] T b5743befcfb54ba6a0f0acd341714b04 P 6fea9b808d7c46ee8edc09b87c6990ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:02.364573 7288 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cec48b75c57b48d4a7c4099296da4f83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:02.364749 7527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cec48b75c57b48d4a7c4099296da4f83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:02.367136 7709 ts_tablet_manager.cc:1905] T b5743befcfb54ba6a0f0acd341714b04 P 6fea9b808d7c46ee8edc09b87c6990ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:02.370563 7032 tablet_service.cc:1467] Processing CreateTablet for tablet cec48b75c57b48d4a7c4099296da4f83 (DEFAULT_TABLE table=test-table [id=c21109f803c9437fb094a5c2f1ec71dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:02.371194 7032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cec48b75c57b48d4a7c4099296da4f83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:02.371964 7670 tablet_bootstrap.cc:492] T cec48b75c57b48d4a7c4099296da4f83 P 6fea9b808d7c46ee8edc09b87c6990ce: Bootstrap starting.
I20260812 01:05:02.373659 7668 tablet_bootstrap.cc:492] T cec48b75c57b48d4a7c4099296da4f83 P 9bf85593faaa440fbcc015dfcb6ecadc: Bootstrap starting.
I20260812 01:05:02.373857 7670 tablet_bootstrap.cc:654] T cec48b75c57b48d4a7c4099296da4f83 P 6fea9b808d7c46ee8edc09b87c6990ce: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:02.375391 7668 tablet_bootstrap.cc:654] T cec48b75c57b48d4a7c4099296da4f83 P 9bf85593faaa440fbcc015dfcb6ecadc: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:02.379012 7669 tablet_bootstrap.cc:492] T cec48b75c57b48d4a7c4099296da4f83 P 29cb95bf04ef4d74bb6cf355272c8214: Bootstrap starting.
I20260812 01:05:02.380659 7669 tablet_bootstrap.cc:654] T cec48b75c57b48d4a7c4099296da4f83 P 29cb95bf04ef4d74bb6cf355272c8214: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:02.385636 7668 tablet_bootstrap.cc:492] T cec48b75c57b48d4a7c4099296da4f83 P 9bf85593faaa440fbcc015dfcb6ecadc: No bootstrap required, opened a new log
I20260812 01:05:02.385885 7668 ts_tablet_manager.cc:1397] T cec48b75c57b48d4a7c4099296da4f83 P 9bf85593faaa440fbcc015dfcb6ecadc: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.001s
I20260812 01:05:02.386969 7668 raft_consensus.cc:348] T cec48b75c57b48d4a7c4099296da4f83 P 9bf85593faaa440fbcc015dfcb6ecadc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } }
I20260812 01:05:02.387306 7668 raft_consensus.cc:374] T cec48b75c57b48d4a7c4099296da4f83 P 9bf85593faaa440fbcc015dfcb6ecadc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:02.387480 7668 raft_consensus.cc:729] T cec48b75c57b48d4a7c4099296da4f83 P 9bf85593faaa440fbcc015dfcb6ecadc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf85593faaa440fbcc015dfcb6ecadc, State: Initialized, Role: FOLLOWER
I20260812 01:05:02.387842 7668 consensus_queue.cc:260] T cec48b75c57b48d4a7c4099296da4f83 P 9bf85593faaa440fbcc015dfcb6ecadc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } }
I20260812 01:05:02.388397 7709 ts_tablet_manager.cc:1918] T b5743befcfb54ba6a0f0acd341714b04 P 6fea9b808d7c46ee8edc09b87c6990ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:05:02.388581 7709 log.cc:1196] T b5743befcfb54ba6a0f0acd341714b04 P 6fea9b808d7c46ee8edc09b87c6990ce: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-2/wal/wals/b5743befcfb54ba6a0f0acd341714b04
I20260812 01:05:02.389515 7668 ts_tablet_manager.cc:1428] T cec48b75c57b48d4a7c4099296da4f83 P 9bf85593faaa440fbcc015dfcb6ecadc: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260812 01:05:02.390300 7708 tablet_replica.cc:330] T b5743befcfb54ba6a0f0acd341714b04 P 29cb95bf04ef4d74bb6cf355272c8214: stopping tablet replica
I20260812 01:05:02.390352 7709 ts_tablet_manager.cc:1939] T b5743befcfb54ba6a0f0acd341714b04 P 6fea9b808d7c46ee8edc09b87c6990ce: Deleting consensus metadata
I20260812 01:05:02.390964 7708 raft_consensus.cc:2229] T b5743befcfb54ba6a0f0acd341714b04 P 29cb95bf04ef4d74bb6cf355272c8214 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:05:02.391654 7708 raft_consensus.cc:2258] T b5743befcfb54ba6a0f0acd341714b04 P 29cb95bf04ef4d74bb6cf355272c8214 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:02.392328 6772 catalog_manager.cc:4841] TS 6fea9b808d7c46ee8edc09b87c6990ce (127.4.201.67:39811): tablet b5743befcfb54ba6a0f0acd341714b04 (table test-table [id=1cf98980721349178d8925455fe536a4]) successfully deleted
I20260812 01:05:02.392714 7710 tablet_replica.cc:330] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc: stopping tablet replica
I20260812 01:05:02.394302 7708 ts_tablet_manager.cc:1905] T b5743befcfb54ba6a0f0acd341714b04 P 29cb95bf04ef4d74bb6cf355272c8214: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:02.394333 7670 tablet_bootstrap.cc:492] T cec48b75c57b48d4a7c4099296da4f83 P 6fea9b808d7c46ee8edc09b87c6990ce: No bootstrap required, opened a new log
I20260812 01:05:02.394493 7670 ts_tablet_manager.cc:1397] T cec48b75c57b48d4a7c4099296da4f83 P 6fea9b808d7c46ee8edc09b87c6990ce: Time spent bootstrapping tablet: real 0.023s user 0.005s sys 0.005s
I20260812 01:05:02.395311 7670 raft_consensus.cc:348] T cec48b75c57b48d4a7c4099296da4f83 P 6fea9b808d7c46ee8edc09b87c6990ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } }
I20260812 01:05:02.395558 7670 raft_consensus.cc:374] T cec48b75c57b48d4a7c4099296da4f83 P 6fea9b808d7c46ee8edc09b87c6990ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:02.395648 7670 raft_consensus.cc:729] T cec48b75c57b48d4a7c4099296da4f83 P 6fea9b808d7c46ee8edc09b87c6990ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fea9b808d7c46ee8edc09b87c6990ce, State: Initialized, Role: FOLLOWER
I20260812 01:05:02.395915 7670 consensus_queue.cc:260] T cec48b75c57b48d4a7c4099296da4f83 P 6fea9b808d7c46ee8edc09b87c6990ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } }
I20260812 01:05:02.396561 7670 ts_tablet_manager.cc:1428] T cec48b75c57b48d4a7c4099296da4f83 P 6fea9b808d7c46ee8edc09b87c6990ce: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260812 01:05:02.397605 7710 raft_consensus.cc:2229] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:05:02.398841 7710 raft_consensus.cc:2258] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:02.401036 7708 ts_tablet_manager.cc:1918] T b5743befcfb54ba6a0f0acd341714b04 P 29cb95bf04ef4d74bb6cf355272c8214: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:05:02.401052 7710 ts_tablet_manager.cc:1905] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:02.401247 7708 log.cc:1196] T b5743befcfb54ba6a0f0acd341714b04 P 29cb95bf04ef4d74bb6cf355272c8214: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-0/wal/wals/b5743befcfb54ba6a0f0acd341714b04
I20260812 01:05:02.401823 7669 tablet_bootstrap.cc:492] T cec48b75c57b48d4a7c4099296da4f83 P 29cb95bf04ef4d74bb6cf355272c8214: No bootstrap required, opened a new log
I20260812 01:05:02.401847 7708 ts_tablet_manager.cc:1939] T b5743befcfb54ba6a0f0acd341714b04 P 29cb95bf04ef4d74bb6cf355272c8214: Deleting consensus metadata
I20260812 01:05:02.402061 7669 ts_tablet_manager.cc:1397] T cec48b75c57b48d4a7c4099296da4f83 P 29cb95bf04ef4d74bb6cf355272c8214: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.012s
I20260812 01:05:02.402899 7669 raft_consensus.cc:348] T cec48b75c57b48d4a7c4099296da4f83 P 29cb95bf04ef4d74bb6cf355272c8214 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } }
I20260812 01:05:02.403136 7669 raft_consensus.cc:374] T cec48b75c57b48d4a7c4099296da4f83 P 29cb95bf04ef4d74bb6cf355272c8214 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:02.403237 7669 raft_consensus.cc:729] T cec48b75c57b48d4a7c4099296da4f83 P 29cb95bf04ef4d74bb6cf355272c8214 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29cb95bf04ef4d74bb6cf355272c8214, State: Initialized, Role: FOLLOWER
I20260812 01:05:02.403523 7669 consensus_queue.cc:260] T cec48b75c57b48d4a7c4099296da4f83 P 29cb95bf04ef4d74bb6cf355272c8214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } }
I20260812 01:05:02.403709 6773 catalog_manager.cc:4841] TS 29cb95bf04ef4d74bb6cf355272c8214 (127.4.201.65:34419): tablet b5743befcfb54ba6a0f0acd341714b04 (table test-table [id=1cf98980721349178d8925455fe536a4]) successfully deleted
I20260812 01:05:02.404191 7669 ts_tablet_manager.cc:1428] T cec48b75c57b48d4a7c4099296da4f83 P 29cb95bf04ef4d74bb6cf355272c8214: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 01:05:02.408707 7710 ts_tablet_manager.cc:1918] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:05:02.408931 7710 log.cc:1196] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-1/wal/wals/b5743befcfb54ba6a0f0acd341714b04
I20260812 01:05:02.409437 7710 ts_tablet_manager.cc:1939] T b5743befcfb54ba6a0f0acd341714b04 P 9bf85593faaa440fbcc015dfcb6ecadc: Deleting consensus metadata
I20260812 01:05:02.410801 6772 catalog_manager.cc:4841] TS 9bf85593faaa440fbcc015dfcb6ecadc (127.4.201.66:42017): tablet b5743befcfb54ba6a0f0acd341714b04 (table test-table [id=1cf98980721349178d8925455fe536a4]) successfully deleted
I20260812 01:05:02.436100 7678 raft_consensus.cc:482] T cec48b75c57b48d4a7c4099296da4f83 P 9bf85593faaa440fbcc015dfcb6ecadc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:05:02.436308 7678 raft_consensus.cc:504] T cec48b75c57b48d4a7c4099296da4f83 P 9bf85593faaa440fbcc015dfcb6ecadc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } }
I20260812 01:05:02.437029 7678 leader_election.cc:288] T cec48b75c57b48d4a7c4099296da4f83 P 9bf85593faaa440fbcc015dfcb6ecadc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29cb95bf04ef4d74bb6cf355272c8214 (127.4.201.65:34419), 6fea9b808d7c46ee8edc09b87c6990ce (127.4.201.67:39811)
I20260812 01:05:02.437561 7067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cec48b75c57b48d4a7c4099296da4f83" candidate_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29cb95bf04ef4d74bb6cf355272c8214" is_pre_election: true
I20260812 01:05:02.437578 7568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cec48b75c57b48d4a7c4099296da4f83" candidate_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" is_pre_election: true
I20260812 01:05:02.437796 7067 raft_consensus.cc:2454] T cec48b75c57b48d4a7c4099296da4f83 P 29cb95bf04ef4d74bb6cf355272c8214 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bf85593faaa440fbcc015dfcb6ecadc in term 0.
I20260812 01:05:02.437834 7568 raft_consensus.cc:2454] T cec48b75c57b48d4a7c4099296da4f83 P 6fea9b808d7c46ee8edc09b87c6990ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bf85593faaa440fbcc015dfcb6ecadc in term 0.
I20260812 01:05:02.438206 7198 leader_election.cc:302] T cec48b75c57b48d4a7c4099296da4f83 P 9bf85593faaa440fbcc015dfcb6ecadc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29cb95bf04ef4d74bb6cf355272c8214, 9bf85593faaa440fbcc015dfcb6ecadc; no voters:
I20260812 01:05:02.438505 7678 raft_consensus.cc:2781] T cec48b75c57b48d4a7c4099296da4f83 P 9bf85593faaa440fbcc015dfcb6ecadc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:05:02.438652 7678 raft_consensus.cc:482] T cec48b75c57b48d4a7c4099296da4f83 P 9bf85593faaa440fbcc015dfcb6ecadc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:05:02.438753 7678 raft_consensus.cc:3037] T cec48b75c57b48d4a7c4099296da4f83 P 9bf85593faaa440fbcc015dfcb6ecadc [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:02.440881 7678 raft_consensus.cc:504] T cec48b75c57b48d4a7c4099296da4f83 P 9bf85593faaa440fbcc015dfcb6ecadc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } }
I20260812 01:05:02.441432 7678 leader_election.cc:288] T cec48b75c57b48d4a7c4099296da4f83 P 9bf85593faaa440fbcc015dfcb6ecadc [CANDIDATE]: Term 1 election: Requested vote from peers 29cb95bf04ef4d74bb6cf355272c8214 (127.4.201.65:34419), 6fea9b808d7c46ee8edc09b87c6990ce (127.4.201.67:39811)
I20260812 01:05:02.441936 7067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cec48b75c57b48d4a7c4099296da4f83" candidate_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29cb95bf04ef4d74bb6cf355272c8214"
I20260812 01:05:02.441953 7568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cec48b75c57b48d4a7c4099296da4f83" candidate_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fea9b808d7c46ee8edc09b87c6990ce"
I20260812 01:05:02.442112 7067 raft_consensus.cc:3037] T cec48b75c57b48d4a7c4099296da4f83 P 29cb95bf04ef4d74bb6cf355272c8214 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:02.442158 7568 raft_consensus.cc:3037] T cec48b75c57b48d4a7c4099296da4f83 P 6fea9b808d7c46ee8edc09b87c6990ce [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:02.444641 7067 raft_consensus.cc:2454] T cec48b75c57b48d4a7c4099296da4f83 P 29cb95bf04ef4d74bb6cf355272c8214 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf85593faaa440fbcc015dfcb6ecadc in term 1.
I20260812 01:05:02.445055 7198 leader_election.cc:302] T cec48b75c57b48d4a7c4099296da4f83 P 9bf85593faaa440fbcc015dfcb6ecadc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29cb95bf04ef4d74bb6cf355272c8214, 9bf85593faaa440fbcc015dfcb6ecadc; no voters:
I20260812 01:05:02.445152 7568 raft_consensus.cc:2454] T cec48b75c57b48d4a7c4099296da4f83 P 6fea9b808d7c46ee8edc09b87c6990ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf85593faaa440fbcc015dfcb6ecadc in term 1.
I20260812 01:05:02.445360 7678 raft_consensus.cc:2781] T cec48b75c57b48d4a7c4099296da4f83 P 9bf85593faaa440fbcc015dfcb6ecadc [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:05:02.445775 7678 raft_consensus.cc:686] T cec48b75c57b48d4a7c4099296da4f83 P 9bf85593faaa440fbcc015dfcb6ecadc [term 1 LEADER]: Becoming Leader. State: Replica: 9bf85593faaa440fbcc015dfcb6ecadc, State: Running, Role: LEADER
I20260812 01:05:02.446277 7678 consensus_queue.cc:237] T cec48b75c57b48d4a7c4099296da4f83 P 9bf85593faaa440fbcc015dfcb6ecadc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } }
I20260812 01:05:02.451180 6798 catalog_manager.cc:5495] T cec48b75c57b48d4a7c4099296da4f83 P 9bf85593faaa440fbcc015dfcb6ecadc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bf85593faaa440fbcc015dfcb6ecadc (127.4.201.66). New cstate: current_term: 1 leader_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } health_report { overall_health: UNKNOWN } } }
Aug 12 01:05:02 dist-test-slave-bndk krb5kdc[6720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496700, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:02.502907 7724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.487776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:44869 (local address 127.0.0.1:60810)
0812 01:05:02.488483 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:02.488500 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:02.488628 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:02.488987 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:02.488990 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:02.489747 (+ 757us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:02.490027 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:02.490037 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.491436 (+ 1399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.491440 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:02.492399 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:02.492410 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.493393 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.493398 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:02.493541 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.494169 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:02.494186 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:02.496672 (+ 2486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:02.500345 (+ 3673us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:02.500357 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:02.500363 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:02.500772 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:02.501162 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:02.501165 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:02.501168 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:02.501333 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:02.501954 (+ 621us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:02.501960 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:02.502118 (+ 158us) client_negotiation.cc:769] Sending connection context
0812 01:05:02.502254 (+ 136us) client_negotiation.cc:240] Negotiation successful
0812 01:05:02.502445 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":412,"threads_started":1}
I20260812 01:05:02.503106 6962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.487787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60810 (local address 127.4.201.126:44869)
0812 01:05:02.487961 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:02.487967 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:02.488589 (+ 622us) server_negotiation.cc:407] Connection header received
0812 01:05:02.488734 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:02.488748 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:02.488857 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:02.488969 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:02.490180 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.491278 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.492543 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.493201 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.493359 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.496964 (+ 3605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:02.496971 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:02.496976 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:02.497015 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:02.500219 (+ 3204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:02.500912 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:02.500918 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:02.500922 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:02.501069 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:02.501434 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:02.501439 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:02.501443 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:02.501815 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:02.501975 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:02.502384 (+ 409us) server_negotiation.cc:299] Negotiation successful
0812 01:05:02.502616 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 01:05:02.508354 6798 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:60810:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 01:05:02.509549 6798 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:05:02.516752 7033 tablet_service.cc:1467] Processing CreateTablet for tablet 5a503fa695e848e3816a70b968f035db (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e9261b27d2174585bc689f930e6bb753]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 01:05:02.516911 7527 tablet_service.cc:1467] Processing CreateTablet for tablet 5a503fa695e848e3816a70b968f035db (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e9261b27d2174585bc689f930e6bb753]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 01:05:02.517418 7033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a503fa695e848e3816a70b968f035db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:02.517416 7527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a503fa695e848e3816a70b968f035db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:02.524586 7669 tablet_bootstrap.cc:492] T 5a503fa695e848e3816a70b968f035db P 29cb95bf04ef4d74bb6cf355272c8214: Bootstrap starting.
I20260812 01:05:02.524967 7292 tablet_service.cc:1467] Processing CreateTablet for tablet 5a503fa695e848e3816a70b968f035db (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e9261b27d2174585bc689f930e6bb753]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 01:05:02.525444 7292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a503fa695e848e3816a70b968f035db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:02.526540 7669 tablet_bootstrap.cc:654] T 5a503fa695e848e3816a70b968f035db P 29cb95bf04ef4d74bb6cf355272c8214: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:02.527595 7670 tablet_bootstrap.cc:492] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce: Bootstrap starting.
I20260812 01:05:02.529193 7670 tablet_bootstrap.cc:654] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:02.531318 7670 tablet_bootstrap.cc:492] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce: No bootstrap required, opened a new log
I20260812 01:05:02.531489 7670 ts_tablet_manager.cc:1397] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260812 01:05:02.531776 7668 tablet_bootstrap.cc:492] T 5a503fa695e848e3816a70b968f035db P 9bf85593faaa440fbcc015dfcb6ecadc: Bootstrap starting.
I20260812 01:05:02.532558 7670 raft_consensus.cc:348] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } }
I20260812 01:05:02.532909 7670 raft_consensus.cc:374] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:02.533035 7670 raft_consensus.cc:729] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fea9b808d7c46ee8edc09b87c6990ce, State: Initialized, Role: FOLLOWER
I20260812 01:05:02.533439 7670 consensus_queue.cc:260] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } }
I20260812 01:05:02.533717 7668 tablet_bootstrap.cc:654] T 5a503fa695e848e3816a70b968f035db P 9bf85593faaa440fbcc015dfcb6ecadc: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:02.534085 7683 tablet_replica.cc:439] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } } }
I20260812 01:05:02.534422 7683 tablet_replica.cc:442] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:05:02.534960 7669 tablet_bootstrap.cc:492] T 5a503fa695e848e3816a70b968f035db P 29cb95bf04ef4d74bb6cf355272c8214: No bootstrap required, opened a new log
I20260812 01:05:02.535125 7669 ts_tablet_manager.cc:1397] T 5a503fa695e848e3816a70b968f035db P 29cb95bf04ef4d74bb6cf355272c8214: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20260812 01:05:02.535840 7669 raft_consensus.cc:348] T 5a503fa695e848e3816a70b968f035db P 29cb95bf04ef4d74bb6cf355272c8214 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } }
I20260812 01:05:02.536145 7669 raft_consensus.cc:374] T 5a503fa695e848e3816a70b968f035db P 29cb95bf04ef4d74bb6cf355272c8214 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:02.536226 7669 raft_consensus.cc:729] T 5a503fa695e848e3816a70b968f035db P 29cb95bf04ef4d74bb6cf355272c8214 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29cb95bf04ef4d74bb6cf355272c8214, State: Initialized, Role: FOLLOWER
I20260812 01:05:02.536461 7669 consensus_queue.cc:260] T 5a503fa695e848e3816a70b968f035db P 29cb95bf04ef4d74bb6cf355272c8214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } }
I20260812 01:05:02.537109 7669 ts_tablet_manager.cc:1428] T 5a503fa695e848e3816a70b968f035db P 29cb95bf04ef4d74bb6cf355272c8214: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260812 01:05:02.536952 7680 tablet_replica.cc:439] T 5a503fa695e848e3816a70b968f035db P 29cb95bf04ef4d74bb6cf355272c8214: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } } }
I20260812 01:05:02.537343 7680 tablet_replica.cc:442] T 5a503fa695e848e3816a70b968f035db P 29cb95bf04ef4d74bb6cf355272c8214: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:05:02.538318 7683 raft_consensus.cc:482] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:05:02.538463 7683 raft_consensus.cc:504] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } }
I20260812 01:05:02.540104 7683 leader_election.cc:288] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29cb95bf04ef4d74bb6cf355272c8214 (127.4.201.65:34419), 9bf85593faaa440fbcc015dfcb6ecadc (127.4.201.66:42017)
I20260812 01:05:02.544687 7670 ts_tablet_manager.cc:1428] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260812 01:05:02.548262 7668 tablet_bootstrap.cc:492] T 5a503fa695e848e3816a70b968f035db P 9bf85593faaa440fbcc015dfcb6ecadc: No bootstrap required, opened a new log
I20260812 01:05:02.548458 7668 ts_tablet_manager.cc:1397] T 5a503fa695e848e3816a70b968f035db P 9bf85593faaa440fbcc015dfcb6ecadc: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.008s
I20260812 01:05:02.549321 7668 raft_consensus.cc:348] T 5a503fa695e848e3816a70b968f035db P 9bf85593faaa440fbcc015dfcb6ecadc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } }
I20260812 01:05:02.549661 7668 raft_consensus.cc:374] T 5a503fa695e848e3816a70b968f035db P 9bf85593faaa440fbcc015dfcb6ecadc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:02.549764 7668 raft_consensus.cc:729] T 5a503fa695e848e3816a70b968f035db P 9bf85593faaa440fbcc015dfcb6ecadc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf85593faaa440fbcc015dfcb6ecadc, State: Initialized, Role: FOLLOWER
I20260812 01:05:02.550096 7668 consensus_queue.cc:260] T 5a503fa695e848e3816a70b968f035db P 9bf85593faaa440fbcc015dfcb6ecadc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } }
I20260812 01:05:02.550734 7668 ts_tablet_manager.cc:1428] T 5a503fa695e848e3816a70b968f035db P 9bf85593faaa440fbcc015dfcb6ecadc: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 01:05:02.555351 7678 tablet_replica.cc:439] T 5a503fa695e848e3816a70b968f035db P 9bf85593faaa440fbcc015dfcb6ecadc: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } } }
I20260812 01:05:02.555722 7678 tablet_replica.cc:442] T 5a503fa695e848e3816a70b968f035db P 9bf85593faaa440fbcc015dfcb6ecadc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:05:02.562654 7733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.540366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:34419 (local address 127.4.201.67:43877)
0812 01:05:02.555064 (+ 14698us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:02.555087 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:02.555252 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:02.555749 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:02.555753 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:02.555831 (+ 78us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:02.556028 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:02.556041 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.557760 (+ 1719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.557766 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:02.560059 (+ 2293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:02.560076 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.561898 (+ 1822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.561904 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:02.562103 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.562140 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 01:05:02.562229 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 01:05:02.562358 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14580,"thread_start_us":15313,"threads_started":1}
I20260812 01:05:02.562726 7662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.540798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:43877 (local address 127.4.201.65:34419)
0812 01:05:02.540973 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:02.540979 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:02.555188 (+ 14209us) server_negotiation.cc:407] Connection header received
0812 01:05:02.555386 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:02.555392 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:02.555481 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:02.555575 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:02.556217 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.557419 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.560228 (+ 2809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.561587 (+ 1359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.561738 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.561809 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:02.562293 (+ 484us) server_negotiation.cc:299] Negotiation successful
0812 01:05:02.562431 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 01:05:02.563519 7067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a503fa695e848e3816a70b968f035db" candidate_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29cb95bf04ef4d74bb6cf355272c8214" is_pre_election: true
I20260812 01:05:02.563751 7067 raft_consensus.cc:2454] T 5a503fa695e848e3816a70b968f035db P 29cb95bf04ef4d74bb6cf355272c8214 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fea9b808d7c46ee8edc09b87c6990ce in term 0.
I20260812 01:05:02.564260 7438 leader_election.cc:302] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29cb95bf04ef4d74bb6cf355272c8214, 6fea9b808d7c46ee8edc09b87c6990ce; no voters:
I20260812 01:05:02.564707 7683 raft_consensus.cc:2781] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:05:02.564848 7683 raft_consensus.cc:482] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:05:02.564954 7683 raft_consensus.cc:3037] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:02.567938 7683 raft_consensus.cc:504] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } }
I20260812 01:05:02.568791 7683 leader_election.cc:288] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce [CANDIDATE]: Term 1 election: Requested vote from peers 29cb95bf04ef4d74bb6cf355272c8214 (127.4.201.65:34419), 9bf85593faaa440fbcc015dfcb6ecadc (127.4.201.66:42017)
I20260812 01:05:02.569679 7067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a503fa695e848e3816a70b968f035db" candidate_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29cb95bf04ef4d74bb6cf355272c8214"
I20260812 01:05:02.569875 7067 raft_consensus.cc:3037] T 5a503fa695e848e3816a70b968f035db P 29cb95bf04ef4d74bb6cf355272c8214 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:02.572069 7067 raft_consensus.cc:2454] T 5a503fa695e848e3816a70b968f035db P 29cb95bf04ef4d74bb6cf355272c8214 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fea9b808d7c46ee8edc09b87c6990ce in term 1.
I20260812 01:05:02.572506 7438 leader_election.cc:302] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29cb95bf04ef4d74bb6cf355272c8214, 6fea9b808d7c46ee8edc09b87c6990ce; no voters:
I20260812 01:05:02.572772 7683 raft_consensus.cc:2781] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:05:02.574304 7667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.540799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:58847 (local address 127.4.201.66:42017)
0812 01:05:02.540981 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:02.540987 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:02.560440 (+ 19453us) server_negotiation.cc:407] Connection header received
0812 01:05:02.560673 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:02.560682 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:02.560778 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:02.560874 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:02.563132 (+ 2258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.564266 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.571528 (+ 7262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.572835 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.572986 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.573058 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:02.573783 (+ 725us) server_negotiation.cc:299] Negotiation successful
0812 01:05:02.573940 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 01:05:02.575172 7731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.540470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:42017 (local address 127.4.201.67:58847)
0812 01:05:02.560338 (+ 19868us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:02.560356 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:02.560526 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:02.561348 (+ 822us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:02.561352 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:02.561380 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:02.561680 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:02.561692 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.569447 (+ 7755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.569452 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:02.571345 (+ 1893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:02.571362 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.573333 (+ 1971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.573340 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:02.573574 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.573612 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 01:05:02.574675 (+ 1063us) client_negotiation.cc:240] Negotiation successful
0812 01:05:02.574840 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19754,"thread_start_us":14869,"threads_started":1}
I20260812 01:05:02.576370 7325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a503fa695e848e3816a70b968f035db" candidate_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf85593faaa440fbcc015dfcb6ecadc"
I20260812 01:05:02.576432 7327 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a503fa695e848e3816a70b968f035db" candidate_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" is_pre_election: true
I20260812 01:05:02.576786 7325 raft_consensus.cc:3037] T 5a503fa695e848e3816a70b968f035db P 9bf85593faaa440fbcc015dfcb6ecadc [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:02.578294 7683 raft_consensus.cc:686] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce [term 1 LEADER]: Becoming Leader. State: Replica: 6fea9b808d7c46ee8edc09b87c6990ce, State: Running, Role: LEADER
I20260812 01:05:02.578703 7683 consensus_queue.cc:237] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } }
I20260812 01:05:02.584149 7325 raft_consensus.cc:2454] T 5a503fa695e848e3816a70b968f035db P 9bf85593faaa440fbcc015dfcb6ecadc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fea9b808d7c46ee8edc09b87c6990ce in term 1.
I20260812 01:05:02.586766 7735 tablet_replica.cc:439] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce: TxnStatusTablet state changed. Reason: New leader 6fea9b808d7c46ee8edc09b87c6990ce. Latest consensus state: current_term: 1 leader_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } } }
I20260812 01:05:02.587073 7735 tablet_replica.cc:442] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce: This TxnStatusTablet replica's current role is: LEADER
I20260812 01:05:02.587759 6798 catalog_manager.cc:5495] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fea9b808d7c46ee8edc09b87c6990ce (127.4.201.67). New cstate: current_term: 1 leader_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } health_report { overall_health: HEALTHY } } }
I20260812 01:05:02.589717 7738 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 01:05:02.590031 7738 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 01:05:02.612286 7663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.604866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44862 (local address 127.4.201.67:39811)
0812 01:05:02.605047 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:02.605053 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:02.605347 (+ 294us) server_negotiation.cc:407] Connection header received
0812 01:05:02.605597 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:02.605606 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:02.605729 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:02.605877 (+ 148us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:05:02.606369 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.607601 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.609614 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.610265 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.610413 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.610961 (+ 548us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:05:02.611625 (+ 664us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:05:02.611774 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:02.611894 (+ 120us) server_negotiation.cc:299] Negotiation successful
0812 01:05:02.611978 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 01:05:02.612330 7724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.604868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:39811 (local address 127.0.0.1:44862)
0812 01:05:02.605254 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:02.605272 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:02.605405 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:02.605905 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:02.605910 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:02.605923 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 01:05:02.606167 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:02.606179 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.607728 (+ 1549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.607734 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:02.609468 (+ 1734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:02.609485 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.610448 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.610455 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:02.610686 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.610757 (+ 71us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 01:05:02.611744 (+ 987us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 01:05:02.611768 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 01:05:02.611864 (+ 96us) client_negotiation.cc:240] Negotiation successful
0812 01:05:02.612030 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200}
I20260812 01:05:02.617159 7067 raft_consensus.cc:1261] T 5a503fa695e848e3816a70b968f035db P 29cb95bf04ef4d74bb6cf355272c8214 [term 1 FOLLOWER]: Refusing update from remote peer 6fea9b808d7c46ee8edc09b87c6990ce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:02.617295 7325 raft_consensus.cc:1261] T 5a503fa695e848e3816a70b968f035db P 9bf85593faaa440fbcc015dfcb6ecadc [term 1 FOLLOWER]: Refusing update from remote peer 6fea9b808d7c46ee8edc09b87c6990ce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:02.617937 7735 consensus_queue.cc:1035] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:02.618633 7683 consensus_queue.cc:1035] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:02.630911 7678 tablet_replica.cc:439] T 5a503fa695e848e3816a70b968f035db P 9bf85593faaa440fbcc015dfcb6ecadc: TxnStatusTablet state changed. Reason: New leader 6fea9b808d7c46ee8edc09b87c6990ce. Latest consensus state: current_term: 1 leader_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } } }
I20260812 01:05:02.631245 7678 tablet_replica.cc:442] T 5a503fa695e848e3816a70b968f035db P 9bf85593faaa440fbcc015dfcb6ecadc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:05:02.635458 7683 tablet_replica.cc:439] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } } }
I20260812 01:05:02.635739 7683 tablet_replica.cc:442] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce: This TxnStatusTablet replica's current role is: LEADER
I20260812 01:05:02.638898 7694 mvcc.cc:205] Tried to move back new op lower bound from 7317490493912682496 to 7317490493766549504. Current Snapshot: MvccSnapshot[applied={T|T < 7317490493912682496 or (T in {7317490493912682496})}]
I20260812 01:05:02.639236 7696 mvcc.cc:205] Tried to move back new op lower bound from 7317490493912682496 to 7317490493766549504. Current Snapshot: MvccSnapshot[applied={T|T < 7317490493912682496 or (T in {7317490493912682496})}]
I20260812 01:05:02.639586 7678 tablet_replica.cc:439] T 5a503fa695e848e3816a70b968f035db P 9bf85593faaa440fbcc015dfcb6ecadc: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } } }
I20260812 01:05:02.639837 7678 tablet_replica.cc:442] T 5a503fa695e848e3816a70b968f035db P 9bf85593faaa440fbcc015dfcb6ecadc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:05:02.643699 7680 tablet_replica.cc:439] T 5a503fa695e848e3816a70b968f035db P 29cb95bf04ef4d74bb6cf355272c8214: TxnStatusTablet state changed. Reason: New leader 6fea9b808d7c46ee8edc09b87c6990ce. Latest consensus state: current_term: 1 leader_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } } }
I20260812 01:05:02.644013 7680 tablet_replica.cc:442] T 5a503fa695e848e3816a70b968f035db P 29cb95bf04ef4d74bb6cf355272c8214: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:05:02.647565 7735 tablet_replica.cc:439] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } } }
I20260812 01:05:02.647831 7735 tablet_replica.cc:442] T 5a503fa695e848e3816a70b968f035db P 6fea9b808d7c46ee8edc09b87c6990ce: This TxnStatusTablet replica's current role is: LEADER
I20260812 01:05:02.651908 7680 tablet_replica.cc:439] T 5a503fa695e848e3816a70b968f035db P 29cb95bf04ef4d74bb6cf355272c8214: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 } } peers { permanent_uuid: "9bf85593faaa440fbcc015dfcb6ecadc" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42017 } } peers { permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 } } }
I20260812 01:05:02.652151 7680 tablet_replica.cc:442] T 5a503fa695e848e3816a70b968f035db P 29cb95bf04ef4d74bb6cf355272c8214: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:05:02.673007 7663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.665040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:42677 (local address 127.4.201.67:39811)
0812 01:05:02.665258 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:02.665265 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:02.666179 (+ 914us) server_negotiation.cc:407] Connection header received
0812 01:05:02.666447 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:02.666457 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:02.666574 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:02.666700 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:05:02.667293 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.668402 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.670763 (+ 2361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.671491 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.671635 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.672226 (+ 591us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:05:02.672389 (+ 163us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:05:02.672495 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:02.672635 (+ 140us) server_negotiation.cc:299] Negotiation successful
0812 01:05:02.672719 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 01:05:02.673297 7746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.665130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:39811 (local address 127.4.201.66:42677)
0812 01:05:02.665993 (+ 863us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:02.666013 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:02.666243 (+ 230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:02.666717 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:02.666722 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:02.666736 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 01:05:02.667107 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:02.667120 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.668617 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.668626 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:02.670594 (+ 1968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:02.670615 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.671699 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.671706 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:02.671929 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.672002 (+ 73us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 01:05:02.672502 (+ 500us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 01:05:02.672517 (+ 15us) client_negotiation.cc:769] Sending connection context
0812 01:05:02.672598 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 01:05:02.672750 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":666,"thread_start_us":504,"threads_started":1}
I20260812 01:05:02.688338 7568 raft_consensus.cc:1261] T cec48b75c57b48d4a7c4099296da4f83 P 6fea9b808d7c46ee8edc09b87c6990ce [term 1 FOLLOWER]: Refusing update from remote peer 9bf85593faaa440fbcc015dfcb6ecadc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:02.688383 7067 raft_consensus.cc:1261] T cec48b75c57b48d4a7c4099296da4f83 P 29cb95bf04ef4d74bb6cf355272c8214 [term 1 FOLLOWER]: Refusing update from remote peer 9bf85593faaa440fbcc015dfcb6ecadc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:02.689061 7701 consensus_queue.cc:1035] T cec48b75c57b48d4a7c4099296da4f83 P 9bf85593faaa440fbcc015dfcb6ecadc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fea9b808d7c46ee8edc09b87c6990ce" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:02.689772 7678 consensus_queue.cc:1035] T cec48b75c57b48d4a7c4099296da4f83 P 9bf85593faaa440fbcc015dfcb6ecadc [LEADER]: Connected to new peer: Peer: permanent_uuid: "29cb95bf04ef4d74bb6cf355272c8214" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:02.748997 7667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.740237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:50641 (local address 127.4.201.66:42017)
0812 01:05:02.740426 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:02.740432 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:02.741989 (+ 1557us) server_negotiation.cc:407] Connection header received
0812 01:05:02.742192 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:02.742198 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:02.742283 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:02.742395 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:05:02.743281 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.744495 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.746699 (+ 2204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.747345 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.747496 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.748180 (+ 684us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:05:02.748314 (+ 134us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:05:02.748376 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:02.748619 (+ 243us) server_negotiation.cc:299] Negotiation successful
0812 01:05:02.748708 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 01:05:02.749994 7753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.739786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:42017 (local address 127.4.201.67:50641)
0812 01:05:02.741856 (+ 2070us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:02.741876 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:02.742044 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:02.742661 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:02.742666 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:02.742680 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 01:05:02.743065 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:02.743078 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.744709 (+ 1631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.744715 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:02.746541 (+ 1826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:02.746558 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.747686 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.747694 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:02.747880 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.747970 (+ 90us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 01:05:02.748470 (+ 500us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 01:05:02.748484 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 01:05:02.749423 (+ 939us) client_negotiation.cc:240] Negotiation successful
0812 01:05:02.749576 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1842,"thread_start_us":1703,"threads_started":1}
I20260812 01:05:02.798735 6798 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60798:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:05:02.799029 6798 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60798:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:05:02.802561 6798 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f5104aab16eb43fab71cfc6d3e35236b: Sending DeleteTablet for 3 replicas of tablet cec48b75c57b48d4a7c4099296da4f83
I20260812 01:05:02.803320 7033 tablet_service.cc:1514] Processing DeleteTablet for tablet cec48b75c57b48d4a7c4099296da4f83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:02 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:44562
I20260812 01:05:02.803632 7708 tablet_replica.cc:330] T cec48b75c57b48d4a7c4099296da4f83 P 29cb95bf04ef4d74bb6cf355272c8214: stopping tablet replica
I20260812 01:05:02.803670 7292 tablet_service.cc:1514] Processing DeleteTablet for tablet cec48b75c57b48d4a7c4099296da4f83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:02 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:53642
I20260812 01:05:02.803849 7708 raft_consensus.cc:2229] T cec48b75c57b48d4a7c4099296da4f83 P 29cb95bf04ef4d74bb6cf355272c8214 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:05:02.803929 7710 tablet_replica.cc:330] T cec48b75c57b48d4a7c4099296da4f83 P 9bf85593faaa440fbcc015dfcb6ecadc: stopping tablet replica
I20260812 01:05:02.804051 7708 raft_consensus.cc:2258] T cec48b75c57b48d4a7c4099296da4f83 P 29cb95bf04ef4d74bb6cf355272c8214 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:02.804093 7710 raft_consensus.cc:2229] T cec48b75c57b48d4a7c4099296da4f83 P 9bf85593faaa440fbcc015dfcb6ecadc [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:05:02.804448 7710 raft_consensus.cc:2258] T cec48b75c57b48d4a7c4099296da4f83 P 9bf85593faaa440fbcc015dfcb6ecadc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:02.805671 7708 ts_tablet_manager.cc:1905] T cec48b75c57b48d4a7c4099296da4f83 P 29cb95bf04ef4d74bb6cf355272c8214: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:02.805820 7710 ts_tablet_manager.cc:1905] T cec48b75c57b48d4a7c4099296da4f83 P 9bf85593faaa440fbcc015dfcb6ecadc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:02.807849 7527 tablet_service.cc:1514] Processing DeleteTablet for tablet cec48b75c57b48d4a7c4099296da4f83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:02 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:44858
I20260812 01:05:02.808144 7709 tablet_replica.cc:330] T cec48b75c57b48d4a7c4099296da4f83 P 6fea9b808d7c46ee8edc09b87c6990ce: stopping tablet replica
I20260812 01:05:02.808346 7709 raft_consensus.cc:2229] T cec48b75c57b48d4a7c4099296da4f83 P 6fea9b808d7c46ee8edc09b87c6990ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:05:02.808555 7709 raft_consensus.cc:2258] T cec48b75c57b48d4a7c4099296da4f83 P 6fea9b808d7c46ee8edc09b87c6990ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:02.809779 7709 ts_tablet_manager.cc:1905] T cec48b75c57b48d4a7c4099296da4f83 P 6fea9b808d7c46ee8edc09b87c6990ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:02.814085 7710 ts_tablet_manager.cc:1918] T cec48b75c57b48d4a7c4099296da4f83 P 9bf85593faaa440fbcc015dfcb6ecadc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 01:05:02.814321 7710 log.cc:1196] T cec48b75c57b48d4a7c4099296da4f83 P 9bf85593faaa440fbcc015dfcb6ecadc: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-1/wal/wals/cec48b75c57b48d4a7c4099296da4f83
I20260812 01:05:02.814819 7710 ts_tablet_manager.cc:1939] T cec48b75c57b48d4a7c4099296da4f83 P 9bf85593faaa440fbcc015dfcb6ecadc: Deleting consensus metadata
I20260812 01:05:02.815955 6772 catalog_manager.cc:4841] TS 9bf85593faaa440fbcc015dfcb6ecadc (127.4.201.66:42017): tablet cec48b75c57b48d4a7c4099296da4f83 (table test-table [id=c21109f803c9437fb094a5c2f1ec71dd]) successfully deleted
I20260812 01:05:02.820004 7708 ts_tablet_manager.cc:1918] T cec48b75c57b48d4a7c4099296da4f83 P 29cb95bf04ef4d74bb6cf355272c8214: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 01:05:02.820169 7708 log.cc:1196] T cec48b75c57b48d4a7c4099296da4f83 P 29cb95bf04ef4d74bb6cf355272c8214: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-0/wal/wals/cec48b75c57b48d4a7c4099296da4f83
I20260812 01:05:02.820606 7708 ts_tablet_manager.cc:1939] T cec48b75c57b48d4a7c4099296da4f83 P 29cb95bf04ef4d74bb6cf355272c8214: Deleting consensus metadata
I20260812 01:05:02.821730 6773 catalog_manager.cc:4841] TS 29cb95bf04ef4d74bb6cf355272c8214 (127.4.201.65:34419): tablet cec48b75c57b48d4a7c4099296da4f83 (table test-table [id=c21109f803c9437fb094a5c2f1ec71dd]) successfully deleted
I20260812 01:05:02.823482 7709 ts_tablet_manager.cc:1918] T cec48b75c57b48d4a7c4099296da4f83 P 6fea9b808d7c46ee8edc09b87c6990ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 01:05:02.825026 7709 log.cc:1196] T cec48b75c57b48d4a7c4099296da4f83 P 6fea9b808d7c46ee8edc09b87c6990ce: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786496689953932-4901-0/minicluster-data/ts-2/wal/wals/cec48b75c57b48d4a7c4099296da4f83
I20260812 01:05:02.825683 7709 ts_tablet_manager.cc:1939] T cec48b75c57b48d4a7c4099296da4f83 P 6fea9b808d7c46ee8edc09b87c6990ce: Deleting consensus metadata
I20260812 01:05:02.827446 6772 catalog_manager.cc:4841] TS 6fea9b808d7c46ee8edc09b87c6990ce (127.4.201.67:39811): tablet cec48b75c57b48d4a7c4099296da4f83 (table test-table [id=c21109f803c9437fb094a5c2f1ec71dd]) successfully deleted
Aug 12 01:05:02 dist-test-slave-bndk krb5kdc[6720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496702, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.4.201.65@KRBTEST.COM
I20260812 01:05:02.850277 7662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.826770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44572 (local address 127.4.201.65:34419)
0812 01:05:02.826962 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:02.826969 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:02.832103 (+ 5134us) server_negotiation.cc:407] Connection header received
0812 01:05:02.832278 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:02.832284 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:02.832380 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:02.832494 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:02.834432 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.835553 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.837371 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.838013 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.838143 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.843139 (+ 4996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:02.843157 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:02.843177 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:02.843217 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:02.846973 (+ 3756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:02.847804 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:02.847814 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:02.847818 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:02.848022 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:02.848463 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:02.848469 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:02.848473 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:02.848920 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:02.849249 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:02.849587 (+ 338us) server_negotiation.cc:299] Negotiation successful
0812 01:05:02.849891 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260812 01:05:02.851022 7148 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44572
I20260812 01:05:02.870711 6962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.854189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60826 (local address 127.4.201.126:44869)
0812 01:05:02.854428 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:02.854434 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:02.855121 (+ 687us) server_negotiation.cc:407] Connection header received
0812 01:05:02.855389 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:02.855395 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:02.855478 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:02.855549 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:02.857365 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.858470 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.860378 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.861064 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.861165 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.864302 (+ 3137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:02.864308 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:02.864313 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:02.864354 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:02.867695 (+ 3341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:02.868548 (+ 853us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:02.868554 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:02.868557 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:02.868729 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:02.869152 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:02.869157 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:02.869160 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:02.869549 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:02.869790 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:02.870118 (+ 328us) server_negotiation.cc:299] Negotiation successful
0812 01:05:02.870351 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260812 01:05:02.871356 6798 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60826
I20260812 01:05:02.873240 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 6919
I20260812 01:05:02.893244 7662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.874684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44586 (local address 127.4.201.65:34419)
0812 01:05:02.875398 (+ 714us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:02.875404 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:02.877752 (+ 2348us) server_negotiation.cc:407] Connection header received
0812 01:05:02.877928 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:02.877934 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:02.878013 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:02.878112 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:02.879637 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.880748 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.882549 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.883217 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.883343 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.886306 (+ 2963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:02.886314 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:02.886319 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:02.886382 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:02.890015 (+ 3633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:02.890891 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:02.890897 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:02.890901 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:02.891089 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:02.891497 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:02.891502 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:02.891506 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:02.891864 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:02.892163 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:02.892419 (+ 256us) server_negotiation.cc:299] Negotiation successful
0812 01:05:02.892657 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":565}
W20260812 01:05:02.893858 7148 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44586
W20260812 01:05:02.894495 4901 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 6919: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 01:05:02.894651 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 6919
I20260812 01:05:02.930960 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 7166
Aug 12 01:05:02 dist-test-slave-bndk krb5kdc[6720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496702, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.4.201.66@KRBTEST.COM
I20260812 01:05:02.947563 7667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.931749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53668 (local address 127.4.201.66:42017)
0812 01:05:02.931988 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:02.931995 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:02.932089 (+ 94us) server_negotiation.cc:407] Connection header received
0812 01:05:02.932275 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:02.932282 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:02.932374 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:02.932500 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:02.933928 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.935052 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.936227 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.936848 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.936981 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.940866 (+ 3885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:02.940887 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:02.940908 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:02.940952 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:02.944675 (+ 3723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:02.945418 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:02.945430 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:02.945433 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:02.945603 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:02.945962 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:02.945967 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:02.945971 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:02.946413 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:02.946764 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:02.946958 (+ 194us) server_negotiation.cc:299] Negotiation successful
0812 01:05:02.947205 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
W20260812 01:05:02.948320 7396 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53668
W20260812 01:05:02.948916 4901 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 7166: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 01:05:02.949098 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 7166
I20260812 01:05:02.978749 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 7409
Aug 12 01:05:02 dist-test-slave-bndk krb5kdc[6720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496702, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.4.201.67@KRBTEST.COM
I20260812 01:05:02.999495 7663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:02.980030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44878 (local address 127.4.201.67:39811)
0812 01:05:02.980428 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:02.980435 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:02.980456 (+ 21us) server_negotiation.cc:407] Connection header received
0812 01:05:02.980524 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:02.980551 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:02.980742 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:02.980867 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:02.983095 (+ 2228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.984348 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.985776 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:02.986311 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:02.986425 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:02.993521 (+ 7096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:02.993534 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:02.993552 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:02.993606 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:02.996588 (+ 2982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:02.997299 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:02.997308 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:02.997310 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:02.997474 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:02.997920 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:02.997924 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:02.997927 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:02.998321 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:02.998658 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:02.998897 (+ 239us) server_negotiation.cc:299] Negotiation successful
0812 01:05:02.999147 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217}
W20260812 01:05:03.000252 7622 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44878
W20260812 01:05:03.000974 4901 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 7409: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 01:05:03.001116 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 7409
I20260812 01:05:03.031957 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 6744
I20260812 01:05:03.033072 6869 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:03.148605 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 6744
2026-08-12T01:05:03Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (4501 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:05:03 dist-test-slave-bndk krb5kdc[7767](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:05:03 dist-test-slave-bndk krb5kdc[7767](info): set up 2 sockets
Aug 12 01:05:03 dist-test-slave-bndk krb5kdc[7767](info): commencing operation
krb5kdc: starting...
W20260812 01:05:04.357434 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.159s user 0.004s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:05:04 dist-test-slave-bndk krb5kdc[7767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:05:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:05:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.201.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
I20260812 01:05:04.548388 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:45137
--webserver_interface=127.4.201.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:39061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:45137
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:04.867183 7788 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:04.867466 7788 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:04.867612 7788 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:04.874583 7788 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:05:04.874689 7788 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 01:05:04.874764 7788 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:04.874850 7788 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:04.874912 7788 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:05:04.874994 7788 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:05:04.884347 7788 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:39061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:45137
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:45137
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:04.885583 7788 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:04.886861 7788 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:04.898018 7801 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:04.898058 7802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:04.897953 7810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:04.899013 7788 server_base.cc:1034] running on GCE node
I20260812 01:05:04.899739 7788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:04.901044 7788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:04.902266 7788 hybrid_clock.cc:648] HybridClock initialized: now 1786496704902195 us; error 39 us; skew 500 ppm
I20260812 01:05:04.902591 7788 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:04 dist-test-slave-bndk krb5kdc[7767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496704, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:04.905535 7788 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:05:04.906956 7788 webserver.cc:460] Webserver started at http://127.4.201.126:39179/ using document root <none> and password file <none>
I20260812 01:05:04.907604 7788 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:04.907692 7788 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:04.907954 7788 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:04.910802 7788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "9dcab807a8054690bc118e2aadcda3b2"
format_stamp: "Formatted at 2026-08-12 01:05:04 on dist-test-slave-bndk"
server_key: "86863bbc6d4fc8a0ff18b969d2d0f396"
server_key_iv: "f90aabdd3d4501eb8ef965d03df55539"
server_key_version: "encryptionkey@0"
I20260812 01:05:04.911513 7788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "9dcab807a8054690bc118e2aadcda3b2"
format_stamp: "Formatted at 2026-08-12 01:05:04 on dist-test-slave-bndk"
server_key: "86863bbc6d4fc8a0ff18b969d2d0f396"
server_key_iv: "f90aabdd3d4501eb8ef965d03df55539"
server_key_version: "encryptionkey@0"
I20260812 01:05:04.916322 7788 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 01:05:04.919556 7821 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:04.920768 7788 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 01:05:04.920917 7788 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "9dcab807a8054690bc118e2aadcda3b2"
format_stamp: "Formatted at 2026-08-12 01:05:04 on dist-test-slave-bndk"
server_key: "86863bbc6d4fc8a0ff18b969d2d0f396"
server_key_iv: "f90aabdd3d4501eb8ef965d03df55539"
server_key_version: "encryptionkey@0"
I20260812 01:05:04.921116 7788 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:04.933194 7788 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:04.936754 7788 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:04.936985 7788 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:04.956811 7788 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:45137
I20260812 01:05:04.956835 7921 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:45137 every 8 connection(s)
I20260812 01:05:04.958102 7788 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:05:04.961804 7924 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:04.963778 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 7788
I20260812 01:05:04.963953 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:05:04.964598 4901 external_mini_cluster.cc:1428] Setting key acac11964765e28ad5329343f8fad9bc
I20260812 01:05:04.973266 7924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9dcab807a8054690bc118e2aadcda3b2: Bootstrap starting.
I20260812 01:05:04.976966 7924 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9dcab807a8054690bc118e2aadcda3b2: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:04.978282 7924 log.cc:824] T 00000000000000000000000000000000 P 9dcab807a8054690bc118e2aadcda3b2: Log is configured to *not* fsync() on all Append() calls
Aug 12 01:05:04 dist-test-slave-bndk krb5kdc[7767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:04.981156 7924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9dcab807a8054690bc118e2aadcda3b2: No bootstrap required, opened a new log
I20260812 01:05:04.987039 7928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:04.966529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51992 (local address 127.4.201.126:45137)
0812 01:05:04.967344 (+ 815us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:04.967355 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:04.967397 (+ 42us) server_negotiation.cc:407] Connection header received
0812 01:05:04.969090 (+ 1693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:04.969113 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:04.969535 (+ 422us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:04.969860 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:04.971653 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:04.972917 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:04.974609 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:04.975289 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:04.975425 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:04.980038 (+ 4613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:04.980046 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:04.980061 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:04.980099 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:04.983045 (+ 2946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:04.983832 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:04.983838 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:04.983848 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:04.984012 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:04.984385 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:04.984388 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:04.984390 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:04.984921 (+ 531us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:04.985135 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:04.985660 (+ 525us) server_negotiation.cc:299] Negotiation successful
0812 01:05:04.986015 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":608,"thread_start_us":379,"threads_started":1}
I20260812 01:05:04.989511 7924 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9dcab807a8054690bc118e2aadcda3b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dcab807a8054690bc118e2aadcda3b2" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45137 } }
I20260812 01:05:04.989854 7924 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9dcab807a8054690bc118e2aadcda3b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:04.989944 7924 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9dcab807a8054690bc118e2aadcda3b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dcab807a8054690bc118e2aadcda3b2, State: Initialized, Role: FOLLOWER
I20260812 01:05:04.990449 7924 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9dcab807a8054690bc118e2aadcda3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dcab807a8054690bc118e2aadcda3b2" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45137 } }
I20260812 01:05:04.990682 7924 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9dcab807a8054690bc118e2aadcda3b2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:05:04.990803 7924 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9dcab807a8054690bc118e2aadcda3b2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:05:04.990948 7924 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9dcab807a8054690bc118e2aadcda3b2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:04.993041 7924 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9dcab807a8054690bc118e2aadcda3b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dcab807a8054690bc118e2aadcda3b2" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45137 } }
I20260812 01:05:04.993531 7924 leader_election.cc:302] T 00000000000000000000000000000000 P 9dcab807a8054690bc118e2aadcda3b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9dcab807a8054690bc118e2aadcda3b2; no voters:
I20260812 01:05:04.994050 7924 leader_election.cc:288] T 00000000000000000000000000000000 P 9dcab807a8054690bc118e2aadcda3b2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:05:04.994180 7932 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9dcab807a8054690bc118e2aadcda3b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:05:04.994817 7932 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9dcab807a8054690bc118e2aadcda3b2 [term 1 LEADER]: Becoming Leader. State: Replica: 9dcab807a8054690bc118e2aadcda3b2, State: Running, Role: LEADER
I20260812 01:05:04.995374 7932 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9dcab807a8054690bc118e2aadcda3b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dcab807a8054690bc118e2aadcda3b2" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45137 } }
I20260812 01:05:04.995904 7924 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9dcab807a8054690bc118e2aadcda3b2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:05:04.998570 7934 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9dcab807a8054690bc118e2aadcda3b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9dcab807a8054690bc118e2aadcda3b2. Latest consensus state: current_term: 1 leader_uuid: "9dcab807a8054690bc118e2aadcda3b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dcab807a8054690bc118e2aadcda3b2" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45137 } } }
I20260812 01:05:04.998986 7934 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9dcab807a8054690bc118e2aadcda3b2 [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:04.999727 7933 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9dcab807a8054690bc118e2aadcda3b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9dcab807a8054690bc118e2aadcda3b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dcab807a8054690bc118e2aadcda3b2" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45137 } } }
I20260812 01:05:04.999951 7933 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9dcab807a8054690bc118e2aadcda3b2 [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:05.002086 7946 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:05:05.006527 7946 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:05:05.014254 7946 catalog_manager.cc:1347] Generated new cluster ID: 42b9ac3af6a7444eb63645870820e6a5
I20260812 01:05:05.014370 7946 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:05:05.022589 7946 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:05:05.024801 7946 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:05:05.034132 7946 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9dcab807a8054690bc118e2aadcda3b2: Generated new TSK 0
I20260812 01:05:05.035996 7946 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.201.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
I20260812 01:05:05.110289 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:0
--local_ip_for_outbound_sockets=127.4.201.65
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:45137
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:39061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:05.536862 7967 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:05.537122 7967 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:05.537256 7967 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:05.544306 7967 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:05.544400 7967 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:05.544490 7967 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 01:05:05.544539 7967 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 01:05:05.544605 7967 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:05:05.554056 7967 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:39061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.201.126:45137
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:05.555274 7967 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:05.556512 7967 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:05.568878 7976 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:05.568993 7977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:05.568988 7982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:05.570207 7967 server_base.cc:1034] running on GCE node
I20260812 01:05:05.570744 7967 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:05.571580 7967 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:05.572772 7967 hybrid_clock.cc:648] HybridClock initialized: now 1786496705572714 us; error 53 us; skew 500 ppm
I20260812 01:05:05.573064 7967 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:05 dist-test-slave-bndk krb5kdc[7767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496705, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:05.576053 7967 init.cc:377] Logged in from keytab as kudu/127.4.201.65@KRBTEST.COM (short username kudu)
I20260812 01:05:05.577471 7967 webserver.cc:460] Webserver started at http://127.4.201.65:42321/ using document root <none> and password file <none>
I20260812 01:05:05.578118 7967 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:05.578234 7967 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:05.578524 7967 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:05.581404 7967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-0/data/instance:
uuid: "55ce6b086ff646b4b1f7379551e0be58"
format_stamp: "Formatted at 2026-08-12 01:05:05 on dist-test-slave-bndk"
server_key: "12805e45ef8d48120bf6aef9d2e43d8f"
server_key_iv: "c0c092a0a91ca2652aa9b9bc0aeb0902"
server_key_version: "encryptionkey@0"
I20260812 01:05:05.582145 7967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance:
uuid: "55ce6b086ff646b4b1f7379551e0be58"
format_stamp: "Formatted at 2026-08-12 01:05:05 on dist-test-slave-bndk"
server_key: "12805e45ef8d48120bf6aef9d2e43d8f"
server_key_iv: "c0c092a0a91ca2652aa9b9bc0aeb0902"
server_key_version: "encryptionkey@0"
I20260812 01:05:05.587505 7967 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 01:05:05.590866 7995 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:05.592509 7967 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260812 01:05:05.592680 7967 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "55ce6b086ff646b4b1f7379551e0be58"
format_stamp: "Formatted at 2026-08-12 01:05:05 on dist-test-slave-bndk"
server_key: "12805e45ef8d48120bf6aef9d2e43d8f"
server_key_iv: "c0c092a0a91ca2652aa9b9bc0aeb0902"
server_key_version: "encryptionkey@0"
I20260812 01:05:05.592868 7967 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:05.611701 7967 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:05.615327 7967 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:05.615585 7967 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:05.618466 7967 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:05.618577 7967 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:05.618698 7967 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:05.618788 7967 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 01:05:05 dist-test-slave-bndk krb5kdc[7767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496705, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:05.641113 8010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:05.618574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:46623 (local address 127.4.201.126:45137)
0812 01:05:05.619198 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:05.619205 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:05.620238 (+ 1033us) server_negotiation.cc:407] Connection header received
0812 01:05:05.623015 (+ 2777us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:05.623020 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:05.623090 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:05.623183 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:05.625550 (+ 2367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:05.626478 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:05.629450 (+ 2972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:05.629926 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:05.630070 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:05.634923 (+ 4853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:05.634930 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:05.634935 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:05.634989 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:05.638056 (+ 3067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:05.638922 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:05.638926 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:05.638928 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:05.639053 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:05.639497 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:05.639500 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:05.639502 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:05.639764 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:05.639874 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:05.640670 (+ 796us) server_negotiation.cc:299] Negotiation successful
0812 01:05:05.640834 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":474,"thread_start_us":353,"threads_started":1}
I20260812 01:05:05.642798 8012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:05.619093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45137 (local address 127.4.201.65:46623)
0812 01:05:05.620034 (+ 941us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:05.620091 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:05.622682 (+ 2591us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:05.623471 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:05.623482 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:05.624333 (+ 851us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:05.625323 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:05.625355 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:05.626684 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:05.626694 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:05.629258 (+ 2564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:05.629296 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:05.630283 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:05.630291 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:05.630627 (+ 336us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:05.631404 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:05.631439 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:05.634667 (+ 3228us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:05.638189 (+ 3522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:05.638199 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:05.638216 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:05.638809 (+ 593us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:05.639140 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:05.639145 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:05.639150 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:05.639404 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:05.639873 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:05.639881 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:05.640317 (+ 436us) client_negotiation.cc:769] Sending connection context
0812 01:05:05.640607 (+ 290us) client_negotiation.cc:240] Negotiation successful
0812 01:05:05.641138 (+ 531us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"thread_start_us":344,"threads_started":1}
I20260812 01:05:05.661167 8010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:05.648963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:39717 (local address 127.4.201.126:45137)
0812 01:05:05.649150 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:05.649155 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:05.649802 (+ 647us) server_negotiation.cc:407] Connection header received
0812 01:05:05.649999 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:05.650005 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:05.650067 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:05.650143 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:05.651060 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:05.651987 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:05.653321 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:05.653863 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:05.653989 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:05.655659 (+ 1670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:05.655665 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:05.655668 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:05.655698 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:05.658200 (+ 2502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:05.658871 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:05.658878 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:05.658882 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:05.659049 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:05.659497 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:05.659503 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:05.659507 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:05.659892 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:05.660052 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:05.660591 (+ 539us) server_negotiation.cc:299] Negotiation successful
0812 01:05:05.660803 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 01:05:05.661275 8126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:05.648930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45137 (local address 127.4.201.65:39717)
0812 01:05:05.649687 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:05.649711 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:05.649869 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:05.650196 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:05.650201 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:05.650642 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:05.650920 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:05.650930 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:05.652112 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:05.652118 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:05.653169 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:05.653183 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:05.654047 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:05.654053 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:05.654210 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:05.654786 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:05.654802 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:05.655487 (+ 685us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:05.658324 (+ 2837us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:05.658330 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:05.658334 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:05.658742 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:05.659193 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:05.659202 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:05.659205 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:05.659378 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:05.660021 (+ 643us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:05.660027 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:05.660253 (+ 226us) client_negotiation.cc:769] Sending connection context
0812 01:05:05.660461 (+ 208us) client_negotiation.cc:240] Negotiation successful
0812 01:05:05.660808 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":345,"threads_started":1}
I20260812 01:05:05.667042 7967 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:38961
I20260812 01:05:05.667079 8193 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:38961 every 8 connection(s)
I20260812 01:05:05.668212 7967 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:05:05.668838 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 7967
I20260812 01:05:05.669059 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance
I20260812 01:05:05.669860 4901 external_mini_cluster.cc:1428] Setting key 38aa746fc5a7623821dc84d3f8ce17a5
I20260812 01:05:05.670292 8194 heartbeater.cc:347] Connected to a master server at 127.4.201.126:45137
I20260812 01:05:05.670511 8194 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:05.671193 8194 heartbeater.cc:511] Master 127.4.201.126:45137 requested a full tablet report, sending...
I20260812 01:05:05.673362 7851 ts_manager.cc:194] Registered new tserver with Master: 55ce6b086ff646b4b1f7379551e0be58 (127.4.201.65:38961)
I20260812 01:05:05.675282 7851 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.65@KRBTEST.COM'} at 127.4.201.65:46623
WARNING: no policy specified for kudu/127.4.201.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
I20260812 01:05:05.713776 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:0
--local_ip_for_outbound_sockets=127.4.201.66
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:45137
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:39061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:06.036475 8200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:06.036764 8200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:06.036867 8200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:06.044021 8200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:06.044130 8200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:06.044224 8200 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 01:05:06.044274 8200 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 01:05:06.044343 8200 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:05:06.054103 8200 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:39061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.201.126:45137
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:06.055326 8200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:06.056610 8200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:06.069149 8207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:06.069051 8209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:06.069253 8211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:06.070283 8200 server_base.cc:1034] running on GCE node
I20260812 01:05:06.070905 8200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:06.071817 8200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:06.073004 8200 hybrid_clock.cc:648] HybridClock initialized: now 1786496706072950 us; error 47 us; skew 500 ppm
I20260812 01:05:06.073333 8200 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:06 dist-test-slave-bndk krb5kdc[7767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496706, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:06.076331 8200 init.cc:377] Logged in from keytab as kudu/127.4.201.66@KRBTEST.COM (short username kudu)
I20260812 01:05:06.077786 8200 webserver.cc:460] Webserver started at http://127.4.201.66:38733/ using document root <none> and password file <none>
I20260812 01:05:06.078435 8200 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:06.078548 8200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:06.078881 8200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:06.081871 8200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-1/data/instance:
uuid: "95e29c9b83b6439b8cf752b77c874fbb"
format_stamp: "Formatted at 2026-08-12 01:05:06 on dist-test-slave-bndk"
server_key: "03414a847ed23127797663146ed3b7ff"
server_key_iv: "0c2d7a46ad5e472df13df2178bf21a69"
server_key_version: "encryptionkey@0"
I20260812 01:05:06.082585 8200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance:
uuid: "95e29c9b83b6439b8cf752b77c874fbb"
format_stamp: "Formatted at 2026-08-12 01:05:06 on dist-test-slave-bndk"
server_key: "03414a847ed23127797663146ed3b7ff"
server_key_iv: "0c2d7a46ad5e472df13df2178bf21a69"
server_key_version: "encryptionkey@0"
I20260812 01:05:06.087549 8200 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 01:05:06.090963 8223 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:06.092245 8200 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 01:05:06.092398 8200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "95e29c9b83b6439b8cf752b77c874fbb"
format_stamp: "Formatted at 2026-08-12 01:05:06 on dist-test-slave-bndk"
server_key: "03414a847ed23127797663146ed3b7ff"
server_key_iv: "0c2d7a46ad5e472df13df2178bf21a69"
server_key_version: "encryptionkey@0"
I20260812 01:05:06.092582 8200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:06.105733 8200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:06.109338 8200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:06.109587 8200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:06.112219 8200 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:06.112360 8200 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:06.112478 8200 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:06.112565 8200 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 01:05:06 dist-test-slave-bndk krb5kdc[7767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496706, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:06.135718 8010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:06.112545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:38221 (local address 127.4.201.126:45137)
0812 01:05:06.112751 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:06.112758 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:06.114132 (+ 1374us) server_negotiation.cc:407] Connection header received
0812 01:05:06.116976 (+ 2844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:06.116982 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:06.117077 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:06.117203 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:06.119669 (+ 2466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.120614 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.123118 (+ 2504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.123741 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.123883 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:06.128419 (+ 4536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:06.128427 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:06.128432 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:06.128474 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:06.131719 (+ 3245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:06.132710 (+ 991us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:06.132717 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:06.132721 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:06.132903 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:06.133502 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:06.133508 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:06.133512 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:06.133908 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:06.134066 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:06.135104 (+ 1038us) server_negotiation.cc:299] Negotiation successful
0812 01:05:06.135351 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 01:05:06.137351 8237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:06.113028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45137 (local address 127.4.201.66:38221)
0812 01:05:06.113947 (+ 919us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:06.114007 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:06.116598 (+ 2591us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:06.117505 (+ 907us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:06.117515 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:06.118358 (+ 843us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:06.119452 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:06.119481 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.120774 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.120780 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:06.122963 (+ 2183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:06.122984 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.124109 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.124119 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:06.124446 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:06.125356 (+ 910us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:06.125389 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:06.128124 (+ 2735us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:06.131860 (+ 3736us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:06.131874 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:06.131891 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:06.132556 (+ 665us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:06.133036 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:06.133041 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:06.133045 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:06.133380 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:06.134037 (+ 657us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:06.134044 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:06.134585 (+ 541us) client_negotiation.cc:769] Sending connection context
0812 01:05:06.134938 (+ 353us) client_negotiation.cc:240] Negotiation successful
0812 01:05:06.135547 (+ 609us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":369,"threads_started":1}
I20260812 01:05:06.153299 8200 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:43103
I20260812 01:05:06.153366 8426 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:43103 every 8 connection(s)
I20260812 01:05:06.154722 8200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:05:06.156924 8427 heartbeater.cc:347] Connected to a master server at 127.4.201.126:45137
I20260812 01:05:06.157156 8427 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:06.158006 8427 heartbeater.cc:511] Master 127.4.201.126:45137 requested a full tablet report, sending...
I20260812 01:05:06.159410 8010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:06.144581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:36395 (local address 127.4.201.126:45137)
0812 01:05:06.144785 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:06.144790 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:06.146006 (+ 1216us) server_negotiation.cc:407] Connection header received
0812 01:05:06.146388 (+ 382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:06.146394 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:06.146485 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:06.146596 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:06.147986 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.148708 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.150731 (+ 2023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.151203 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.151277 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:06.153652 (+ 2375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:06.153658 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:06.153662 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:06.153692 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:06.156585 (+ 2893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:06.157374 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:06.157379 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:06.157383 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:06.157553 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:06.157917 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:06.157921 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:06.157924 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:06.158366 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:06.158519 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:06.158907 (+ 388us) server_negotiation.cc:299] Negotiation successful
0812 01:05:06.159117 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 01:05:06.159448 8390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:06.144741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45137 (local address 127.4.201.66:36395)
0812 01:05:06.145797 (+ 1056us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:06.145830 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:06.146215 (+ 385us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:06.146752 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:06.146755 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:06.147392 (+ 637us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:06.147830 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:06.147843 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.148847 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.148857 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:06.150541 (+ 1684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:06.150557 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.151534 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.151539 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:06.151680 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:06.152420 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:06.152437 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:06.153478 (+ 1041us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:06.156703 (+ 3225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:06.156708 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:06.156712 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:06.157252 (+ 540us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:06.157661 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:06.157664 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:06.157667 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:06.157792 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:06.158493 (+ 701us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:06.158497 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:06.158658 (+ 161us) client_negotiation.cc:769] Sending connection context
0812 01:05:06.158772 (+ 114us) client_negotiation.cc:240] Negotiation successful
0812 01:05:06.159077 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":881,"thread_start_us":710,"threads_started":1}
I20260812 01:05:06.159626 7851 ts_manager.cc:194] Registered new tserver with Master: 95e29c9b83b6439b8cf752b77c874fbb (127.4.201.66:43103)
I20260812 01:05:06.160313 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 8200
I20260812 01:05:06.160483 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance
I20260812 01:05:06.161020 4901 external_mini_cluster.cc:1428] Setting key 296b60ae54f81b0d535c493e44f99dd5
I20260812 01:05:06.160996 7851 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.66@KRBTEST.COM'} at 127.4.201.66:38221
WARNING: no policy specified for kudu/127.4.201.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
I20260812 01:05:06.204008 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:0
--local_ip_for_outbound_sockets=127.4.201.67
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:45137
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:39061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:06.522096 8433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:06.522372 8433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:06.522511 8433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:06.529661 8433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:06.529762 8433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:06.529891 8433 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 01:05:06.529955 8433 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 01:05:06.530055 8433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:05:06.539490 8433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:39061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.201.126:45137
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:06.540709 8433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:06.542006 8433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:06.554559 8440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:06.554661 8441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:06.554672 8445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:06.555444 8433 server_base.cc:1034] running on GCE node
I20260812 01:05:06.555974 8433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:06.556780 8433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:06.557973 8433 hybrid_clock.cc:648] HybridClock initialized: now 1786496706557917 us; error 47 us; skew 500 ppm
I20260812 01:05:06.558257 8433 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:06 dist-test-slave-bndk krb5kdc[7767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496706, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:06.565929 8433 init.cc:377] Logged in from keytab as kudu/127.4.201.67@KRBTEST.COM (short username kudu)
I20260812 01:05:06.567271 8433 webserver.cc:460] Webserver started at http://127.4.201.67:36737/ using document root <none> and password file <none>
I20260812 01:05:06.567914 8433 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:06.568012 8433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:06.568269 8433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:06.571383 8433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-2/data/instance:
uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e"
format_stamp: "Formatted at 2026-08-12 01:05:06 on dist-test-slave-bndk"
server_key: "f29a91cc68da6b690671a912cc1ed176"
server_key_iv: "b58e94567c436e62cc7f6662fcd21aab"
server_key_version: "encryptionkey@0"
I20260812 01:05:06.572098 8433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance:
uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e"
format_stamp: "Formatted at 2026-08-12 01:05:06 on dist-test-slave-bndk"
server_key: "f29a91cc68da6b690671a912cc1ed176"
server_key_iv: "b58e94567c436e62cc7f6662fcd21aab"
server_key_version: "encryptionkey@0"
I20260812 01:05:06.577087 8433 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 01:05:06.580410 8457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:06.581684 8433 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:05:06.581822 8433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e"
format_stamp: "Formatted at 2026-08-12 01:05:06 on dist-test-slave-bndk"
server_key: "f29a91cc68da6b690671a912cc1ed176"
server_key_iv: "b58e94567c436e62cc7f6662fcd21aab"
server_key_version: "encryptionkey@0"
I20260812 01:05:06.581993 8433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:06.595450 8433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:06.599943 8433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:06.600180 8433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:06.602653 8433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:06.602743 8433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:06.602869 8433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:06.602957 8433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 01:05:06 dist-test-slave-bndk krb5kdc[7767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496706, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:06.624810 8010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:06.603282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:45847 (local address 127.4.201.126:45137)
0812 01:05:06.603487 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:06.603494 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:06.604743 (+ 1249us) server_negotiation.cc:407] Connection header received
0812 01:05:06.606935 (+ 2192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:06.606942 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:06.607029 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:06.607151 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:06.609159 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.610336 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.612679 (+ 2343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.613302 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.613417 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:06.617991 (+ 4574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:06.617996 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:06.618000 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:06.618049 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:06.621152 (+ 3103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:06.622021 (+ 869us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:06.622028 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:06.622032 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:06.622200 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:06.622739 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:06.622745 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:06.622749 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:06.623106 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:06.623255 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:06.624232 (+ 977us) server_negotiation.cc:299] Negotiation successful
0812 01:05:06.624463 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 01:05:06.626065 8472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:06.603758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45137 (local address 127.4.201.67:45847)
0812 01:05:06.604572 (+ 814us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:06.604615 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:06.606640 (+ 2025us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:06.607421 (+ 781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:06.607437 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:06.608177 (+ 740us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:06.608950 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:06.608989 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.610531 (+ 1542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.610540 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:06.612530 (+ 1990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:06.612543 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.613705 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.613711 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:06.613907 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:06.614622 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:06.614656 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:06.617717 (+ 3061us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:06.621305 (+ 3588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:06.621314 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:06.621334 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:06.621892 (+ 558us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:06.622341 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:06.622347 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:06.622351 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:06.622633 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:06.623340 (+ 707us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:06.623345 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:06.623807 (+ 462us) client_negotiation.cc:769] Sending connection context
0812 01:05:06.624073 (+ 266us) client_negotiation.cc:240] Negotiation successful
0812 01:05:06.624632 (+ 559us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":337,"threads_started":1}
I20260812 01:05:06.638936 8433 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:45259
I20260812 01:05:06.639000 8662 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:45259 every 8 connection(s)
I20260812 01:05:06.640393 8433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:05:06.642575 8668 heartbeater.cc:347] Connected to a master server at 127.4.201.126:45137
I20260812 01:05:06.642791 8668 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:06.643450 8668 heartbeater.cc:511] Master 127.4.201.126:45137 requested a full tablet report, sending...
I20260812 01:05:06.644935 7851 ts_manager.cc:194] Registered new tserver with Master: 6165e2b1cf7d4e1ab72dbfe2c00b638e (127.4.201.67:45259)
I20260812 01:05:06.645937 7851 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.67@KRBTEST.COM'} at 127.4.201.67:45847
I20260812 01:05:06.650213 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 8433
I20260812 01:05:06.650368 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance
I20260812 01:05:06.650794 4901 external_mini_cluster.cc:1428] Setting key d8b0bbe642f041432c5b8338e634fb5c
I20260812 01:05:06.652202 8010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:06.640004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:39557 (local address 127.4.201.126:45137)
0812 01:05:06.640187 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:06.640193 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:06.640833 (+ 640us) server_negotiation.cc:407] Connection header received
0812 01:05:06.641000 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:06.641006 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:06.641086 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:06.641168 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:06.642288 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.643171 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.644615 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.645164 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.645321 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:06.647141 (+ 1820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:06.647147 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:06.647150 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:06.647180 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:06.649665 (+ 2485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:06.650295 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:06.650301 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:06.650305 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:06.650458 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:06.650803 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:06.650808 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:06.650812 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:06.651102 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:06.651243 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:06.651646 (+ 403us) server_negotiation.cc:299] Negotiation successful
0812 01:05:06.651857 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":67}
I20260812 01:05:06.652240 8667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:06.640054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45137 (local address 127.4.201.67:39557)
0812 01:05:06.640731 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:06.640747 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:06.640878 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:06.641209 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:06.641234 (+ 25us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:06.641732 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:06.642152 (+ 420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:06.642165 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.643339 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.643343 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:06.644495 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:06.644510 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.645360 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.645367 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:06.645531 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:06.646169 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:06.646185 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:06.646954 (+ 769us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:06.649783 (+ 2829us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:06.649788 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:06.649793 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:06.650183 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:06.650572 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:06.650577 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:06.650581 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:06.650703 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:06.651215 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:06.651220 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:06.651396 (+ 176us) client_negotiation.cc:769] Sending connection context
0812 01:05:06.651520 (+ 124us) client_negotiation.cc:240] Negotiation successful
0812 01:05:06.651798 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":365,"threads_started":1}
I20260812 01:05:06.654078 4901 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:05:06.678107 8194 heartbeater.cc:503] Master 127.4.201.126:45137 was elected leader, sending a full tablet report...
Aug 12 01:05:06 dist-test-slave-bndk krb5kdc[7767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 01:05:06 dist-test-slave-bndk krb5kdc[7767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:06.704969 8010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:06.692091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52664 (local address 127.4.201.126:45137)
0812 01:05:06.692332 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:06.692338 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:06.692580 (+ 242us) server_negotiation.cc:407] Connection header received
0812 01:05:06.692725 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:06.692729 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:06.692794 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:06.692875 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:06.694307 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.695040 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.696318 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.696747 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.696839 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:06.700581 (+ 3742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:06.700586 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:06.700590 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:06.700621 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:06.702910 (+ 2289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:06.703472 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:06.703476 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:06.703479 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:06.703591 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:06.703860 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:06.703863 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:06.703865 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:06.704128 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:06.704298 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:06.704508 (+ 210us) server_negotiation.cc:299] Negotiation successful
0812 01:05:06.704700 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260812 01:05:06.708711 7850 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52664:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:05:06.715641 7850 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:05:06.750046 8685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:06.727219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:38961 (local address 127.0.0.1:50770)
0812 01:05:06.740045 (+ 12826us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:06.740092 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:06.740316 (+ 224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:06.741353 (+ 1037us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:06.741361 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:06.741398 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:06.741985 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:06.742000 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.744461 (+ 2461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.744466 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:06.746858 (+ 2392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:06.746874 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.748981 (+ 2107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.748988 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:06.749192 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:06.749269 (+ 77us) client_negotiation.cc:769] Sending connection context
0812 01:05:06.749387 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 01:05:06.749579 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12543,"mutex_wait_us":3,"spinlock_wait_cycles":15360,"thread_start_us":12319,"threads_started":1}
I20260812 01:05:06.751050 8687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:06.727743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50770 (local address 127.4.201.65:38961)
0812 01:05:06.740386 (+ 12643us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:06.740394 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:06.740487 (+ 93us) server_negotiation.cc:407] Connection header received
0812 01:05:06.740604 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:06.740613 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:06.740876 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:06.741080 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:06.742212 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.744269 (+ 2057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.747046 (+ 2777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.748501 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.748628 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:06.748846 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:06.750580 (+ 1734us) server_negotiation.cc:299] Negotiation successful
0812 01:05:06.750751 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12037,"spinlock_wait_cycles":275328,"thread_start_us":12094,"threads_started":1}
I20260812 01:05:06.752925 8686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:06.727362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:45259 (local address 127.0.0.1:38952)
0812 01:05:06.740097 (+ 12735us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:06.740117 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:06.740317 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:06.742506 (+ 2189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:06.742510 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:06.742537 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:06.742923 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:06.742936 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.745582 (+ 2646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.745587 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:06.749765 (+ 4178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:06.749780 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.752174 (+ 2394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.752180 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:06.752344 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:06.752377 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 01:05:06.752467 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 01:05:06.752586 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12575,"mutex_wait_us":37,"spinlock_wait_cycles":1920,"thread_start_us":13110,"threads_started":1}
I20260812 01:05:06.753845 8688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:06.727735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38952 (local address 127.4.201.67:45259)
0812 01:05:06.739511 (+ 11776us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:06.739523 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:06.741641 (+ 2118us) server_negotiation.cc:407] Connection header received
0812 01:05:06.741759 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:06.741766 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:06.742041 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:06.742218 (+ 177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:06.743153 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.745401 (+ 2248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.749945 (+ 4544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.751673 (+ 1728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.751790 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:06.752032 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:06.753379 (+ 1347us) server_negotiation.cc:299] Negotiation successful
0812 01:05:06.753545 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11525,"thread_start_us":11303,"threads_started":1}
I20260812 01:05:06.755573 8076 tablet_service.cc:1467] Processing CreateTablet for tablet c49e535624e54021b92bab9ab8d825ae (DEFAULT_TABLE table=test-table [id=7ac0878c28eb41ceb521410ac01d44de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:06.757120 8076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c49e535624e54021b92bab9ab8d825ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:06.757364 8540 tablet_service.cc:1467] Processing CreateTablet for tablet c49e535624e54021b92bab9ab8d825ae (DEFAULT_TABLE table=test-table [id=7ac0878c28eb41ceb521410ac01d44de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:06.758606 8685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:06.740799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:43103 (local address 127.0.0.1:47670)
0812 01:05:06.750274 (+ 9475us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:06.750293 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:06.750390 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:06.753365 (+ 2975us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:06.753370 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:06.753396 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:06.753544 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:06.753556 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.755226 (+ 1670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.755232 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:06.756415 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:06.756430 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.757894 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.757900 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:06.758068 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:06.758101 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 01:05:06.758183 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 01:05:06.758314 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9382,"thread_start_us":10648,"threads_started":1}
I20260812 01:05:06.758653 8690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:06.740804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47670 (local address 127.4.201.66:43103)
0812 01:05:06.752753 (+ 11949us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:06.752762 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:06.752788 (+ 26us) server_negotiation.cc:407] Connection header received
0812 01:05:06.752893 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:06.752900 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:06.753127 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:06.753400 (+ 273us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:06.753695 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.755086 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.756601 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.757732 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.757858 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:06.758053 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:06.758252 (+ 199us) server_negotiation.cc:299] Negotiation successful
0812 01:05:06.758408 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11789,"thread_start_us":11674,"threads_started":1}
I20260812 01:05:06.758749 8540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c49e535624e54021b92bab9ab8d825ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:06.761415 8305 tablet_service.cc:1467] Processing CreateTablet for tablet c49e535624e54021b92bab9ab8d825ae (DEFAULT_TABLE table=test-table [id=7ac0878c28eb41ceb521410ac01d44de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:06.762607 8305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c49e535624e54021b92bab9ab8d825ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:06.771636 8694 tablet_bootstrap.cc:492] T c49e535624e54021b92bab9ab8d825ae P 55ce6b086ff646b4b1f7379551e0be58: Bootstrap starting.
I20260812 01:05:06.773650 8695 tablet_bootstrap.cc:492] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Bootstrap starting.
I20260812 01:05:06.774943 8696 tablet_bootstrap.cc:492] T c49e535624e54021b92bab9ab8d825ae P 95e29c9b83b6439b8cf752b77c874fbb: Bootstrap starting.
I20260812 01:05:06.775904 8694 tablet_bootstrap.cc:654] T c49e535624e54021b92bab9ab8d825ae P 55ce6b086ff646b4b1f7379551e0be58: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:06.776896 8694 log.cc:824] T c49e535624e54021b92bab9ab8d825ae P 55ce6b086ff646b4b1f7379551e0be58: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:06.777020 8695 tablet_bootstrap.cc:654] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:06.778189 8696 tablet_bootstrap.cc:654] T c49e535624e54021b92bab9ab8d825ae P 95e29c9b83b6439b8cf752b77c874fbb: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:06.778276 8695 log.cc:824] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:06.779467 8696 log.cc:824] T c49e535624e54021b92bab9ab8d825ae P 95e29c9b83b6439b8cf752b77c874fbb: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:06.780197 8694 tablet_bootstrap.cc:492] T c49e535624e54021b92bab9ab8d825ae P 55ce6b086ff646b4b1f7379551e0be58: No bootstrap required, opened a new log
I20260812 01:05:06.780483 8694 ts_tablet_manager.cc:1397] T c49e535624e54021b92bab9ab8d825ae P 55ce6b086ff646b4b1f7379551e0be58: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.006s
I20260812 01:05:06.782473 8696 tablet_bootstrap.cc:492] T c49e535624e54021b92bab9ab8d825ae P 95e29c9b83b6439b8cf752b77c874fbb: No bootstrap required, opened a new log
I20260812 01:05:06.782760 8696 ts_tablet_manager.cc:1397] T c49e535624e54021b92bab9ab8d825ae P 95e29c9b83b6439b8cf752b77c874fbb: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260812 01:05:06.787402 8695 tablet_bootstrap.cc:492] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e: No bootstrap required, opened a new log
I20260812 01:05:06.787688 8695 ts_tablet_manager.cc:1397] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.012s
I20260812 01:05:06.788503 8694 raft_consensus.cc:348] T c49e535624e54021b92bab9ab8d825ae P 55ce6b086ff646b4b1f7379551e0be58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } }
I20260812 01:05:06.788938 8694 raft_consensus.cc:374] T c49e535624e54021b92bab9ab8d825ae P 55ce6b086ff646b4b1f7379551e0be58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:06.789054 8694 raft_consensus.cc:729] T c49e535624e54021b92bab9ab8d825ae P 55ce6b086ff646b4b1f7379551e0be58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55ce6b086ff646b4b1f7379551e0be58, State: Initialized, Role: FOLLOWER
I20260812 01:05:06.789770 8694 consensus_queue.cc:260] T c49e535624e54021b92bab9ab8d825ae P 55ce6b086ff646b4b1f7379551e0be58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } }
I20260812 01:05:06.791522 8694 ts_tablet_manager.cc:1428] T c49e535624e54021b92bab9ab8d825ae P 55ce6b086ff646b4b1f7379551e0be58: Time spent starting tablet: real 0.011s user 0.010s sys 0.001s
I20260812 01:05:06.792330 8696 raft_consensus.cc:348] T c49e535624e54021b92bab9ab8d825ae P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } }
I20260812 01:05:06.792650 8696 raft_consensus.cc:374] T c49e535624e54021b92bab9ab8d825ae P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:06.792749 8696 raft_consensus.cc:729] T c49e535624e54021b92bab9ab8d825ae P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95e29c9b83b6439b8cf752b77c874fbb, State: Initialized, Role: FOLLOWER
I20260812 01:05:06.793300 8696 consensus_queue.cc:260] T c49e535624e54021b92bab9ab8d825ae P 95e29c9b83b6439b8cf752b77c874fbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } }
I20260812 01:05:06.794282 8427 heartbeater.cc:503] Master 127.4.201.126:45137 was elected leader, sending a full tablet report...
I20260812 01:05:06.794878 8696 ts_tablet_manager.cc:1428] T c49e535624e54021b92bab9ab8d825ae P 95e29c9b83b6439b8cf752b77c874fbb: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
I20260812 01:05:06.797427 8695 raft_consensus.cc:348] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } }
I20260812 01:05:06.797848 8695 raft_consensus.cc:374] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:06.797943 8695 raft_consensus.cc:729] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6165e2b1cf7d4e1ab72dbfe2c00b638e, State: Initialized, Role: FOLLOWER
I20260812 01:05:06.798475 8695 consensus_queue.cc:260] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } }
I20260812 01:05:06.799474 8668 heartbeater.cc:503] Master 127.4.201.126:45137 was elected leader, sending a full tablet report...
I20260812 01:05:06.800002 8695 ts_tablet_manager.cc:1428] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Time spent starting tablet: real 0.012s user 0.013s sys 0.000s
I20260812 01:05:06.853863 8706 raft_consensus.cc:482] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:05:06.854157 8706 raft_consensus.cc:504] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } }
I20260812 01:05:06.855895 8706 leader_election.cc:288] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55ce6b086ff646b4b1f7379551e0be58 (127.4.201.65:38961), 95e29c9b83b6439b8cf752b77c874fbb (127.4.201.66:43103)
I20260812 01:05:06.862262 8472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:06.856249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:38961 (local address 127.4.201.67:47107)
0812 01:05:06.856450 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:06.856483 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:06.856602 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:06.857172 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:06.857177 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:06.857210 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:06.857428 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:06.857437 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.858692 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.858698 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:06.860197 (+ 1499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:06.860211 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.861574 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.861580 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:06.861745 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:06.861769 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 01:05:06.861853 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 01:05:06.861977 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260812 01:05:06.862257 8687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:06.856325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:47107 (local address 127.4.201.65:38961)
0812 01:05:06.856508 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:06.856512 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:06.856533 (+ 21us) server_negotiation.cc:407] Connection header received
0812 01:05:06.856792 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:06.856797 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:06.856879 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:06.856972 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:06.857606 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.858545 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.860361 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.861422 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.861580 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:06.861657 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:06.861893 (+ 236us) server_negotiation.cc:299] Negotiation successful
0812 01:05:06.862027 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 01:05:06.862843 8690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:06.856950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:44183 (local address 127.4.201.66:43103)
0812 01:05:06.857157 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:06.857162 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:06.857491 (+ 329us) server_negotiation.cc:407] Connection header received
0812 01:05:06.857644 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:06.857648 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:06.857706 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:06.857773 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:06.858324 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.859277 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.861071 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.861956 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.862113 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:06.862183 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:06.862522 (+ 339us) server_negotiation.cc:299] Negotiation successful
0812 01:05:06.862646 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260812 01:05:06.863350 8707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:06.856720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:43103 (local address 127.4.201.67:44183)
0812 01:05:06.857399 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:06.857413 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:06.857523 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:06.857811 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:06.857816 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:06.857840 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:06.858201 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:06.858213 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.859412 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.859416 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:06.860909 (+ 1493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:06.860921 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.862184 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.862190 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:06.862327 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:06.862357 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 01:05:06.863009 (+ 652us) client_negotiation.cc:240] Negotiation successful
0812 01:05:06.863126 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":344,"threads_started":1}
I20260812 01:05:06.863263 8109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c49e535624e54021b92bab9ab8d825ae" candidate_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55ce6b086ff646b4b1f7379551e0be58" is_pre_election: true
I20260812 01:05:06.863771 8109 raft_consensus.cc:2454] T c49e535624e54021b92bab9ab8d825ae P 55ce6b086ff646b4b1f7379551e0be58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6165e2b1cf7d4e1ab72dbfe2c00b638e in term 0.
I20260812 01:05:06.864336 8342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c49e535624e54021b92bab9ab8d825ae" candidate_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95e29c9b83b6439b8cf752b77c874fbb" is_pre_election: true
I20260812 01:05:06.864487 8461 leader_election.cc:302] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55ce6b086ff646b4b1f7379551e0be58, 6165e2b1cf7d4e1ab72dbfe2c00b638e; no voters:
I20260812 01:05:06.864912 8706 raft_consensus.cc:2781] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:05:06.864916 8342 raft_consensus.cc:2454] T c49e535624e54021b92bab9ab8d825ae P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6165e2b1cf7d4e1ab72dbfe2c00b638e in term 0.
I20260812 01:05:06.865069 8706 raft_consensus.cc:482] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:05:06.865175 8706 raft_consensus.cc:3037] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:06.867415 8706 raft_consensus.cc:504] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } }
I20260812 01:05:06.867938 8706 leader_election.cc:288] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e [CANDIDATE]: Term 1 election: Requested vote from peers 55ce6b086ff646b4b1f7379551e0be58 (127.4.201.65:38961), 95e29c9b83b6439b8cf752b77c874fbb (127.4.201.66:43103)
I20260812 01:05:06.868379 8109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c49e535624e54021b92bab9ab8d825ae" candidate_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55ce6b086ff646b4b1f7379551e0be58"
I20260812 01:05:06.868427 8342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c49e535624e54021b92bab9ab8d825ae" candidate_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95e29c9b83b6439b8cf752b77c874fbb"
I20260812 01:05:06.868571 8109 raft_consensus.cc:3037] T c49e535624e54021b92bab9ab8d825ae P 55ce6b086ff646b4b1f7379551e0be58 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:06.868608 8342 raft_consensus.cc:3037] T c49e535624e54021b92bab9ab8d825ae P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:06.870729 8109 raft_consensus.cc:2454] T c49e535624e54021b92bab9ab8d825ae P 55ce6b086ff646b4b1f7379551e0be58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6165e2b1cf7d4e1ab72dbfe2c00b638e in term 1.
I20260812 01:05:06.870748 8342 raft_consensus.cc:2454] T c49e535624e54021b92bab9ab8d825ae P 95e29c9b83b6439b8cf752b77c874fbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6165e2b1cf7d4e1ab72dbfe2c00b638e in term 1.
I20260812 01:05:06.871066 8461 leader_election.cc:302] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6165e2b1cf7d4e1ab72dbfe2c00b638e, 95e29c9b83b6439b8cf752b77c874fbb; no voters:
I20260812 01:05:06.871318 8706 raft_consensus.cc:2781] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:05:06.871722 8706 raft_consensus.cc:686] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 1 LEADER]: Becoming Leader. State: Replica: 6165e2b1cf7d4e1ab72dbfe2c00b638e, State: Running, Role: LEADER
I20260812 01:05:06.872243 8706 consensus_queue.cc:237] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } }
I20260812 01:05:06.876459 7851 catalog_manager.cc:5495] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e reported cstate change: term changed from 0 to 1, leader changed from <none> to 6165e2b1cf7d4e1ab72dbfe2c00b638e (127.4.201.67). New cstate: current_term: 1 leader_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } health_report { overall_health: UNKNOWN } } }
W20260812 01:05:06.892946 8669 tablet.cc:2369] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:05:06.906881 8430 tablet.cc:2369] T c49e535624e54021b92bab9ab8d825ae P 95e29c9b83b6439b8cf752b77c874fbb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:05:06.920643 8196 tablet.cc:2369] T c49e535624e54021b92bab9ab8d825ae P 55ce6b086ff646b4b1f7379551e0be58: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 12 01:05:06 dist-test-slave-bndk krb5kdc[7767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496704, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:06.928213 8725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:06.915439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45137 (local address 127.0.0.1:52678)
0812 01:05:06.916040 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:06.916057 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:06.916180 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:06.916459 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:06.916462 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:06.917124 (+ 662us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:06.917439 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:06.917450 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.918398 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.918402 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:06.919339 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:06.919350 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.920024 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.920028 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:06.920152 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:06.920929 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:06.920953 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:06.923184 (+ 2231us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:06.925769 (+ 2585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:06.925782 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:06.925790 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:06.926176 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:06.926518 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:06.926524 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:06.926526 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:06.926650 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:06.927160 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:06.927169 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:06.927340 (+ 171us) client_negotiation.cc:769] Sending connection context
0812 01:05:06.927504 (+ 164us) client_negotiation.cc:240] Negotiation successful
0812 01:05:06.927766 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":334,"threads_started":1}
I20260812 01:05:06.928246 8010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:06.915381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52678 (local address 127.4.201.126:45137)
0812 01:05:06.915560 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:06.915567 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:06.916144 (+ 577us) server_negotiation.cc:407] Connection header received
0812 01:05:06.916268 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:06.916272 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:06.916343 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:06.916421 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:06.917562 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.918285 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.919456 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.919862 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.919955 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:06.923347 (+ 3392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:06.923351 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:06.923355 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:06.923383 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:06.925649 (+ 2266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:06.926284 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:06.926290 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:06.926292 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:06.926407 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:06.926750 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:06.926755 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:06.926758 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:06.927028 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:06.927167 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:06.927606 (+ 439us) server_negotiation.cc:299] Negotiation successful
0812 01:05:06.927897 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":105,"server-negotiator.queue_time_us":54}
I20260812 01:05:06.932870 7851 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:52678:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 01:05:06.933866 7851 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:05:06.940129 8305 tablet_service.cc:1467] Processing CreateTablet for tablet dd08288dc58248d18ebfadfd8aa001ed (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=cb22a64afe634e0bab0112ae1d0184f1]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 01:05:06.939989 8076 tablet_service.cc:1467] Processing CreateTablet for tablet dd08288dc58248d18ebfadfd8aa001ed (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=cb22a64afe634e0bab0112ae1d0184f1]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 01:05:06.940936 8305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd08288dc58248d18ebfadfd8aa001ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:06.940491 8540 tablet_service.cc:1467] Processing CreateTablet for tablet dd08288dc58248d18ebfadfd8aa001ed (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=cb22a64afe634e0bab0112ae1d0184f1]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 01:05:06.940958 8076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd08288dc58248d18ebfadfd8aa001ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:06.941285 8540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd08288dc58248d18ebfadfd8aa001ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:06.946403 8696 tablet_bootstrap.cc:492] T dd08288dc58248d18ebfadfd8aa001ed P 95e29c9b83b6439b8cf752b77c874fbb: Bootstrap starting.
I20260812 01:05:06.947978 8695 tablet_bootstrap.cc:492] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Bootstrap starting.
I20260812 01:05:06.947966 8694 tablet_bootstrap.cc:492] T dd08288dc58248d18ebfadfd8aa001ed P 55ce6b086ff646b4b1f7379551e0be58: Bootstrap starting.
I20260812 01:05:06.948057 8696 tablet_bootstrap.cc:654] T dd08288dc58248d18ebfadfd8aa001ed P 95e29c9b83b6439b8cf752b77c874fbb: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:06.949530 8694 tablet_bootstrap.cc:654] T dd08288dc58248d18ebfadfd8aa001ed P 55ce6b086ff646b4b1f7379551e0be58: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:06.950037 8695 tablet_bootstrap.cc:654] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:06.952291 8695 tablet_bootstrap.cc:492] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e: No bootstrap required, opened a new log
I20260812 01:05:06.952422 8695 ts_tablet_manager.cc:1397] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260812 01:05:06.952553 8694 tablet_bootstrap.cc:492] T dd08288dc58248d18ebfadfd8aa001ed P 55ce6b086ff646b4b1f7379551e0be58: No bootstrap required, opened a new log
I20260812 01:05:06.952698 8694 ts_tablet_manager.cc:1397] T dd08288dc58248d18ebfadfd8aa001ed P 55ce6b086ff646b4b1f7379551e0be58: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 01:05:06.953361 8696 tablet_bootstrap.cc:492] T dd08288dc58248d18ebfadfd8aa001ed P 95e29c9b83b6439b8cf752b77c874fbb: No bootstrap required, opened a new log
I20260812 01:05:06.953203 8695 raft_consensus.cc:348] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:06.953498 8695 raft_consensus.cc:374] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:06.953598 8695 raft_consensus.cc:729] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6165e2b1cf7d4e1ab72dbfe2c00b638e, State: Initialized, Role: FOLLOWER
I20260812 01:05:06.953639 8696 ts_tablet_manager.cc:1397] T dd08288dc58248d18ebfadfd8aa001ed P 95e29c9b83b6439b8cf752b77c874fbb: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.004s
I20260812 01:05:06.953496 8694 raft_consensus.cc:348] T dd08288dc58248d18ebfadfd8aa001ed P 55ce6b086ff646b4b1f7379551e0be58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:06.953730 8694 raft_consensus.cc:374] T dd08288dc58248d18ebfadfd8aa001ed P 55ce6b086ff646b4b1f7379551e0be58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:06.953827 8694 raft_consensus.cc:729] T dd08288dc58248d18ebfadfd8aa001ed P 55ce6b086ff646b4b1f7379551e0be58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55ce6b086ff646b4b1f7379551e0be58, State: Initialized, Role: FOLLOWER
I20260812 01:05:06.953835 8695 consensus_queue.cc:260] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:06.954048 8694 consensus_queue.cc:260] T dd08288dc58248d18ebfadfd8aa001ed P 55ce6b086ff646b4b1f7379551e0be58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:06.954401 8695 ts_tablet_manager.cc:1428] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 01:05:06.954612 8694 ts_tablet_manager.cc:1428] T dd08288dc58248d18ebfadfd8aa001ed P 55ce6b086ff646b4b1f7379551e0be58: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260812 01:05:06.954524 8703 tablet_replica.cc:439] T dd08288dc58248d18ebfadfd8aa001ed P 55ce6b086ff646b4b1f7379551e0be58: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } } }
I20260812 01:05:06.954717 8706 tablet_replica.cc:439] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } } }
I20260812 01:05:06.954952 8706 tablet_replica.cc:442] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:05:06.954941 8703 tablet_replica.cc:442] T dd08288dc58248d18ebfadfd8aa001ed P 55ce6b086ff646b4b1f7379551e0be58: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:05:06.955271 8696 raft_consensus.cc:348] T dd08288dc58248d18ebfadfd8aa001ed P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:06.955523 8696 raft_consensus.cc:374] T dd08288dc58248d18ebfadfd8aa001ed P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:06.955783 8696 raft_consensus.cc:729] T dd08288dc58248d18ebfadfd8aa001ed P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95e29c9b83b6439b8cf752b77c874fbb, State: Initialized, Role: FOLLOWER
I20260812 01:05:06.956023 8696 consensus_queue.cc:260] T dd08288dc58248d18ebfadfd8aa001ed P 95e29c9b83b6439b8cf752b77c874fbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:06.957638 8696 ts_tablet_manager.cc:1428] T dd08288dc58248d18ebfadfd8aa001ed P 95e29c9b83b6439b8cf752b77c874fbb: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260812 01:05:06.961303 8730 tablet_replica.cc:439] T dd08288dc58248d18ebfadfd8aa001ed P 95e29c9b83b6439b8cf752b77c874fbb: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } } }
I20260812 01:05:06.961673 8730 tablet_replica.cc:442] T dd08288dc58248d18ebfadfd8aa001ed P 95e29c9b83b6439b8cf752b77c874fbb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:05:06.961853 8730 raft_consensus.cc:482] T dd08288dc58248d18ebfadfd8aa001ed P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:05:06.962005 8730 raft_consensus.cc:504] T dd08288dc58248d18ebfadfd8aa001ed P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:06.963706 8730 leader_election.cc:288] T dd08288dc58248d18ebfadfd8aa001ed P 95e29c9b83b6439b8cf752b77c874fbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55ce6b086ff646b4b1f7379551e0be58 (127.4.201.65:38961), 6165e2b1cf7d4e1ab72dbfe2c00b638e (127.4.201.67:45259)
I20260812 01:05:06.965667 8706 raft_consensus.cc:482] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:05:06.965814 8706 raft_consensus.cc:504] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:06.966338 8706 leader_election.cc:288] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55ce6b086ff646b4b1f7379551e0be58 (127.4.201.65:38961), 95e29c9b83b6439b8cf752b77c874fbb (127.4.201.66:43103)
I20260812 01:05:06.966869 8342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd08288dc58248d18ebfadfd8aa001ed" candidate_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95e29c9b83b6439b8cf752b77c874fbb" is_pre_election: true
I20260812 01:05:06.966885 8109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd08288dc58248d18ebfadfd8aa001ed" candidate_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55ce6b086ff646b4b1f7379551e0be58" is_pre_election: true
I20260812 01:05:06.967105 8342 raft_consensus.cc:2454] T dd08288dc58248d18ebfadfd8aa001ed P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6165e2b1cf7d4e1ab72dbfe2c00b638e in term 0.
I20260812 01:05:06.967168 8109 raft_consensus.cc:2454] T dd08288dc58248d18ebfadfd8aa001ed P 55ce6b086ff646b4b1f7379551e0be58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6165e2b1cf7d4e1ab72dbfe2c00b638e in term 0.
I20260812 01:05:06.967536 8461 leader_election.cc:302] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6165e2b1cf7d4e1ab72dbfe2c00b638e, 95e29c9b83b6439b8cf752b77c874fbb; no voters:
I20260812 01:05:06.967831 8706 raft_consensus.cc:2781] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:05:06.967942 8706 raft_consensus.cc:482] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:05:06.968042 8706 raft_consensus.cc:3037] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:06.971004 8706 raft_consensus.cc:504] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:06.971648 8706 leader_election.cc:288] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e [CANDIDATE]: Term 1 election: Requested vote from peers 55ce6b086ff646b4b1f7379551e0be58 (127.4.201.65:38961), 95e29c9b83b6439b8cf752b77c874fbb (127.4.201.66:43103)
I20260812 01:05:06.972128 8342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd08288dc58248d18ebfadfd8aa001ed" candidate_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95e29c9b83b6439b8cf752b77c874fbb"
I20260812 01:05:06.972352 8342 raft_consensus.cc:3037] T dd08288dc58248d18ebfadfd8aa001ed P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:06.973047 8687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:06.964561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:34269 (local address 127.4.201.65:38961)
0812 01:05:06.964908 (+ 347us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:06.964914 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:06.965004 (+ 90us) server_negotiation.cc:407] Connection header received
0812 01:05:06.965169 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:06.965175 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:06.965303 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:06.965401 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:06.966933 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.968044 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.970578 (+ 2534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.971802 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.971934 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:06.972007 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:06.972591 (+ 584us) server_negotiation.cc:299] Negotiation successful
0812 01:05:06.972746 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235}
I20260812 01:05:06.973063 8731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:06.964068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:38961 (local address 127.4.201.66:34269)
0812 01:05:06.964883 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:06.964901 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:06.965041 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:06.965423 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:06.965428 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:06.965453 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:06.966722 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:06.966737 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.968216 (+ 1479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.968222 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:06.970397 (+ 2175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:06.970413 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.972218 (+ 1805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.972225 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:06.972398 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:06.972435 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 01:05:06.972542 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 01:05:06.972669 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":689,"spinlock_wait_cycles":24960,"threads_started":1}
I20260812 01:05:06.974931 8342 raft_consensus.cc:2454] T dd08288dc58248d18ebfadfd8aa001ed P 95e29c9b83b6439b8cf752b77c874fbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6165e2b1cf7d4e1ab72dbfe2c00b638e in term 1.
I20260812 01:05:06.975322 8461 leader_election.cc:302] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6165e2b1cf7d4e1ab72dbfe2c00b638e, 95e29c9b83b6439b8cf752b77c874fbb; no voters:
I20260812 01:05:06.975607 8706 raft_consensus.cc:2781] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:05:06.975621 8109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd08288dc58248d18ebfadfd8aa001ed" candidate_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55ce6b086ff646b4b1f7379551e0be58"
I20260812 01:05:06.975847 8109 raft_consensus.cc:3037] T dd08288dc58248d18ebfadfd8aa001ed P 55ce6b086ff646b4b1f7379551e0be58 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:06.975872 8706 raft_consensus.cc:686] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 1 LEADER]: Becoming Leader. State: Replica: 6165e2b1cf7d4e1ab72dbfe2c00b638e, State: Running, Role: LEADER
I20260812 01:05:06.976243 8706 consensus_queue.cc:237] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:06.978811 8109 raft_consensus.cc:2454] T dd08288dc58248d18ebfadfd8aa001ed P 55ce6b086ff646b4b1f7379551e0be58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6165e2b1cf7d4e1ab72dbfe2c00b638e in term 1.
I20260812 01:05:06.979946 8688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:06.964514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:37921 (local address 127.4.201.67:45259)
0812 01:05:06.964768 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:06.964774 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:06.973380 (+ 8606us) server_negotiation.cc:407] Connection header received
0812 01:05:06.973650 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:06.973656 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:06.973738 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:06.973839 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:06.974202 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.975284 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.977542 (+ 2258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.978799 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.978938 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:06.979008 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:06.979571 (+ 563us) server_negotiation.cc:299] Negotiation successful
0812 01:05:06.979698 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117}
I20260812 01:05:06.980580 8731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:06.964088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:45259 (local address 127.4.201.66:37921)
0812 01:05:06.973289 (+ 9201us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:06.973307 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:06.973490 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:06.973870 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:06.973875 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:06.973904 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:06.974078 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:06.974088 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.975616 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.975621 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:06.977354 (+ 1733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:06.977370 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:06.979147 (+ 1777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:06.979153 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:06.979374 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:06.979406 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 01:05:06.980155 (+ 749us) client_negotiation.cc:240] Negotiation successful
0812 01:05:06.980299 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9085,"thread_start_us":556,"threads_started":1}
I20260812 01:05:06.981453 8577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd08288dc58248d18ebfadfd8aa001ed" candidate_uuid: "95e29c9b83b6439b8cf752b77c874fbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" is_pre_election: true
I20260812 01:05:06.982300 8109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd08288dc58248d18ebfadfd8aa001ed" candidate_uuid: "95e29c9b83b6439b8cf752b77c874fbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55ce6b086ff646b4b1f7379551e0be58" is_pre_election: true
I20260812 01:05:06.982626 8109 raft_consensus.cc:2379] T dd08288dc58248d18ebfadfd8aa001ed P 55ce6b086ff646b4b1f7379551e0be58 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95e29c9b83b6439b8cf752b77c874fbb in current term 1: Already voted for candidate 6165e2b1cf7d4e1ab72dbfe2c00b638e in this term.
I20260812 01:05:06.983390 8227 leader_election.cc:302] T dd08288dc58248d18ebfadfd8aa001ed P 95e29c9b83b6439b8cf752b77c874fbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95e29c9b83b6439b8cf752b77c874fbb; no voters: 55ce6b086ff646b4b1f7379551e0be58, 6165e2b1cf7d4e1ab72dbfe2c00b638e
I20260812 01:05:06.984472 8704 raft_consensus.cc:2726] T dd08288dc58248d18ebfadfd8aa001ed P 95e29c9b83b6439b8cf752b77c874fbb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 01:05:06.986755 8708 tablet_replica.cc:439] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e: TxnStatusTablet state changed. Reason: New leader 6165e2b1cf7d4e1ab72dbfe2c00b638e. Latest consensus state: current_term: 1 leader_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } } }
I20260812 01:05:06.987133 8708 tablet_replica.cc:442] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e: This TxnStatusTablet replica's current role is: LEADER
I20260812 01:05:06.987717 8735 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 01:05:06.987963 8735 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 01:05:06.987950 7850 catalog_manager.cc:5495] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e reported cstate change: term changed from 0 to 1, leader changed from <none> to 6165e2b1cf7d4e1ab72dbfe2c00b638e (127.4.201.67). New cstate: current_term: 1 leader_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } health_report { overall_health: HEALTHY } } }
I20260812 01:05:07.009040 8725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:07.003111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:45259 (local address 127.0.0.1:38960)
0812 01:05:07.003409 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:07.003425 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:07.003541 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:07.004010 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:07.004013 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:07.004022 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 01:05:07.004169 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:07.004176 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:07.005587 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:07.005591 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:07.006533 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:07.006545 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:07.007482 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:07.007487 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:07.007645 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:07.007701 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 01:05:07.008635 (+ 934us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 01:05:07.008645 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 01:05:07.008691 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 01:05:07.008800 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172}
I20260812 01:05:07.009145 8688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:07.003102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38960 (local address 127.4.201.67:45259)
0812 01:05:07.003277 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:07.003284 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:07.003499 (+ 215us) server_negotiation.cc:407] Connection header received
0812 01:05:07.003731 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:07.003737 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:07.003843 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:07.004002 (+ 159us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:05:07.004282 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:07.005464 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:07.006670 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:07.007341 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:07.007488 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:07.007880 (+ 392us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:05:07.008543 (+ 663us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:05:07.008691 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:07.008751 (+ 60us) server_negotiation.cc:299] Negotiation successful
0812 01:05:07.008839 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 01:05:07.016275 8109 raft_consensus.cc:1261] T dd08288dc58248d18ebfadfd8aa001ed P 55ce6b086ff646b4b1f7379551e0be58 [term 1 FOLLOWER]: Refusing update from remote peer 6165e2b1cf7d4e1ab72dbfe2c00b638e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:07.016434 8342 raft_consensus.cc:1261] T dd08288dc58248d18ebfadfd8aa001ed P 95e29c9b83b6439b8cf752b77c874fbb [term 1 FOLLOWER]: Refusing update from remote peer 6165e2b1cf7d4e1ab72dbfe2c00b638e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:07.017102 8708 consensus_queue.cc:1035] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e [LEADER]: Connected to new peer: Peer: permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:07.017470 8706 consensus_queue.cc:1035] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e [LEADER]: Connected to new peer: Peer: permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:07.028600 8703 tablet_replica.cc:439] T dd08288dc58248d18ebfadfd8aa001ed P 55ce6b086ff646b4b1f7379551e0be58: TxnStatusTablet state changed. Reason: New leader 6165e2b1cf7d4e1ab72dbfe2c00b638e. Latest consensus state: current_term: 1 leader_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } } }
I20260812 01:05:07.028885 8703 tablet_replica.cc:442] T dd08288dc58248d18ebfadfd8aa001ed P 55ce6b086ff646b4b1f7379551e0be58: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:05:07.030961 8704 tablet_replica.cc:439] T dd08288dc58248d18ebfadfd8aa001ed P 95e29c9b83b6439b8cf752b77c874fbb: TxnStatusTablet state changed. Reason: New leader 6165e2b1cf7d4e1ab72dbfe2c00b638e. Latest consensus state: current_term: 1 leader_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } } }
I20260812 01:05:07.031328 8704 tablet_replica.cc:442] T dd08288dc58248d18ebfadfd8aa001ed P 95e29c9b83b6439b8cf752b77c874fbb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:05:07.036684 8708 tablet_replica.cc:439] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } } }
I20260812 01:05:07.036986 8708 tablet_replica.cc:442] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e: This TxnStatusTablet replica's current role is: LEADER
I20260812 01:05:07.039546 8708 tablet_replica.cc:439] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } } }
I20260812 01:05:07.039834 8708 tablet_replica.cc:442] T dd08288dc58248d18ebfadfd8aa001ed P 6165e2b1cf7d4e1ab72dbfe2c00b638e: This TxnStatusTablet replica's current role is: LEADER
I20260812 01:05:07.044055 8704 tablet_replica.cc:439] T dd08288dc58248d18ebfadfd8aa001ed P 95e29c9b83b6439b8cf752b77c874fbb: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } } }
I20260812 01:05:07.044320 8704 tablet_replica.cc:442] T dd08288dc58248d18ebfadfd8aa001ed P 95e29c9b83b6439b8cf752b77c874fbb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:05:07.044726 8703 tablet_replica.cc:439] T dd08288dc58248d18ebfadfd8aa001ed P 55ce6b086ff646b4b1f7379551e0be58: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } } }
I20260812 01:05:07.044960 8703 tablet_replica.cc:442] T dd08288dc58248d18ebfadfd8aa001ed P 55ce6b086ff646b4b1f7379551e0be58: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:05:07.053020 8688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:07.048100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38968 (local address 127.4.201.67:45259)
0812 01:05:07.048254 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:07.048261 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:07.048470 (+ 209us) server_negotiation.cc:407] Connection header received
0812 01:05:07.048696 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:07.048702 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:07.048793 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:07.048864 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:05:07.049212 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:07.049981 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:07.051311 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:07.051767 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:07.051885 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:07.052342 (+ 457us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:05:07.052443 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:05:07.052521 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:07.052674 (+ 153us) server_negotiation.cc:299] Negotiation successful
0812 01:05:07.052752 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 01:05:07.068666 8667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:07.063521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:45259 (local address 127.4.201.67:46301)
0812 01:05:07.063743 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:07.063760 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:07.063878 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:07.064142 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:07.064147 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:07.064158 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 01:05:07.064359 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:07.064371 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:07.065550 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:07.065555 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:07.066637 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:07.066654 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:07.067632 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:07.067636 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:07.067745 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:07.067794 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 01:05:07.068220 (+ 426us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 01:05:07.068228 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 01:05:07.068284 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 01:05:07.068391 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":27}
I20260812 01:05:07.068732 8688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:07.063592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:46301 (local address 127.4.201.67:45259)
0812 01:05:07.063740 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:07.063745 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:07.063818 (+ 73us) server_negotiation.cc:407] Connection header received
0812 01:05:07.063989 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:07.063993 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:07.064045 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:07.064116 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:05:07.064491 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:07.065401 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:07.066786 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:07.067484 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:07.067628 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:07.067989 (+ 361us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:05:07.068130 (+ 141us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:05:07.068217 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:07.068328 (+ 111us) server_negotiation.cc:299] Negotiation successful
0812 01:05:07.068403 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":60}
I20260812 01:05:07.077355 8342 raft_consensus.cc:1261] T c49e535624e54021b92bab9ab8d825ae P 95e29c9b83b6439b8cf752b77c874fbb [term 1 FOLLOWER]: Refusing update from remote peer 6165e2b1cf7d4e1ab72dbfe2c00b638e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:07.077440 8109 raft_consensus.cc:1261] T c49e535624e54021b92bab9ab8d825ae P 55ce6b086ff646b4b1f7379551e0be58 [term 1 FOLLOWER]: Refusing update from remote peer 6165e2b1cf7d4e1ab72dbfe2c00b638e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:07.077977 8708 consensus_queue.cc:1035] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e [LEADER]: Connected to new peer: Peer: permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:07.078239 8706 consensus_queue.cc:1035] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e [LEADER]: Connected to new peer: Peer: permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:07.147122 7851 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52664:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:05:07.147399 7851 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52664:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:05:07.150928 7851 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9dcab807a8054690bc118e2aadcda3b2: Sending DeleteTablet for 3 replicas of tablet c49e535624e54021b92bab9ab8d825ae
I20260812 01:05:07.151938 8076 tablet_service.cc:1514] Processing DeleteTablet for tablet c49e535624e54021b92bab9ab8d825ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:07 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:50770
I20260812 01:05:07.152053 8539 tablet_service.cc:1514] Processing DeleteTablet for tablet c49e535624e54021b92bab9ab8d825ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:07 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:38952
I20260812 01:05:07.152442 8305 tablet_service.cc:1514] Processing DeleteTablet for tablet c49e535624e54021b92bab9ab8d825ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:07 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:47670
I20260812 01:05:07.154597 7851 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52664:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:05:07.155262 7851 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:05:07.163961 8074 tablet_service.cc:1467] Processing CreateTablet for tablet d3232231403c4da59a7b2e3e92343420 (DEFAULT_TABLE table=test-table [id=c53d9b7fd1744bb89839df9852506384]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:07.164206 8302 tablet_service.cc:1467] Processing CreateTablet for tablet d3232231403c4da59a7b2e3e92343420 (DEFAULT_TABLE table=test-table [id=c53d9b7fd1744bb89839df9852506384]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:07.164409 8540 tablet_service.cc:1467] Processing CreateTablet for tablet d3232231403c4da59a7b2e3e92343420 (DEFAULT_TABLE table=test-table [id=c53d9b7fd1744bb89839df9852506384]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:07.164768 8074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3232231403c4da59a7b2e3e92343420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:07.164769 8302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3232231403c4da59a7b2e3e92343420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:07.164883 8540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3232231403c4da59a7b2e3e92343420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:07.165978 8777 tablet_replica.cc:330] T c49e535624e54021b92bab9ab8d825ae P 95e29c9b83b6439b8cf752b77c874fbb: stopping tablet replica
I20260812 01:05:07.166405 8777 raft_consensus.cc:2229] T c49e535624e54021b92bab9ab8d825ae P 95e29c9b83b6439b8cf752b77c874fbb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:05:07.166795 8777 raft_consensus.cc:2258] T c49e535624e54021b92bab9ab8d825ae P 95e29c9b83b6439b8cf752b77c874fbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:07.171178 8694 tablet_bootstrap.cc:492] T d3232231403c4da59a7b2e3e92343420 P 55ce6b086ff646b4b1f7379551e0be58: Bootstrap starting.
I20260812 01:05:07.172118 8695 tablet_bootstrap.cc:492] T d3232231403c4da59a7b2e3e92343420 P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Bootstrap starting.
I20260812 01:05:07.172511 8696 tablet_bootstrap.cc:492] T d3232231403c4da59a7b2e3e92343420 P 95e29c9b83b6439b8cf752b77c874fbb: Bootstrap starting.
I20260812 01:05:07.172878 8694 tablet_bootstrap.cc:654] T d3232231403c4da59a7b2e3e92343420 P 55ce6b086ff646b4b1f7379551e0be58: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:07.173709 8695 tablet_bootstrap.cc:654] T d3232231403c4da59a7b2e3e92343420 P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:07.174019 8696 tablet_bootstrap.cc:654] T d3232231403c4da59a7b2e3e92343420 P 95e29c9b83b6439b8cf752b77c874fbb: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:07.174576 8777 ts_tablet_manager.cc:1905] T c49e535624e54021b92bab9ab8d825ae P 95e29c9b83b6439b8cf752b77c874fbb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:07.184250 8772 tablet_replica.cc:330] T c49e535624e54021b92bab9ab8d825ae P 55ce6b086ff646b4b1f7379551e0be58: stopping tablet replica
I20260812 01:05:07.184563 8695 tablet_bootstrap.cc:492] T d3232231403c4da59a7b2e3e92343420 P 6165e2b1cf7d4e1ab72dbfe2c00b638e: No bootstrap required, opened a new log
I20260812 01:05:07.184728 8695 ts_tablet_manager.cc:1397] T d3232231403c4da59a7b2e3e92343420 P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.003s
I20260812 01:05:07.185608 8695 raft_consensus.cc:348] T d3232231403c4da59a7b2e3e92343420 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:07.185920 8695 raft_consensus.cc:374] T d3232231403c4da59a7b2e3e92343420 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:07.186014 8695 raft_consensus.cc:729] T d3232231403c4da59a7b2e3e92343420 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6165e2b1cf7d4e1ab72dbfe2c00b638e, State: Initialized, Role: FOLLOWER
I20260812 01:05:07.186311 8695 consensus_queue.cc:260] T d3232231403c4da59a7b2e3e92343420 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:07.186923 8694 tablet_bootstrap.cc:492] T d3232231403c4da59a7b2e3e92343420 P 55ce6b086ff646b4b1f7379551e0be58: No bootstrap required, opened a new log
I20260812 01:05:07.187127 8694 ts_tablet_manager.cc:1397] T d3232231403c4da59a7b2e3e92343420 P 55ce6b086ff646b4b1f7379551e0be58: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.003s
I20260812 01:05:07.187872 8694 raft_consensus.cc:348] T d3232231403c4da59a7b2e3e92343420 P 55ce6b086ff646b4b1f7379551e0be58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:07.188174 8694 raft_consensus.cc:374] T d3232231403c4da59a7b2e3e92343420 P 55ce6b086ff646b4b1f7379551e0be58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:07.188289 8694 raft_consensus.cc:729] T d3232231403c4da59a7b2e3e92343420 P 55ce6b086ff646b4b1f7379551e0be58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55ce6b086ff646b4b1f7379551e0be58, State: Initialized, Role: FOLLOWER
I20260812 01:05:07.188628 8694 consensus_queue.cc:260] T d3232231403c4da59a7b2e3e92343420 P 55ce6b086ff646b4b1f7379551e0be58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:07.189491 8695 ts_tablet_manager.cc:1428] T d3232231403c4da59a7b2e3e92343420 P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260812 01:05:07.191051 8694 ts_tablet_manager.cc:1428] T d3232231403c4da59a7b2e3e92343420 P 55ce6b086ff646b4b1f7379551e0be58: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260812 01:05:07.191394 8772 raft_consensus.cc:2229] T c49e535624e54021b92bab9ab8d825ae P 55ce6b086ff646b4b1f7379551e0be58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:05:07.192119 8772 raft_consensus.cc:2258] T c49e535624e54021b92bab9ab8d825ae P 55ce6b086ff646b4b1f7379551e0be58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:07.192448 8696 tablet_bootstrap.cc:492] T d3232231403c4da59a7b2e3e92343420 P 95e29c9b83b6439b8cf752b77c874fbb: No bootstrap required, opened a new log
I20260812 01:05:07.192628 8696 ts_tablet_manager.cc:1397] T d3232231403c4da59a7b2e3e92343420 P 95e29c9b83b6439b8cf752b77c874fbb: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.004s
I20260812 01:05:07.193400 8776 tablet_replica.cc:330] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e: stopping tablet replica
I20260812 01:05:07.193449 8696 raft_consensus.cc:348] T d3232231403c4da59a7b2e3e92343420 P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:07.193699 8696 raft_consensus.cc:374] T d3232231403c4da59a7b2e3e92343420 P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:07.193781 8696 raft_consensus.cc:729] T d3232231403c4da59a7b2e3e92343420 P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95e29c9b83b6439b8cf752b77c874fbb, State: Initialized, Role: FOLLOWER
I20260812 01:05:07.194027 8696 consensus_queue.cc:260] T d3232231403c4da59a7b2e3e92343420 P 95e29c9b83b6439b8cf752b77c874fbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:07.194595 8696 ts_tablet_manager.cc:1428] T d3232231403c4da59a7b2e3e92343420 P 95e29c9b83b6439b8cf752b77c874fbb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 01:05:07.195250 8777 ts_tablet_manager.cc:1918] T c49e535624e54021b92bab9ab8d825ae P 95e29c9b83b6439b8cf752b77c874fbb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 01:05:07.195427 8777 log.cc:1196] T c49e535624e54021b92bab9ab8d825ae P 95e29c9b83b6439b8cf752b77c874fbb: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-1/wal/wals/c49e535624e54021b92bab9ab8d825ae
I20260812 01:05:07.195742 8776 raft_consensus.cc:2229] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:05:07.196148 8777 ts_tablet_manager.cc:1939] T c49e535624e54021b92bab9ab8d825ae P 95e29c9b83b6439b8cf752b77c874fbb: Deleting consensus metadata
I20260812 01:05:07.195348 8772 ts_tablet_manager.cc:1905] T c49e535624e54021b92bab9ab8d825ae P 55ce6b086ff646b4b1f7379551e0be58: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:07.197558 8776 raft_consensus.cc:2258] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:07.198910 7826 catalog_manager.cc:4841] TS 95e29c9b83b6439b8cf752b77c874fbb (127.4.201.66:43103): tablet c49e535624e54021b92bab9ab8d825ae (table test-table [id=7ac0878c28eb41ceb521410ac01d44de]) successfully deleted
I20260812 01:05:07.199666 8776 ts_tablet_manager.cc:1905] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:07.206522 8776 ts_tablet_manager.cc:1918] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 01:05:07.206712 8776 log.cc:1196] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-2/wal/wals/c49e535624e54021b92bab9ab8d825ae
I20260812 01:05:07.207134 8772 ts_tablet_manager.cc:1918] T c49e535624e54021b92bab9ab8d825ae P 55ce6b086ff646b4b1f7379551e0be58: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 01:05:07.207264 8776 ts_tablet_manager.cc:1939] T c49e535624e54021b92bab9ab8d825ae P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Deleting consensus metadata
I20260812 01:05:07.207389 8772 log.cc:1196] T c49e535624e54021b92bab9ab8d825ae P 55ce6b086ff646b4b1f7379551e0be58: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-0/wal/wals/c49e535624e54021b92bab9ab8d825ae
I20260812 01:05:07.207931 8772 ts_tablet_manager.cc:1939] T c49e535624e54021b92bab9ab8d825ae P 55ce6b086ff646b4b1f7379551e0be58: Deleting consensus metadata
I20260812 01:05:07.209049 7829 catalog_manager.cc:4841] TS 6165e2b1cf7d4e1ab72dbfe2c00b638e (127.4.201.67:45259): tablet c49e535624e54021b92bab9ab8d825ae (table test-table [id=7ac0878c28eb41ceb521410ac01d44de]) successfully deleted
I20260812 01:05:07.209656 7826 catalog_manager.cc:4841] TS 55ce6b086ff646b4b1f7379551e0be58 (127.4.201.65:38961): tablet c49e535624e54021b92bab9ab8d825ae (table test-table [id=7ac0878c28eb41ceb521410ac01d44de]) successfully deleted
I20260812 01:05:07.431411 8766 raft_consensus.cc:482] T d3232231403c4da59a7b2e3e92343420 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:05:07.431623 8766 raft_consensus.cc:504] T d3232231403c4da59a7b2e3e92343420 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:07.432367 8766 leader_election.cc:288] T d3232231403c4da59a7b2e3e92343420 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55ce6b086ff646b4b1f7379551e0be58 (127.4.201.65:38961), 95e29c9b83b6439b8cf752b77c874fbb (127.4.201.66:43103)
I20260812 01:05:07.433048 8342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3232231403c4da59a7b2e3e92343420" candidate_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95e29c9b83b6439b8cf752b77c874fbb" is_pre_election: true
I20260812 01:05:07.433063 8109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3232231403c4da59a7b2e3e92343420" candidate_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55ce6b086ff646b4b1f7379551e0be58" is_pre_election: true
I20260812 01:05:07.433305 8342 raft_consensus.cc:2454] T d3232231403c4da59a7b2e3e92343420 P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6165e2b1cf7d4e1ab72dbfe2c00b638e in term 0.
I20260812 01:05:07.433364 8109 raft_consensus.cc:2454] T d3232231403c4da59a7b2e3e92343420 P 55ce6b086ff646b4b1f7379551e0be58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6165e2b1cf7d4e1ab72dbfe2c00b638e in term 0.
I20260812 01:05:07.433768 8461 leader_election.cc:302] T d3232231403c4da59a7b2e3e92343420 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6165e2b1cf7d4e1ab72dbfe2c00b638e, 95e29c9b83b6439b8cf752b77c874fbb; no voters:
I20260812 01:05:07.434077 8766 raft_consensus.cc:2781] T d3232231403c4da59a7b2e3e92343420 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:05:07.434197 8766 raft_consensus.cc:482] T d3232231403c4da59a7b2e3e92343420 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:05:07.434302 8766 raft_consensus.cc:3037] T d3232231403c4da59a7b2e3e92343420 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:07.436430 8766 raft_consensus.cc:504] T d3232231403c4da59a7b2e3e92343420 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:07.436966 8766 leader_election.cc:288] T d3232231403c4da59a7b2e3e92343420 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [CANDIDATE]: Term 1 election: Requested vote from peers 55ce6b086ff646b4b1f7379551e0be58 (127.4.201.65:38961), 95e29c9b83b6439b8cf752b77c874fbb (127.4.201.66:43103)
I20260812 01:05:07.437486 8109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3232231403c4da59a7b2e3e92343420" candidate_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55ce6b086ff646b4b1f7379551e0be58"
I20260812 01:05:07.437522 8342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3232231403c4da59a7b2e3e92343420" candidate_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95e29c9b83b6439b8cf752b77c874fbb"
I20260812 01:05:07.437687 8109 raft_consensus.cc:3037] T d3232231403c4da59a7b2e3e92343420 P 55ce6b086ff646b4b1f7379551e0be58 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:07.437686 8342 raft_consensus.cc:3037] T d3232231403c4da59a7b2e3e92343420 P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:07.439749 8342 raft_consensus.cc:2454] T d3232231403c4da59a7b2e3e92343420 P 95e29c9b83b6439b8cf752b77c874fbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6165e2b1cf7d4e1ab72dbfe2c00b638e in term 1.
I20260812 01:05:07.440176 8461 leader_election.cc:302] T d3232231403c4da59a7b2e3e92343420 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6165e2b1cf7d4e1ab72dbfe2c00b638e, 95e29c9b83b6439b8cf752b77c874fbb; no voters:
I20260812 01:05:07.440496 8766 raft_consensus.cc:2781] T d3232231403c4da59a7b2e3e92343420 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:05:07.440760 8109 raft_consensus.cc:2454] T d3232231403c4da59a7b2e3e92343420 P 55ce6b086ff646b4b1f7379551e0be58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6165e2b1cf7d4e1ab72dbfe2c00b638e in term 1.
I20260812 01:05:07.440663 8766 raft_consensus.cc:686] T d3232231403c4da59a7b2e3e92343420 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 1 LEADER]: Becoming Leader. State: Replica: 6165e2b1cf7d4e1ab72dbfe2c00b638e, State: Running, Role: LEADER
I20260812 01:05:07.441180 8766 consensus_queue.cc:237] T d3232231403c4da59a7b2e3e92343420 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:07.443863 7849 catalog_manager.cc:5495] T d3232231403c4da59a7b2e3e92343420 P 6165e2b1cf7d4e1ab72dbfe2c00b638e reported cstate change: term changed from 0 to 1, leader changed from <none> to 6165e2b1cf7d4e1ab72dbfe2c00b638e (127.4.201.67). New cstate: current_term: 1 leader_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } health_report { overall_health: HEALTHY } } }
I20260812 01:05:07.485702 8342 raft_consensus.cc:1261] T d3232231403c4da59a7b2e3e92343420 P 95e29c9b83b6439b8cf752b77c874fbb [term 1 FOLLOWER]: Refusing update from remote peer 6165e2b1cf7d4e1ab72dbfe2c00b638e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:07.485769 8108 raft_consensus.cc:1261] T d3232231403c4da59a7b2e3e92343420 P 55ce6b086ff646b4b1f7379551e0be58 [term 1 FOLLOWER]: Refusing update from remote peer 6165e2b1cf7d4e1ab72dbfe2c00b638e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:07.486282 8767 consensus_queue.cc:1035] T d3232231403c4da59a7b2e3e92343420 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [LEADER]: Connected to new peer: Peer: permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:07.486655 8706 consensus_queue.cc:1035] T d3232231403c4da59a7b2e3e92343420 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [LEADER]: Connected to new peer: Peer: permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:07.490865 8738 mvcc.cc:205] Tried to move back new op lower bound from 7317490513856385024 to 7317490513681383424. Current Snapshot: MvccSnapshot[applied={T|T < 7317490513856385024}]
I20260812 01:05:07.494498 8742 mvcc.cc:205] Tried to move back new op lower bound from 7317490513856385024 to 7317490513681383424. Current Snapshot: MvccSnapshot[applied={T|T < 7317490513856385024}]
W20260812 01:05:07.511049 8738 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 01:05:09.092371 7851 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52664:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:05:09.092597 7851 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52664:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:05:09.096505 7851 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9dcab807a8054690bc118e2aadcda3b2: Sending DeleteTablet for 3 replicas of tablet d3232231403c4da59a7b2e3e92343420
I20260812 01:05:09.097302 8539 tablet_service.cc:1514] Processing DeleteTablet for tablet d3232231403c4da59a7b2e3e92343420 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:09 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:38952
I20260812 01:05:09.097355 8076 tablet_service.cc:1514] Processing DeleteTablet for tablet d3232231403c4da59a7b2e3e92343420 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:09 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:50770
I20260812 01:05:09.097536 8302 tablet_service.cc:1514] Processing DeleteTablet for tablet d3232231403c4da59a7b2e3e92343420 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:09 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:47670
I20260812 01:05:09.107266 8822 tablet_replica.cc:330] T d3232231403c4da59a7b2e3e92343420 P 6165e2b1cf7d4e1ab72dbfe2c00b638e: stopping tablet replica
I20260812 01:05:09.107511 8822 raft_consensus.cc:2229] T d3232231403c4da59a7b2e3e92343420 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:05:09.107908 8822 raft_consensus.cc:2258] T d3232231403c4da59a7b2e3e92343420 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:09.109040 8822 ts_tablet_manager.cc:1905] T d3232231403c4da59a7b2e3e92343420 P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:09.110044 8826 tablet_replica.cc:330] T d3232231403c4da59a7b2e3e92343420 P 95e29c9b83b6439b8cf752b77c874fbb: stopping tablet replica
I20260812 01:05:09.110236 8826 raft_consensus.cc:2229] T d3232231403c4da59a7b2e3e92343420 P 95e29c9b83b6439b8cf752b77c874fbb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:05:09.110473 8826 raft_consensus.cc:2258] T d3232231403c4da59a7b2e3e92343420 P 95e29c9b83b6439b8cf752b77c874fbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:09.112169 8826 ts_tablet_manager.cc:1905] T d3232231403c4da59a7b2e3e92343420 P 95e29c9b83b6439b8cf752b77c874fbb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:09.112468 8825 tablet_replica.cc:330] T d3232231403c4da59a7b2e3e92343420 P 55ce6b086ff646b4b1f7379551e0be58: stopping tablet replica
I20260812 01:05:09.112659 8825 raft_consensus.cc:2229] T d3232231403c4da59a7b2e3e92343420 P 55ce6b086ff646b4b1f7379551e0be58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:05:09.112884 8825 raft_consensus.cc:2258] T d3232231403c4da59a7b2e3e92343420 P 55ce6b086ff646b4b1f7379551e0be58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:09.113881 8825 ts_tablet_manager.cc:1905] T d3232231403c4da59a7b2e3e92343420 P 55ce6b086ff646b4b1f7379551e0be58: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:09.115885 8822 ts_tablet_manager.cc:1918] T d3232231403c4da59a7b2e3e92343420 P 6165e2b1cf7d4e1ab72dbfe2c00b638e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 01:05:09.116031 8822 log.cc:1196] T d3232231403c4da59a7b2e3e92343420 P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-2/wal/wals/d3232231403c4da59a7b2e3e92343420
I20260812 01:05:09.116542 8822 ts_tablet_manager.cc:1939] T d3232231403c4da59a7b2e3e92343420 P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Deleting consensus metadata
I20260812 01:05:09.117724 7829 catalog_manager.cc:4841] TS 6165e2b1cf7d4e1ab72dbfe2c00b638e (127.4.201.67:45259): tablet d3232231403c4da59a7b2e3e92343420 (table test-table [id=c53d9b7fd1744bb89839df9852506384]) successfully deleted
I20260812 01:05:09.118920 8826 ts_tablet_manager.cc:1918] T d3232231403c4da59a7b2e3e92343420 P 95e29c9b83b6439b8cf752b77c874fbb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 01:05:09.119051 8826 log.cc:1196] T d3232231403c4da59a7b2e3e92343420 P 95e29c9b83b6439b8cf752b77c874fbb: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-1/wal/wals/d3232231403c4da59a7b2e3e92343420
I20260812 01:05:09.119467 8826 ts_tablet_manager.cc:1939] T d3232231403c4da59a7b2e3e92343420 P 95e29c9b83b6439b8cf752b77c874fbb: Deleting consensus metadata
I20260812 01:05:09.120399 7826 catalog_manager.cc:4841] TS 95e29c9b83b6439b8cf752b77c874fbb (127.4.201.66:43103): tablet d3232231403c4da59a7b2e3e92343420 (table test-table [id=c53d9b7fd1744bb89839df9852506384]) successfully deleted
I20260812 01:05:09.120527 8825 ts_tablet_manager.cc:1918] T d3232231403c4da59a7b2e3e92343420 P 55ce6b086ff646b4b1f7379551e0be58: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 01:05:09.120668 8825 log.cc:1196] T d3232231403c4da59a7b2e3e92343420 P 55ce6b086ff646b4b1f7379551e0be58: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-0/wal/wals/d3232231403c4da59a7b2e3e92343420
I20260812 01:05:09.121070 8825 ts_tablet_manager.cc:1939] T d3232231403c4da59a7b2e3e92343420 P 55ce6b086ff646b4b1f7379551e0be58: Deleting consensus metadata
I20260812 01:05:09.122466 7826 catalog_manager.cc:4841] TS 55ce6b086ff646b4b1f7379551e0be58 (127.4.201.65:38961): tablet d3232231403c4da59a7b2e3e92343420 (table test-table [id=c53d9b7fd1744bb89839df9852506384]) successfully deleted
Aug 12 01:05:09 dist-test-slave-bndk krb5kdc[7767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496709, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 01:05:09 dist-test-slave-bndk krb5kdc[7767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496709, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:09.162050 8839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:09.147146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52690 (local address 127.4.201.126:45137)
0812 01:05:09.147939 (+ 793us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:09.147944 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:09.147966 (+ 22us) server_negotiation.cc:407] Connection header received
0812 01:05:09.148032 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:09.148036 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:09.148095 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:09.148189 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:09.149529 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:09.150303 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:09.151552 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:09.151938 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:09.152041 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:09.156055 (+ 4014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:09.156062 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:09.156068 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:09.156109 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:09.159290 (+ 3181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:09.159900 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:09.159905 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:09.159910 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:09.160072 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:09.160515 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:09.160520 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:09.160524 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:09.160872 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:09.161130 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:09.161445 (+ 315us) server_negotiation.cc:299] Negotiation successful
0812 01:05:09.161669 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":675,"thread_start_us":517,"threads_started":1}
I20260812 01:05:09.165676 7851 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52690:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:05:09.166400 7851 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:05:09.173485 8302 tablet_service.cc:1467] Processing CreateTablet for tablet 23f7ad00a54d448bbbbbb9b9e23bbf31 (DEFAULT_TABLE table=test-table [id=8ff4f2f7868c44fc8445914b0bf33923]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:09.173482 8076 tablet_service.cc:1467] Processing CreateTablet for tablet 23f7ad00a54d448bbbbbb9b9e23bbf31 (DEFAULT_TABLE table=test-table [id=8ff4f2f7868c44fc8445914b0bf33923]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:09.173924 8076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23f7ad00a54d448bbbbbb9b9e23bbf31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:09.173926 8302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23f7ad00a54d448bbbbbb9b9e23bbf31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:09.173856 8539 tablet_service.cc:1467] Processing CreateTablet for tablet 23f7ad00a54d448bbbbbb9b9e23bbf31 (DEFAULT_TABLE table=test-table [id=8ff4f2f7868c44fc8445914b0bf33923]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:09.174293 8539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23f7ad00a54d448bbbbbb9b9e23bbf31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:09.179416 8840 tablet_bootstrap.cc:492] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 95e29c9b83b6439b8cf752b77c874fbb: Bootstrap starting.
I20260812 01:05:09.180719 8841 tablet_bootstrap.cc:492] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 55ce6b086ff646b4b1f7379551e0be58: Bootstrap starting.
I20260812 01:05:09.181613 8842 tablet_bootstrap.cc:492] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Bootstrap starting.
I20260812 01:05:09.182063 8840 tablet_bootstrap.cc:654] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 95e29c9b83b6439b8cf752b77c874fbb: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:09.182338 8841 tablet_bootstrap.cc:654] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 55ce6b086ff646b4b1f7379551e0be58: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:09.183449 8842 tablet_bootstrap.cc:654] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:09.184201 8840 tablet_bootstrap.cc:492] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 95e29c9b83b6439b8cf752b77c874fbb: No bootstrap required, opened a new log
I20260812 01:05:09.184347 8840 ts_tablet_manager.cc:1397] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 95e29c9b83b6439b8cf752b77c874fbb: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260812 01:05:09.184549 8841 tablet_bootstrap.cc:492] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 55ce6b086ff646b4b1f7379551e0be58: No bootstrap required, opened a new log
I20260812 01:05:09.184681 8841 ts_tablet_manager.cc:1397] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 55ce6b086ff646b4b1f7379551e0be58: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260812 01:05:09.185177 8840 raft_consensus.cc:348] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:09.185578 8840 raft_consensus.cc:374] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:09.185437 8841 raft_consensus.cc:348] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 55ce6b086ff646b4b1f7379551e0be58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:09.185664 8841 raft_consensus.cc:374] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 55ce6b086ff646b4b1f7379551e0be58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:09.185669 8840 raft_consensus.cc:729] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95e29c9b83b6439b8cf752b77c874fbb, State: Initialized, Role: FOLLOWER
I20260812 01:05:09.185746 8841 raft_consensus.cc:729] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 55ce6b086ff646b4b1f7379551e0be58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55ce6b086ff646b4b1f7379551e0be58, State: Initialized, Role: FOLLOWER
I20260812 01:05:09.185943 8841 consensus_queue.cc:260] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 55ce6b086ff646b4b1f7379551e0be58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:09.185943 8840 consensus_queue.cc:260] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 95e29c9b83b6439b8cf752b77c874fbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:09.186705 8842 tablet_bootstrap.cc:492] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 6165e2b1cf7d4e1ab72dbfe2c00b638e: No bootstrap required, opened a new log
I20260812 01:05:09.186857 8842 ts_tablet_manager.cc:1397] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260812 01:05:09.186887 8840 ts_tablet_manager.cc:1428] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 95e29c9b83b6439b8cf752b77c874fbb: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 01:05:09.187059 8841 ts_tablet_manager.cc:1428] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 55ce6b086ff646b4b1f7379551e0be58: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 01:05:09.187590 8842 raft_consensus.cc:348] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:09.187857 8842 raft_consensus.cc:374] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:09.187979 8842 raft_consensus.cc:729] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6165e2b1cf7d4e1ab72dbfe2c00b638e, State: Initialized, Role: FOLLOWER
I20260812 01:05:09.188246 8842 consensus_queue.cc:260] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:09.188831 8842 ts_tablet_manager.cc:1428] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260812 01:05:09.206408 8848 raft_consensus.cc:482] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:05:09.206624 8848 raft_consensus.cc:504] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:09.207549 8848 leader_election.cc:288] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 95e29c9b83b6439b8cf752b77c874fbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55ce6b086ff646b4b1f7379551e0be58 (127.4.201.65:38961), 6165e2b1cf7d4e1ab72dbfe2c00b638e (127.4.201.67:45259)
I20260812 01:05:09.207825 8109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23f7ad00a54d448bbbbbb9b9e23bbf31" candidate_uuid: "95e29c9b83b6439b8cf752b77c874fbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55ce6b086ff646b4b1f7379551e0be58" is_pre_election: true
I20260812 01:05:09.207831 8577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23f7ad00a54d448bbbbbb9b9e23bbf31" candidate_uuid: "95e29c9b83b6439b8cf752b77c874fbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" is_pre_election: true
I20260812 01:05:09.208092 8109 raft_consensus.cc:2454] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 55ce6b086ff646b4b1f7379551e0be58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95e29c9b83b6439b8cf752b77c874fbb in term 0.
I20260812 01:05:09.208141 8577 raft_consensus.cc:2454] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95e29c9b83b6439b8cf752b77c874fbb in term 0.
I20260812 01:05:09.208567 8227 leader_election.cc:302] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 95e29c9b83b6439b8cf752b77c874fbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55ce6b086ff646b4b1f7379551e0be58, 95e29c9b83b6439b8cf752b77c874fbb; no voters:
I20260812 01:05:09.208827 8848 raft_consensus.cc:2781] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:05:09.208937 8848 raft_consensus.cc:482] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:05:09.209021 8848 raft_consensus.cc:3037] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:09.211239 8848 raft_consensus.cc:504] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 95e29c9b83b6439b8cf752b77c874fbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:09.211753 8848 leader_election.cc:288] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 95e29c9b83b6439b8cf752b77c874fbb [CANDIDATE]: Term 1 election: Requested vote from peers 55ce6b086ff646b4b1f7379551e0be58 (127.4.201.65:38961), 6165e2b1cf7d4e1ab72dbfe2c00b638e (127.4.201.67:45259)
I20260812 01:05:09.212184 8109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23f7ad00a54d448bbbbbb9b9e23bbf31" candidate_uuid: "95e29c9b83b6439b8cf752b77c874fbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55ce6b086ff646b4b1f7379551e0be58"
I20260812 01:05:09.212249 8577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23f7ad00a54d448bbbbbb9b9e23bbf31" candidate_uuid: "95e29c9b83b6439b8cf752b77c874fbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e"
I20260812 01:05:09.212369 8109 raft_consensus.cc:3037] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 55ce6b086ff646b4b1f7379551e0be58 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:09.212473 8577 raft_consensus.cc:3037] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:09.214416 8109 raft_consensus.cc:2454] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 55ce6b086ff646b4b1f7379551e0be58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95e29c9b83b6439b8cf752b77c874fbb in term 1.
I20260812 01:05:09.214684 8577 raft_consensus.cc:2454] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95e29c9b83b6439b8cf752b77c874fbb in term 1.
I20260812 01:05:09.214809 8227 leader_election.cc:302] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 95e29c9b83b6439b8cf752b77c874fbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55ce6b086ff646b4b1f7379551e0be58, 95e29c9b83b6439b8cf752b77c874fbb; no voters:
I20260812 01:05:09.215142 8848 raft_consensus.cc:2781] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 95e29c9b83b6439b8cf752b77c874fbb [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:05:09.215615 8848 raft_consensus.cc:686] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 95e29c9b83b6439b8cf752b77c874fbb [term 1 LEADER]: Becoming Leader. State: Replica: 95e29c9b83b6439b8cf752b77c874fbb, State: Running, Role: LEADER
I20260812 01:05:09.216051 8848 consensus_queue.cc:237] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 95e29c9b83b6439b8cf752b77c874fbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:09.219300 7851 catalog_manager.cc:5495] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 95e29c9b83b6439b8cf752b77c874fbb reported cstate change: term changed from 0 to 1, leader changed from <none> to 95e29c9b83b6439b8cf752b77c874fbb (127.4.201.66). New cstate: current_term: 1 leader_uuid: "95e29c9b83b6439b8cf752b77c874fbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } health_report { overall_health: UNKNOWN } } }
I20260812 01:05:09.243029 8853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:09.237827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47676 (local address 127.4.201.66:43103)
0812 01:05:09.238315 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:09.238320 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:09.238341 (+ 21us) server_negotiation.cc:407] Connection header received
0812 01:05:09.238419 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:09.238423 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:09.238510 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:09.238645 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:05:09.238954 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:09.239717 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:09.241018 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:09.241477 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:09.241573 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:09.241926 (+ 353us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:05:09.242499 (+ 573us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:05:09.242604 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:09.242645 (+ 41us) server_negotiation.cc:299] Negotiation successful
0812 01:05:09.242706 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":263,"threads_started":1}
I20260812 01:05:09.257597 8859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:09.252007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:45259 (local address 127.4.201.66:60857)
0812 01:05:09.252702 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:09.252716 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:09.252847 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:09.253147 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:09.253152 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:09.253163 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 01:05:09.253504 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:09.253514 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:09.254533 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:09.254539 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:09.255605 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:09.255618 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:09.256333 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:09.256340 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:09.256539 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:09.256599 (+ 60us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 01:05:09.257007 (+ 408us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 01:05:09.257018 (+ 11us) client_negotiation.cc:769] Sending connection context
0812 01:05:09.257085 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 01:05:09.257210 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":360,"threads_started":1}
I20260812 01:05:09.257668 8858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:09.252041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:60857 (local address 127.4.201.67:45259)
0812 01:05:09.252610 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:09.252617 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:09.252787 (+ 170us) server_negotiation.cc:407] Connection header received
0812 01:05:09.252967 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:09.252972 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:09.253037 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:09.253120 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:05:09.253665 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:09.254402 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:09.255741 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:09.256171 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:09.256282 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:09.256790 (+ 508us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:05:09.256901 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:05:09.256977 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:09.257116 (+ 139us) server_negotiation.cc:299] Negotiation successful
0812 01:05:09.257194 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":286,"threads_started":1}
I20260812 01:05:09.265108 8109 raft_consensus.cc:1261] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 55ce6b086ff646b4b1f7379551e0be58 [term 1 FOLLOWER]: Refusing update from remote peer 95e29c9b83b6439b8cf752b77c874fbb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:09.265257 8577 raft_consensus.cc:1261] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 1 FOLLOWER]: Refusing update from remote peer 95e29c9b83b6439b8cf752b77c874fbb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:09.265765 8849 consensus_queue.cc:1035] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 95e29c9b83b6439b8cf752b77c874fbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:09.266148 8848 consensus_queue.cc:1035] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 95e29c9b83b6439b8cf752b77c874fbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:09.296413 8853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:09.290584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:40381 (local address 127.4.201.66:43103)
0812 01:05:09.290760 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:09.290767 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:09.291264 (+ 497us) server_negotiation.cc:407] Connection header received
0812 01:05:09.291411 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:09.291415 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:09.291483 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:09.291551 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:05:09.292061 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:09.293021 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:09.294490 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:09.294983 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:09.295078 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:09.295646 (+ 568us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:05:09.295791 (+ 145us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:05:09.295880 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:09.296070 (+ 190us) server_negotiation.cc:299] Negotiation successful
0812 01:05:09.296167 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 01:05:09.296667 8866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:09.290559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:43103 (local address 127.4.201.67:40381)
0812 01:05:09.291173 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:09.291193 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:09.291315 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:09.291556 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:09.291559 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:09.291567 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 01:05:09.291908 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:09.291919 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:09.293159 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:09.293165 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:09.294346 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:09.294360 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:09.295124 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:09.295129 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:09.295273 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:09.295323 (+ 50us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 01:05:09.295898 (+ 575us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 01:05:09.295911 (+ 13us) client_negotiation.cc:769] Sending connection context
0812 01:05:09.296056 (+ 145us) client_negotiation.cc:240] Negotiation successful
0812 01:05:09.296220 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":363,"threads_started":1}
I20260812 01:05:09.325773 7851 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52690:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:05:09.326032 7851 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52690:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:05:09.329170 7851 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9dcab807a8054690bc118e2aadcda3b2: Sending DeleteTablet for 3 replicas of tablet 23f7ad00a54d448bbbbbb9b9e23bbf31
I20260812 01:05:09.329900 8076 tablet_service.cc:1514] Processing DeleteTablet for tablet 23f7ad00a54d448bbbbbb9b9e23bbf31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:09 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:50770
I20260812 01:05:09.329989 8302 tablet_service.cc:1514] Processing DeleteTablet for tablet 23f7ad00a54d448bbbbbb9b9e23bbf31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:09 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:47670
I20260812 01:05:09.330178 8825 tablet_replica.cc:330] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 55ce6b086ff646b4b1f7379551e0be58: stopping tablet replica
I20260812 01:05:09.330259 8826 tablet_replica.cc:330] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 95e29c9b83b6439b8cf752b77c874fbb: stopping tablet replica
I20260812 01:05:09.330376 8825 raft_consensus.cc:2229] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 55ce6b086ff646b4b1f7379551e0be58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:05:09.330457 8826 raft_consensus.cc:2229] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 95e29c9b83b6439b8cf752b77c874fbb [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:05:09.330572 8825 raft_consensus.cc:2258] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 55ce6b086ff646b4b1f7379551e0be58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:09.330937 8826 raft_consensus.cc:2258] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 95e29c9b83b6439b8cf752b77c874fbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:09.330962 7851 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52690:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:05:09.331606 7851 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:05:09.332195 8825 ts_tablet_manager.cc:1905] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 55ce6b086ff646b4b1f7379551e0be58: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:09.332492 8826 ts_tablet_manager.cc:1905] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 95e29c9b83b6439b8cf752b77c874fbb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:09.337466 8539 tablet_service.cc:1514] Processing DeleteTablet for tablet 23f7ad00a54d448bbbbbb9b9e23bbf31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:09 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:38952
I20260812 01:05:09.337795 8822 tablet_replica.cc:330] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 6165e2b1cf7d4e1ab72dbfe2c00b638e: stopping tablet replica
I20260812 01:05:09.338003 8822 raft_consensus.cc:2229] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:05:09.338181 8822 raft_consensus.cc:2258] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:09.338752 8826 ts_tablet_manager.cc:1918] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 95e29c9b83b6439b8cf752b77c874fbb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 01:05:09.338912 8826 log.cc:1196] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 95e29c9b83b6439b8cf752b77c874fbb: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-1/wal/wals/23f7ad00a54d448bbbbbb9b9e23bbf31
I20260812 01:05:09.339449 8826 ts_tablet_manager.cc:1939] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 95e29c9b83b6439b8cf752b77c874fbb: Deleting consensus metadata
I20260812 01:05:09.340139 8822 ts_tablet_manager.cc:1905] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:09.340373 8825 ts_tablet_manager.cc:1918] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 55ce6b086ff646b4b1f7379551e0be58: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 01:05:09.340595 8825 log.cc:1196] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 55ce6b086ff646b4b1f7379551e0be58: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-0/wal/wals/23f7ad00a54d448bbbbbb9b9e23bbf31
I20260812 01:05:09.340574 7826 catalog_manager.cc:4841] TS 95e29c9b83b6439b8cf752b77c874fbb (127.4.201.66:43103): tablet 23f7ad00a54d448bbbbbb9b9e23bbf31 (table test-table [id=8ff4f2f7868c44fc8445914b0bf33923]) successfully deleted
I20260812 01:05:09.341005 8825 ts_tablet_manager.cc:1939] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 55ce6b086ff646b4b1f7379551e0be58: Deleting consensus metadata
I20260812 01:05:09.342074 7826 catalog_manager.cc:4841] TS 55ce6b086ff646b4b1f7379551e0be58 (127.4.201.65:38961): tablet 23f7ad00a54d448bbbbbb9b9e23bbf31 (table test-table [id=8ff4f2f7868c44fc8445914b0bf33923]) successfully deleted
I20260812 01:05:09.344291 8076 tablet_service.cc:1467] Processing CreateTablet for tablet 65c7e3def57d4b0782ddae6355dd4b14 (DEFAULT_TABLE table=test-table [id=5e8b8afe0d734028a4ba215b9e4f5812]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:09.344719 8076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65c7e3def57d4b0782ddae6355dd4b14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:09.344689 8539 tablet_service.cc:1467] Processing CreateTablet for tablet 65c7e3def57d4b0782ddae6355dd4b14 (DEFAULT_TABLE table=test-table [id=5e8b8afe0d734028a4ba215b9e4f5812]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:09.344815 8302 tablet_service.cc:1467] Processing CreateTablet for tablet 65c7e3def57d4b0782ddae6355dd4b14 (DEFAULT_TABLE table=test-table [id=5e8b8afe0d734028a4ba215b9e4f5812]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:09.345093 8539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65c7e3def57d4b0782ddae6355dd4b14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:09.345204 8302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65c7e3def57d4b0782ddae6355dd4b14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:09.350956 8842 tablet_bootstrap.cc:492] T 65c7e3def57d4b0782ddae6355dd4b14 P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Bootstrap starting.
I20260812 01:05:09.352799 8842 tablet_bootstrap.cc:654] T 65c7e3def57d4b0782ddae6355dd4b14 P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:09.353375 8840 tablet_bootstrap.cc:492] T 65c7e3def57d4b0782ddae6355dd4b14 P 95e29c9b83b6439b8cf752b77c874fbb: Bootstrap starting.
I20260812 01:05:09.354503 8822 ts_tablet_manager.cc:1918] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 6165e2b1cf7d4e1ab72dbfe2c00b638e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 01:05:09.354647 8822 log.cc:1196] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-2/wal/wals/23f7ad00a54d448bbbbbb9b9e23bbf31
I20260812 01:05:09.355118 8840 tablet_bootstrap.cc:654] T 65c7e3def57d4b0782ddae6355dd4b14 P 95e29c9b83b6439b8cf752b77c874fbb: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:09.355136 8822 ts_tablet_manager.cc:1939] T 23f7ad00a54d448bbbbbb9b9e23bbf31 P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Deleting consensus metadata
I20260812 01:05:09.356151 7829 catalog_manager.cc:4841] TS 6165e2b1cf7d4e1ab72dbfe2c00b638e (127.4.201.67:45259): tablet 23f7ad00a54d448bbbbbb9b9e23bbf31 (table test-table [id=8ff4f2f7868c44fc8445914b0bf33923]) successfully deleted
I20260812 01:05:09.356607 8841 tablet_bootstrap.cc:492] T 65c7e3def57d4b0782ddae6355dd4b14 P 55ce6b086ff646b4b1f7379551e0be58: Bootstrap starting.
I20260812 01:05:09.358309 8841 tablet_bootstrap.cc:654] T 65c7e3def57d4b0782ddae6355dd4b14 P 55ce6b086ff646b4b1f7379551e0be58: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:09.362141 8841 tablet_bootstrap.cc:492] T 65c7e3def57d4b0782ddae6355dd4b14 P 55ce6b086ff646b4b1f7379551e0be58: No bootstrap required, opened a new log
I20260812 01:05:09.362310 8841 ts_tablet_manager.cc:1397] T 65c7e3def57d4b0782ddae6355dd4b14 P 55ce6b086ff646b4b1f7379551e0be58: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.003s
I20260812 01:05:09.362643 8840 tablet_bootstrap.cc:492] T 65c7e3def57d4b0782ddae6355dd4b14 P 95e29c9b83b6439b8cf752b77c874fbb: No bootstrap required, opened a new log
I20260812 01:05:09.362818 8840 ts_tablet_manager.cc:1397] T 65c7e3def57d4b0782ddae6355dd4b14 P 95e29c9b83b6439b8cf752b77c874fbb: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.004s
I20260812 01:05:09.363260 8841 raft_consensus.cc:348] T 65c7e3def57d4b0782ddae6355dd4b14 P 55ce6b086ff646b4b1f7379551e0be58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:09.363552 8841 raft_consensus.cc:374] T 65c7e3def57d4b0782ddae6355dd4b14 P 55ce6b086ff646b4b1f7379551e0be58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:09.363649 8841 raft_consensus.cc:729] T 65c7e3def57d4b0782ddae6355dd4b14 P 55ce6b086ff646b4b1f7379551e0be58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55ce6b086ff646b4b1f7379551e0be58, State: Initialized, Role: FOLLOWER
I20260812 01:05:09.364005 8841 consensus_queue.cc:260] T 65c7e3def57d4b0782ddae6355dd4b14 P 55ce6b086ff646b4b1f7379551e0be58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:09.364655 8841 ts_tablet_manager.cc:1428] T 65c7e3def57d4b0782ddae6355dd4b14 P 55ce6b086ff646b4b1f7379551e0be58: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260812 01:05:09.365563 8840 raft_consensus.cc:348] T 65c7e3def57d4b0782ddae6355dd4b14 P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:09.365818 8840 raft_consensus.cc:374] T 65c7e3def57d4b0782ddae6355dd4b14 P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:09.365907 8840 raft_consensus.cc:729] T 65c7e3def57d4b0782ddae6355dd4b14 P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95e29c9b83b6439b8cf752b77c874fbb, State: Initialized, Role: FOLLOWER
I20260812 01:05:09.366173 8840 consensus_queue.cc:260] T 65c7e3def57d4b0782ddae6355dd4b14 P 95e29c9b83b6439b8cf752b77c874fbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:09.366845 8840 ts_tablet_manager.cc:1428] T 65c7e3def57d4b0782ddae6355dd4b14 P 95e29c9b83b6439b8cf752b77c874fbb: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260812 01:05:09.372877 8842 tablet_bootstrap.cc:492] T 65c7e3def57d4b0782ddae6355dd4b14 P 6165e2b1cf7d4e1ab72dbfe2c00b638e: No bootstrap required, opened a new log
I20260812 01:05:09.373128 8842 ts_tablet_manager.cc:1397] T 65c7e3def57d4b0782ddae6355dd4b14 P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.010s
I20260812 01:05:09.373926 8842 raft_consensus.cc:348] T 65c7e3def57d4b0782ddae6355dd4b14 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:09.374132 8842 raft_consensus.cc:374] T 65c7e3def57d4b0782ddae6355dd4b14 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:09.374217 8842 raft_consensus.cc:729] T 65c7e3def57d4b0782ddae6355dd4b14 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6165e2b1cf7d4e1ab72dbfe2c00b638e, State: Initialized, Role: FOLLOWER
I20260812 01:05:09.374456 8842 consensus_queue.cc:260] T 65c7e3def57d4b0782ddae6355dd4b14 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:09.374969 8842 ts_tablet_manager.cc:1428] T 65c7e3def57d4b0782ddae6355dd4b14 P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260812 01:05:09.738293 8849 raft_consensus.cc:482] T 65c7e3def57d4b0782ddae6355dd4b14 P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:05:09.738523 8849 raft_consensus.cc:504] T 65c7e3def57d4b0782ddae6355dd4b14 P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:09.739148 8849 leader_election.cc:288] T 65c7e3def57d4b0782ddae6355dd4b14 P 95e29c9b83b6439b8cf752b77c874fbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55ce6b086ff646b4b1f7379551e0be58 (127.4.201.65:38961), 6165e2b1cf7d4e1ab72dbfe2c00b638e (127.4.201.67:45259)
I20260812 01:05:09.739749 8109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65c7e3def57d4b0782ddae6355dd4b14" candidate_uuid: "95e29c9b83b6439b8cf752b77c874fbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55ce6b086ff646b4b1f7379551e0be58" is_pre_election: true
I20260812 01:05:09.739799 8577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65c7e3def57d4b0782ddae6355dd4b14" candidate_uuid: "95e29c9b83b6439b8cf752b77c874fbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" is_pre_election: true
I20260812 01:05:09.740002 8109 raft_consensus.cc:2454] T 65c7e3def57d4b0782ddae6355dd4b14 P 55ce6b086ff646b4b1f7379551e0be58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95e29c9b83b6439b8cf752b77c874fbb in term 0.
I20260812 01:05:09.740089 8577 raft_consensus.cc:2454] T 65c7e3def57d4b0782ddae6355dd4b14 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95e29c9b83b6439b8cf752b77c874fbb in term 0.
I20260812 01:05:09.740448 8227 leader_election.cc:302] T 65c7e3def57d4b0782ddae6355dd4b14 P 95e29c9b83b6439b8cf752b77c874fbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55ce6b086ff646b4b1f7379551e0be58, 95e29c9b83b6439b8cf752b77c874fbb; no voters:
I20260812 01:05:09.740747 8849 raft_consensus.cc:2781] T 65c7e3def57d4b0782ddae6355dd4b14 P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:05:09.740842 8849 raft_consensus.cc:482] T 65c7e3def57d4b0782ddae6355dd4b14 P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:05:09.740957 8849 raft_consensus.cc:3037] T 65c7e3def57d4b0782ddae6355dd4b14 P 95e29c9b83b6439b8cf752b77c874fbb [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:09.743012 8849 raft_consensus.cc:504] T 65c7e3def57d4b0782ddae6355dd4b14 P 95e29c9b83b6439b8cf752b77c874fbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:09.743530 8849 leader_election.cc:288] T 65c7e3def57d4b0782ddae6355dd4b14 P 95e29c9b83b6439b8cf752b77c874fbb [CANDIDATE]: Term 1 election: Requested vote from peers 55ce6b086ff646b4b1f7379551e0be58 (127.4.201.65:38961), 6165e2b1cf7d4e1ab72dbfe2c00b638e (127.4.201.67:45259)
I20260812 01:05:09.743978 8577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65c7e3def57d4b0782ddae6355dd4b14" candidate_uuid: "95e29c9b83b6439b8cf752b77c874fbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e"
I20260812 01:05:09.743980 8109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65c7e3def57d4b0782ddae6355dd4b14" candidate_uuid: "95e29c9b83b6439b8cf752b77c874fbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55ce6b086ff646b4b1f7379551e0be58"
I20260812 01:05:09.744191 8109 raft_consensus.cc:3037] T 65c7e3def57d4b0782ddae6355dd4b14 P 55ce6b086ff646b4b1f7379551e0be58 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:09.744191 8577 raft_consensus.cc:3037] T 65c7e3def57d4b0782ddae6355dd4b14 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:09.747041 8577 raft_consensus.cc:2454] T 65c7e3def57d4b0782ddae6355dd4b14 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95e29c9b83b6439b8cf752b77c874fbb in term 1.
I20260812 01:05:09.747087 8109 raft_consensus.cc:2454] T 65c7e3def57d4b0782ddae6355dd4b14 P 55ce6b086ff646b4b1f7379551e0be58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95e29c9b83b6439b8cf752b77c874fbb in term 1.
I20260812 01:05:09.747449 8229 leader_election.cc:302] T 65c7e3def57d4b0782ddae6355dd4b14 P 95e29c9b83b6439b8cf752b77c874fbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 55ce6b086ff646b4b1f7379551e0be58, 6165e2b1cf7d4e1ab72dbfe2c00b638e, 95e29c9b83b6439b8cf752b77c874fbb; no voters:
I20260812 01:05:09.747759 8849 raft_consensus.cc:2781] T 65c7e3def57d4b0782ddae6355dd4b14 P 95e29c9b83b6439b8cf752b77c874fbb [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:05:09.747921 8849 raft_consensus.cc:686] T 65c7e3def57d4b0782ddae6355dd4b14 P 95e29c9b83b6439b8cf752b77c874fbb [term 1 LEADER]: Becoming Leader. State: Replica: 95e29c9b83b6439b8cf752b77c874fbb, State: Running, Role: LEADER
I20260812 01:05:09.748157 8849 consensus_queue.cc:237] T 65c7e3def57d4b0782ddae6355dd4b14 P 95e29c9b83b6439b8cf752b77c874fbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } }
I20260812 01:05:09.750648 7851 catalog_manager.cc:5495] T 65c7e3def57d4b0782ddae6355dd4b14 P 95e29c9b83b6439b8cf752b77c874fbb reported cstate change: term changed from 0 to 1, leader changed from <none> to 95e29c9b83b6439b8cf752b77c874fbb (127.4.201.66). New cstate: current_term: 1 leader_uuid: "95e29c9b83b6439b8cf752b77c874fbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95e29c9b83b6439b8cf752b77c874fbb" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 43103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 } health_report { overall_health: UNKNOWN } } }
I20260812 01:05:09.827694 8577 raft_consensus.cc:1261] T 65c7e3def57d4b0782ddae6355dd4b14 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 1 FOLLOWER]: Refusing update from remote peer 95e29c9b83b6439b8cf752b77c874fbb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:09.827808 8109 raft_consensus.cc:1261] T 65c7e3def57d4b0782ddae6355dd4b14 P 55ce6b086ff646b4b1f7379551e0be58 [term 1 FOLLOWER]: Refusing update from remote peer 95e29c9b83b6439b8cf752b77c874fbb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:09.828197 8863 consensus_queue.cc:1035] T 65c7e3def57d4b0782ddae6355dd4b14 P 95e29c9b83b6439b8cf752b77c874fbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6165e2b1cf7d4e1ab72dbfe2c00b638e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 45259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:09.828791 8863 consensus_queue.cc:1035] T 65c7e3def57d4b0782ddae6355dd4b14 P 95e29c9b83b6439b8cf752b77c874fbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "55ce6b086ff646b4b1f7379551e0be58" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 38961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:09.834368 8876 mvcc.cc:205] Tried to move back new op lower bound from 7317490523449610240 to 7317490523130540032. Current Snapshot: MvccSnapshot[applied={T|T < 7317490523449610240}]
W20260812 01:05:09.847541 8878 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 01:05:11.435837 7851 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52690:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:05:11.436046 7851 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52690:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:05:11.439953 7851 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9dcab807a8054690bc118e2aadcda3b2: Sending DeleteTablet for 3 replicas of tablet 65c7e3def57d4b0782ddae6355dd4b14
I20260812 01:05:11.440701 8076 tablet_service.cc:1514] Processing DeleteTablet for tablet 65c7e3def57d4b0782ddae6355dd4b14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:11 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:50770
I20260812 01:05:11.440737 8539 tablet_service.cc:1514] Processing DeleteTablet for tablet 65c7e3def57d4b0782ddae6355dd4b14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:11 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:38952
I20260812 01:05:11.440779 8302 tablet_service.cc:1514] Processing DeleteTablet for tablet 65c7e3def57d4b0782ddae6355dd4b14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:11 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:47670
I20260812 01:05:11.441655 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 7967
I20260812 01:05:11.452422 8943 tablet_replica.cc:330] T 65c7e3def57d4b0782ddae6355dd4b14 P 95e29c9b83b6439b8cf752b77c874fbb: stopping tablet replica
I20260812 01:05:11.452647 8943 raft_consensus.cc:2229] T 65c7e3def57d4b0782ddae6355dd4b14 P 95e29c9b83b6439b8cf752b77c874fbb [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:05:11.453053 8943 raft_consensus.cc:2258] T 65c7e3def57d4b0782ddae6355dd4b14 P 95e29c9b83b6439b8cf752b77c874fbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:11.454629 8943 ts_tablet_manager.cc:1905] T 65c7e3def57d4b0782ddae6355dd4b14 P 95e29c9b83b6439b8cf752b77c874fbb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:11.461664 8940 tablet_replica.cc:330] T 65c7e3def57d4b0782ddae6355dd4b14 P 55ce6b086ff646b4b1f7379551e0be58: stopping tablet replica
I20260812 01:05:11.461876 8940 raft_consensus.cc:2229] T 65c7e3def57d4b0782ddae6355dd4b14 P 55ce6b086ff646b4b1f7379551e0be58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:05:11.461913 8942 tablet_replica.cc:330] T 65c7e3def57d4b0782ddae6355dd4b14 P 6165e2b1cf7d4e1ab72dbfe2c00b638e: stopping tablet replica
I20260812 01:05:11.462133 8940 raft_consensus.cc:2258] T 65c7e3def57d4b0782ddae6355dd4b14 P 55ce6b086ff646b4b1f7379551e0be58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:11.462119 8942 raft_consensus.cc:2229] T 65c7e3def57d4b0782ddae6355dd4b14 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:05:11.462375 8942 raft_consensus.cc:2258] T 65c7e3def57d4b0782ddae6355dd4b14 P 6165e2b1cf7d4e1ab72dbfe2c00b638e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:11.463027 8940 ts_tablet_manager.cc:1905] T 65c7e3def57d4b0782ddae6355dd4b14 P 55ce6b086ff646b4b1f7379551e0be58: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:11.463531 8942 ts_tablet_manager.cc:1905] T 65c7e3def57d4b0782ddae6355dd4b14 P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 12 01:05:11 dist-test-slave-bndk krb5kdc[7767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496709, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.4.201.65@KRBTEST.COM
I20260812 01:05:11.468412 8940 ts_tablet_manager.cc:1918] T 65c7e3def57d4b0782ddae6355dd4b14 P 55ce6b086ff646b4b1f7379551e0be58: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 01:05:11.468541 8940 log.cc:1196] T 65c7e3def57d4b0782ddae6355dd4b14 P 55ce6b086ff646b4b1f7379551e0be58: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-0/wal/wals/65c7e3def57d4b0782ddae6355dd4b14
I20260812 01:05:11.468998 8940 ts_tablet_manager.cc:1939] T 65c7e3def57d4b0782ddae6355dd4b14 P 55ce6b086ff646b4b1f7379551e0be58: Deleting consensus metadata
I20260812 01:05:11.469481 8942 ts_tablet_manager.cc:1918] T 65c7e3def57d4b0782ddae6355dd4b14 P 6165e2b1cf7d4e1ab72dbfe2c00b638e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 01:05:11.469617 8942 log.cc:1196] T 65c7e3def57d4b0782ddae6355dd4b14 P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-2/wal/wals/65c7e3def57d4b0782ddae6355dd4b14
I20260812 01:05:11.470103 8942 ts_tablet_manager.cc:1939] T 65c7e3def57d4b0782ddae6355dd4b14 P 6165e2b1cf7d4e1ab72dbfe2c00b638e: Deleting consensus metadata
I20260812 01:05:11.470111 8943 ts_tablet_manager.cc:1918] T 65c7e3def57d4b0782ddae6355dd4b14 P 95e29c9b83b6439b8cf752b77c874fbb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 01:05:11.470207 7826 catalog_manager.cc:4841] TS 55ce6b086ff646b4b1f7379551e0be58 (127.4.201.65:38961): tablet 65c7e3def57d4b0782ddae6355dd4b14 (table test-table [id=5e8b8afe0d734028a4ba215b9e4f5812]) successfully deleted
I20260812 01:05:11.470392 8943 log.cc:1196] T 65c7e3def57d4b0782ddae6355dd4b14 P 95e29c9b83b6439b8cf752b77c874fbb: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786496689953932-4901-0/minicluster-data/ts-1/wal/wals/65c7e3def57d4b0782ddae6355dd4b14
I20260812 01:05:11.470798 8943 ts_tablet_manager.cc:1939] T 65c7e3def57d4b0782ddae6355dd4b14 P 95e29c9b83b6439b8cf752b77c874fbb: Deleting consensus metadata
I20260812 01:05:11.471211 7829 catalog_manager.cc:4841] TS 6165e2b1cf7d4e1ab72dbfe2c00b638e (127.4.201.67:45259): tablet 65c7e3def57d4b0782ddae6355dd4b14 (table test-table [id=5e8b8afe0d734028a4ba215b9e4f5812]) successfully deleted
I20260812 01:05:11.471745 7826 catalog_manager.cc:4841] TS 95e29c9b83b6439b8cf752b77c874fbb (127.4.201.66:43103): tablet 65c7e3def57d4b0782ddae6355dd4b14 (table test-table [id=5e8b8afe0d734028a4ba215b9e4f5812]) successfully deleted
I20260812 01:05:11.474144 8945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:11.443964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50784 (local address 127.4.201.65:38961)
0812 01:05:11.449467 (+ 5503us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:11.449475 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:11.455482 (+ 6007us) server_negotiation.cc:407] Connection header received
0812 01:05:11.455953 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:11.455960 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:11.456047 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:11.456131 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:11.458155 (+ 2024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:11.459540 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:11.461519 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:11.462142 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:11.462272 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:11.467624 (+ 5352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:11.467647 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:11.467672 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:11.467719 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:11.471693 (+ 3974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:11.472390 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:11.472398 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:11.472401 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:11.472537 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:11.472841 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:11.472844 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:11.472846 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:11.473193 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:11.473498 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:11.473652 (+ 154us) server_negotiation.cc:299] Negotiation successful
0812 01:05:11.473829 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5345,"thread_start_us":5175,"threads_started":1}
W20260812 01:05:11.474828 8185 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50784
W20260812 01:05:11.475406 4901 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 7967: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 01:05:11.475595 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 7967
I20260812 01:05:11.503423 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 8200
Aug 12 01:05:11 dist-test-slave-bndk krb5kdc[7767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496709, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.4.201.66@KRBTEST.COM
I20260812 01:05:11.517740 8949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:11.504137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47688 (local address 127.4.201.66:43103)
0812 01:05:11.504650 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:11.504655 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:11.504672 (+ 17us) server_negotiation.cc:407] Connection header received
0812 01:05:11.504728 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:11.504732 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:11.504808 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:11.504897 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:11.506163 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:11.506951 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:11.508203 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:11.508649 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:11.508747 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:11.512704 (+ 3957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:11.512718 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:11.512734 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:11.512767 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:11.515459 (+ 2692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:11.516035 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:11.516042 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:11.516044 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:11.516163 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:11.516466 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:11.516469 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:11.516471 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:11.516810 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:11.517027 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:11.517255 (+ 228us) server_negotiation.cc:299] Negotiation successful
0812 01:05:11.517466 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":262,"threads_started":1}
W20260812 01:05:11.518389 8417 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47688
W20260812 01:05:11.518965 4901 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 8200: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 01:05:11.519107 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 8200
I20260812 01:05:11.551012 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 8433
Aug 12 01:05:11 dist-test-slave-bndk krb5kdc[7767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496709, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.4.201.67@KRBTEST.COM
I20260812 01:05:11.565450 8950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:11.551702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38980 (local address 127.4.201.67:45259)
0812 01:05:11.552209 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:11.552214 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:11.552230 (+ 16us) server_negotiation.cc:407] Connection header received
0812 01:05:11.552285 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:11.552289 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:11.552349 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:11.552444 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:11.553668 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:11.554389 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:11.555493 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:11.555875 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:11.555963 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:11.560105 (+ 4142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:11.560122 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:11.560139 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:11.560172 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:11.563057 (+ 2885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:11.563644 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:11.563652 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:11.563654 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:11.563785 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:11.564061 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:11.564064 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:11.564066 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:11.564474 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:11.564723 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:11.564933 (+ 210us) server_negotiation.cc:299] Negotiation successful
0812 01:05:11.565100 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":270,"threads_started":1}
W20260812 01:05:11.566082 8654 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38980
W20260812 01:05:11.566660 4901 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 8433: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 01:05:11.566815 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 8433
I20260812 01:05:11.599382 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 7788
I20260812 01:05:11.600559 7917 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:11.727429 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 7788
2026-08-12T01:05:11Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (8578 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:05:11 dist-test-slave-bndk krb5kdc[8956](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:05:11 dist-test-slave-bndk krb5kdc[8956](info): set up 2 sockets
Aug 12 01:05:11 dist-test-slave-bndk krb5kdc[8956](info): commencing operation
krb5kdc: starting...
W20260812 01:05:12.944443 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.004s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:05:13 dist-test-slave-bndk krb5kdc[8956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496713, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:05:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:05:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.201.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
I20260812 01:05:13.143069 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:38685
--webserver_interface=127.4.201.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:34515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:38685
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:13.464108 8978 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:13.464387 8978 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:13.464483 8978 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:13.471576 8978 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:05:13.471678 8978 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:13.471730 8978 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:13.471786 8978 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:05:13.471827 8978 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:05:13.481338 8978 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:34515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:38685
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:38685
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:13.482565 8978 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:13.483798 8978 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:13.495271 8994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:13.495376 8987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:13.495378 8991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:13.495945 8978 server_base.cc:1034] running on GCE node
I20260812 01:05:13.496726 8978 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:13.498128 8978 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:13.499336 8978 hybrid_clock.cc:648] HybridClock initialized: now 1786496713499291 us; error 30 us; skew 500 ppm
I20260812 01:05:13.499673 8978 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:13 dist-test-slave-bndk krb5kdc[8956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496713, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:13.502703 8978 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:05:13.504118 8978 webserver.cc:460] Webserver started at http://127.4.201.126:37691/ using document root <none> and password file <none>
I20260812 01:05:13.504799 8978 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:13.504920 8978 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:13.505260 8978 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:13.508183 8978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "d4efdacbe7f542009ffe716755f3f9f7"
format_stamp: "Formatted at 2026-08-12 01:05:13 on dist-test-slave-bndk"
server_key: "b0f6451c6120aa65121c784496ef99ad"
server_key_iv: "3703f901ec46637a5d93278473b0167d"
server_key_version: "encryptionkey@0"
I20260812 01:05:13.508982 8978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "d4efdacbe7f542009ffe716755f3f9f7"
format_stamp: "Formatted at 2026-08-12 01:05:13 on dist-test-slave-bndk"
server_key: "b0f6451c6120aa65121c784496ef99ad"
server_key_iv: "3703f901ec46637a5d93278473b0167d"
server_key_version: "encryptionkey@0"
I20260812 01:05:13.514001 8978 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260812 01:05:13.517202 9004 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:13.518455 8978 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 01:05:13.518630 8978 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "d4efdacbe7f542009ffe716755f3f9f7"
format_stamp: "Formatted at 2026-08-12 01:05:13 on dist-test-slave-bndk"
server_key: "b0f6451c6120aa65121c784496ef99ad"
server_key_iv: "3703f901ec46637a5d93278473b0167d"
server_key_version: "encryptionkey@0"
I20260812 01:05:13.518798 8978 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:13.544770 8978 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:13.548381 8978 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:13.548652 8978 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:13.565764 8978 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:38685
I20260812 01:05:13.565783 9096 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:38685 every 8 connection(s)
I20260812 01:05:13.567042 8978 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:05:13.569742 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 8978
I20260812 01:05:13.569983 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:05:13.570761 4901 external_mini_cluster.cc:1428] Setting key 9adc6f364b0a804f3836526ebcc5b387
I20260812 01:05:13.571249 9098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:13.585263 9098 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4efdacbe7f542009ffe716755f3f9f7: Bootstrap starting.
Aug 12 01:05:13 dist-test-slave-bndk krb5kdc[8956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496713, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:13.588493 9098 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d4efdacbe7f542009ffe716755f3f9f7: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:13.589565 9098 log.cc:824] T 00000000000000000000000000000000 P d4efdacbe7f542009ffe716755f3f9f7: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:13.592247 9098 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4efdacbe7f542009ffe716755f3f9f7: No bootstrap required, opened a new log
I20260812 01:05:13.593396 9101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:13.572765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51542 (local address 127.4.201.126:38685)
0812 01:05:13.573533 (+ 768us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:13.573544 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:13.573584 (+ 40us) server_negotiation.cc:407] Connection header received
0812 01:05:13.575834 (+ 2250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:13.575857 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:13.576224 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:13.576567 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:13.578343 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:13.579590 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:13.581322 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:13.582007 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:13.582143 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:13.586586 (+ 4443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:13.586597 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:13.586611 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:13.586647 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:13.589561 (+ 2914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:13.590232 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:13.590239 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:13.590245 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:13.590420 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:13.590797 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:13.590801 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:13.590803 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:13.591289 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:13.591584 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:13.592027 (+ 443us) server_negotiation.cc:299] Negotiation successful
0812 01:05:13.592437 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":578,"thread_start_us":359,"threads_started":1}
I20260812 01:05:13.599921 9098 raft_consensus.cc:348] T 00000000000000000000000000000000 P d4efdacbe7f542009ffe716755f3f9f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4efdacbe7f542009ffe716755f3f9f7" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38685 } }
I20260812 01:05:13.600260 9098 raft_consensus.cc:374] T 00000000000000000000000000000000 P d4efdacbe7f542009ffe716755f3f9f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:13.600349 9098 raft_consensus.cc:729] T 00000000000000000000000000000000 P d4efdacbe7f542009ffe716755f3f9f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4efdacbe7f542009ffe716755f3f9f7, State: Initialized, Role: FOLLOWER
I20260812 01:05:13.600847 9098 consensus_queue.cc:260] T 00000000000000000000000000000000 P d4efdacbe7f542009ffe716755f3f9f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4efdacbe7f542009ffe716755f3f9f7" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38685 } }
I20260812 01:05:13.601063 9098 raft_consensus.cc:388] T 00000000000000000000000000000000 P d4efdacbe7f542009ffe716755f3f9f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:05:13.601193 9098 raft_consensus.cc:482] T 00000000000000000000000000000000 P d4efdacbe7f542009ffe716755f3f9f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:05:13.601375 9098 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d4efdacbe7f542009ffe716755f3f9f7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:13.603394 9098 raft_consensus.cc:504] T 00000000000000000000000000000000 P d4efdacbe7f542009ffe716755f3f9f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4efdacbe7f542009ffe716755f3f9f7" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38685 } }
I20260812 01:05:13.603922 9098 leader_election.cc:302] T 00000000000000000000000000000000 P d4efdacbe7f542009ffe716755f3f9f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d4efdacbe7f542009ffe716755f3f9f7; no voters:
I20260812 01:05:13.604498 9098 leader_election.cc:288] T 00000000000000000000000000000000 P d4efdacbe7f542009ffe716755f3f9f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:05:13.604584 9104 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d4efdacbe7f542009ffe716755f3f9f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:05:13.605201 9104 raft_consensus.cc:686] T 00000000000000000000000000000000 P d4efdacbe7f542009ffe716755f3f9f7 [term 1 LEADER]: Becoming Leader. State: Replica: d4efdacbe7f542009ffe716755f3f9f7, State: Running, Role: LEADER
I20260812 01:05:13.605803 9104 consensus_queue.cc:237] T 00000000000000000000000000000000 P d4efdacbe7f542009ffe716755f3f9f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4efdacbe7f542009ffe716755f3f9f7" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38685 } }
I20260812 01:05:13.606442 9098 sys_catalog.cc:564] T 00000000000000000000000000000000 P d4efdacbe7f542009ffe716755f3f9f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:05:13.608450 9105 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4efdacbe7f542009ffe716755f3f9f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d4efdacbe7f542009ffe716755f3f9f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4efdacbe7f542009ffe716755f3f9f7" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38685 } } }
I20260812 01:05:13.608644 9106 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4efdacbe7f542009ffe716755f3f9f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d4efdacbe7f542009ffe716755f3f9f7. Latest consensus state: current_term: 1 leader_uuid: "d4efdacbe7f542009ffe716755f3f9f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4efdacbe7f542009ffe716755f3f9f7" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38685 } } }
I20260812 01:05:13.608866 9105 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4efdacbe7f542009ffe716755f3f9f7 [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:13.608912 9106 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4efdacbe7f542009ffe716755f3f9f7 [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:13.610371 9117 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:05:13.615432 9117 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:05:13.625082 9117 catalog_manager.cc:1347] Generated new cluster ID: 7606f5f3e3f444c39eda51345b38a29c
I20260812 01:05:13.625185 9117 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:05:13.642002 9117 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:05:13.643179 9117 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:05:13.654014 9117 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d4efdacbe7f542009ffe716755f3f9f7: Generated new TSK 0
I20260812 01:05:13.654760 9117 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.201.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
I20260812 01:05:13.713377 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:0
--local_ip_for_outbound_sockets=127.4.201.65
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:38685
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:34515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:14.032979 9139 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:14.033280 9139 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:14.033420 9139 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:14.041615 9139 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:14.041731 9139 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:14.041899 9139 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:05:14.054337 9139 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:34515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:38685
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:14.055615 9139 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:14.056869 9139 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:14.070633 9145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:14.070691 9151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:14.070716 9146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:14.071724 9139 server_base.cc:1034] running on GCE node
I20260812 01:05:14.072296 9139 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:14.073732 9139 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:14.074968 9139 hybrid_clock.cc:648] HybridClock initialized: now 1786496714074901 us; error 47 us; skew 500 ppm
I20260812 01:05:14.075390 9139 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:14 dist-test-slave-bndk krb5kdc[8956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496714, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:14.078740 9139 init.cc:377] Logged in from keytab as kudu/127.4.201.65@KRBTEST.COM (short username kudu)
I20260812 01:05:14.080271 9139 webserver.cc:460] Webserver started at http://127.4.201.65:38087/ using document root <none> and password file <none>
I20260812 01:05:14.080965 9139 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:14.081086 9139 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:14.081441 9139 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:14.084301 9139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/data/instance:
uuid: "ba2cac2797b94c1098ae20016b2ceb11"
format_stamp: "Formatted at 2026-08-12 01:05:14 on dist-test-slave-bndk"
server_key: "18282acdc8a16404854547ca4dd28380"
server_key_iv: "5e9f76f822a72d45f0cd131b68b294f7"
server_key_version: "encryptionkey@0"
I20260812 01:05:14.085088 9139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance:
uuid: "ba2cac2797b94c1098ae20016b2ceb11"
format_stamp: "Formatted at 2026-08-12 01:05:14 on dist-test-slave-bndk"
server_key: "18282acdc8a16404854547ca4dd28380"
server_key_iv: "5e9f76f822a72d45f0cd131b68b294f7"
server_key_version: "encryptionkey@0"
I20260812 01:05:14.090992 9139 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 01:05:14.095184 9165 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:14.096536 9139 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 01:05:14.096698 9139 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "ba2cac2797b94c1098ae20016b2ceb11"
format_stamp: "Formatted at 2026-08-12 01:05:14 on dist-test-slave-bndk"
server_key: "18282acdc8a16404854547ca4dd28380"
server_key_iv: "5e9f76f822a72d45f0cd131b68b294f7"
server_key_version: "encryptionkey@0"
I20260812 01:05:14.096899 9139 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:14.139186 9139 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:14.143157 9139 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:14.143457 9139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:14.144500 9139 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:05:14.145882 9139 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:14.145991 9139 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:14.146118 9139 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:14.146174 9139 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:14.177718 9139 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:37325
I20260812 01:05:14.177755 9360 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:37325 every 8 connection(s)
I20260812 01:05:14.179026 9139 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:05:14.183331 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 9139
I20260812 01:05:14.183543 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance
I20260812 01:05:14.184161 4901 external_mini_cluster.cc:1428] Setting key 320200e7e28b4e2eaf6f6de067f8a9aa
Aug 12 01:05:14 dist-test-slave-bndk krb5kdc[8956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496714, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:14.198514 9364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:14.181634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:49285 (local address 127.4.201.126:38685)
0812 01:05:14.182062 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:14.182067 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:14.182922 (+ 855us) server_negotiation.cc:407] Connection header received
0812 01:05:14.184824 (+ 1902us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:14.184831 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:14.184921 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:14.185029 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:14.186519 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:14.187250 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:14.188709 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:14.189112 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:14.189245 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:14.192488 (+ 3243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:14.192493 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:14.192496 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:14.192528 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:14.195087 (+ 2559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:14.196157 (+ 1070us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:14.196161 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:14.196164 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:14.196301 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:14.196762 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:14.196765 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:14.196767 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:14.197020 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:14.197128 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:14.198063 (+ 935us) server_negotiation.cc:299] Negotiation successful
0812 01:05:14.198252 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":220,"threads_started":1}
I20260812 01:05:14.199857 9366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:14.182050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:38685 (local address 127.4.201.65:49285)
0812 01:05:14.182735 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:14.182776 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:14.184556 (+ 1780us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:14.185316 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:14.185331 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:14.185809 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:14.186357 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:14.186375 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:14.187397 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:14.187401 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:14.188574 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:14.188586 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:14.189347 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:14.189355 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:14.189573 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:14.190172 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:14.190201 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:14.192282 (+ 2081us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:14.195223 (+ 2941us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:14.195232 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:14.195247 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:14.195803 (+ 556us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:14.196433 (+ 630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:14.196437 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:14.196441 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:14.196666 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:14.197148 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:14.197155 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:14.197624 (+ 469us) client_negotiation.cc:769] Sending connection context
0812 01:05:14.197918 (+ 294us) client_negotiation.cc:240] Negotiation successful
0812 01:05:14.198414 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":269,"threads_started":1}
I20260812 01:05:14.201462 9362 heartbeater.cc:347] Connected to a master server at 127.4.201.126:38685
I20260812 01:05:14.201771 9362 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:14.202584 9362 heartbeater.cc:511] Master 127.4.201.126:38685 requested a full tablet report, sending...
I20260812 01:05:14.204612 9040 ts_manager.cc:194] Registered new tserver with Master: ba2cac2797b94c1098ae20016b2ceb11 (127.4.201.65:37325)
WARNING: no policy specified for kudu/127.4.201.66@KRBTEST.COM; defaulting to no policy
I20260812 01:05:14.206108 9040 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.65@KRBTEST.COM'} at 127.4.201.65:49285
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
W20260812 01:05:14.956700 4901 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.4.201.66: real 0.770s user 0.000s sys 0.013s
I20260812 01:05:14.957521 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:0
--local_ip_for_outbound_sockets=127.4.201.66
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:38685
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:34515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:05:15.208941 9362 heartbeater.cc:503] Master 127.4.201.126:38685 was elected leader, sending a full tablet report...
W20260812 01:05:15.349457 9373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:15.349748 9373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:15.349896 9373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:15.357504 9373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:15.357632 9373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:15.357784 9373 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:05:15.367755 9373 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:34515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:38685
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:15.369109 9373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:15.370486 9373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:15.383985 9381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:15.384019 9383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:15.384649 9380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:15.384909 9373 server_base.cc:1034] running on GCE node
I20260812 01:05:15.385597 9373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:15.386583 9373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:15.387830 9373 hybrid_clock.cc:648] HybridClock initialized: now 1786496715387749 us; error 62 us; skew 500 ppm
I20260812 01:05:15.388157 9373 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:15 dist-test-slave-bndk krb5kdc[8956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496715, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:15.391284 9373 init.cc:377] Logged in from keytab as kudu/127.4.201.66@KRBTEST.COM (short username kudu)
I20260812 01:05:15.392716 9373 webserver.cc:460] Webserver started at http://127.4.201.66:37843/ using document root <none> and password file <none>
I20260812 01:05:15.393489 9373 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:15.393595 9373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:15.393873 9373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:15.396837 9373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/data/instance:
uuid: "4a70983b79f14d21919df905ade913d0"
format_stamp: "Formatted at 2026-08-12 01:05:15 on dist-test-slave-bndk"
server_key: "4daa0b47437306e88d2068e94bde4cb3"
server_key_iv: "d7772ddaed47ae6186253f869972df55"
server_key_version: "encryptionkey@0"
I20260812 01:05:15.397639 9373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance:
uuid: "4a70983b79f14d21919df905ade913d0"
format_stamp: "Formatted at 2026-08-12 01:05:15 on dist-test-slave-bndk"
server_key: "4daa0b47437306e88d2068e94bde4cb3"
server_key_iv: "d7772ddaed47ae6186253f869972df55"
server_key_version: "encryptionkey@0"
I20260812 01:05:15.402819 9373 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 01:05:15.406647 9397 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:15.408013 9373 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 01:05:15.408160 9373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "4a70983b79f14d21919df905ade913d0"
format_stamp: "Formatted at 2026-08-12 01:05:15 on dist-test-slave-bndk"
server_key: "4daa0b47437306e88d2068e94bde4cb3"
server_key_iv: "d7772ddaed47ae6186253f869972df55"
server_key_version: "encryptionkey@0"
I20260812 01:05:15.408351 9373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:15.422665 9373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:15.426803 9373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:15.427074 9373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:15.427999 9373 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:05:15.429337 9373 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:15.429409 9373 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:15.429530 9373 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:15.429587 9373 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:15.460103 9373 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:36769
I20260812 01:05:15.460141 9583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:36769 every 8 connection(s)
I20260812 01:05:15.461393 9373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:05:15.465708 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 9373
I20260812 01:05:15.465886 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance
I20260812 01:05:15.466439 4901 external_mini_cluster.cc:1428] Setting key 6780216d69592cc2a70a42c361f46699
Aug 12 01:05:15 dist-test-slave-bndk krb5kdc[8956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496715, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:15.483162 9587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:15.463847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:42407 (local address 127.4.201.126:38685)
0812 01:05:15.464300 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:15.464304 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:15.465117 (+ 813us) server_negotiation.cc:407] Connection header received
0812 01:05:15.467586 (+ 2469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:15.467591 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:15.467667 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:15.467784 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:15.469533 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:15.470273 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:15.472442 (+ 2169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:15.472876 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:15.472971 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:15.477373 (+ 4402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:15.477380 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:15.477385 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:15.477428 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:15.480022 (+ 2594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:15.480845 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:15.480849 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:15.480851 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:15.480966 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:15.481507 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:15.481510 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:15.481512 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:15.481780 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:15.481890 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:15.482701 (+ 811us) server_negotiation.cc:299] Negotiation successful
0812 01:05:15.482885 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":40,"server-negotiator.queue_time_us":336,"thread_start_us":233,"threads_started":1}
I20260812 01:05:15.484560 9590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:15.464235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:38685 (local address 127.4.201.66:42407)
0812 01:05:15.464944 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:15.464991 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:15.467249 (+ 2258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:15.467981 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:15.467989 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:15.468510 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:15.469332 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:15.469358 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:15.470442 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:15.470462 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:15.472265 (+ 1803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:15.472280 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:15.473567 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:15.473575 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:15.473860 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:15.474567 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:15.474597 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:15.477113 (+ 2516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:15.480171 (+ 3058us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:15.480180 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:15.480196 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:15.480743 (+ 547us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:15.481065 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:15.481069 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:15.481073 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:15.481386 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:15.481904 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:15.481911 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:15.482329 (+ 418us) client_negotiation.cc:769] Sending connection context
0812 01:05:15.482607 (+ 278us) client_negotiation.cc:240] Negotiation successful
0812 01:05:15.483192 (+ 585us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":283,"threads_started":1}
I20260812 01:05:15.486227 9584 heartbeater.cc:347] Connected to a master server at 127.4.201.126:38685
I20260812 01:05:15.486537 9584 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:15.487262 9584 heartbeater.cc:511] Master 127.4.201.126:38685 requested a full tablet report, sending...
I20260812 01:05:15.488824 9040 ts_manager.cc:194] Registered new tserver with Master: 4a70983b79f14d21919df905ade913d0 (127.4.201.66:36769)
WARNING: no policy specified for kudu/127.4.201.67@KRBTEST.COM; defaulting to no policy
I20260812 01:05:15.489845 9040 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.66@KRBTEST.COM'} at 127.4.201.66:42407
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
W20260812 01:05:15.939988 4901 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.4.201.67: real 0.471s user 0.004s sys 0.012s
I20260812 01:05:15.940718 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:0
--local_ip_for_outbound_sockets=127.4.201.67
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:38685
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:34515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:16.263062 9595 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:16.263326 9595 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:16.263459 9595 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:16.270449 9595 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:16.270557 9595 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:16.270713 9595 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:05:16.280159 9595 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:34515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:38685
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:16.281454 9595 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:16.282738 9595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:16.295276 9602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:16.295508 9604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:16.295794 9607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:16.296200 9595 server_base.cc:1034] running on GCE node
I20260812 01:05:16.296715 9595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:16.297621 9595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:16.298807 9595 hybrid_clock.cc:648] HybridClock initialized: now 1786496716298765 us; error 35 us; skew 500 ppm
I20260812 01:05:16.299083 9595 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:16 dist-test-slave-bndk krb5kdc[8956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496716, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:16.302214 9595 init.cc:377] Logged in from keytab as kudu/127.4.201.67@KRBTEST.COM (short username kudu)
I20260812 01:05:16.303630 9595 webserver.cc:460] Webserver started at http://127.4.201.67:46191/ using document root <none> and password file <none>
I20260812 01:05:16.304284 9595 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:16.304400 9595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:16.304702 9595 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:16.307619 9595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/data/instance:
uuid: "3a5bb9d508f54e5ca7d0f6ac6a08cd29"
format_stamp: "Formatted at 2026-08-12 01:05:16 on dist-test-slave-bndk"
server_key: "9d5c3c6e1c74b690d7595ee258b4268e"
server_key_iv: "ffd9e342c0b836e0e93b7034cbbbbd03"
server_key_version: "encryptionkey@0"
I20260812 01:05:16.308351 9595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance:
uuid: "3a5bb9d508f54e5ca7d0f6ac6a08cd29"
format_stamp: "Formatted at 2026-08-12 01:05:16 on dist-test-slave-bndk"
server_key: "9d5c3c6e1c74b690d7595ee258b4268e"
server_key_iv: "ffd9e342c0b836e0e93b7034cbbbbd03"
server_key_version: "encryptionkey@0"
I20260812 01:05:16.313369 9595 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260812 01:05:16.316664 9616 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:16.317945 9595 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:05:16.318101 9595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "3a5bb9d508f54e5ca7d0f6ac6a08cd29"
format_stamp: "Formatted at 2026-08-12 01:05:16 on dist-test-slave-bndk"
server_key: "9d5c3c6e1c74b690d7595ee258b4268e"
server_key_iv: "ffd9e342c0b836e0e93b7034cbbbbd03"
server_key_version: "encryptionkey@0"
I20260812 01:05:16.318274 9595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:16.334685 9595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:16.338295 9595 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:16.338570 9595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:16.339435 9595 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:05:16.340989 9595 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:16.341082 9595 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:16.341282 9595 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:16.341609 9595 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260812 01:05:16.371906 9595 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:43189
I20260812 01:05:16.371951 9806 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:43189 every 8 connection(s)
I20260812 01:05:16.373211 9595 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:05:16.380247 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 9595
I20260812 01:05:16.380422 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance
I20260812 01:05:16.380863 4901 external_mini_cluster.cc:1428] Setting key b7761644365e9cbafd7374c8729e0ca4
Aug 12 01:05:16 dist-test-slave-bndk krb5kdc[8956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496716, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:16.392007 9809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:16.375755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:59441 (local address 127.4.201.126:38685)
0812 01:05:16.376199 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:16.376204 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:16.377149 (+ 945us) server_negotiation.cc:407] Connection header received
0812 01:05:16.378968 (+ 1819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:16.378973 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:16.379057 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:16.379158 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:16.380897 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:16.381744 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:16.383256 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:16.383653 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:16.383765 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:16.387118 (+ 3353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:16.387123 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:16.387126 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:16.387160 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:16.389523 (+ 2363us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:16.390170 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:16.390174 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:16.390176 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:16.390287 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:16.390622 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:16.390625 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:16.390627 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:16.390865 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:16.390980 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:16.391573 (+ 593us) server_negotiation.cc:299] Negotiation successful
0812 01:05:16.391732 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":203,"threads_started":1}
I20260812 01:05:16.392899 9810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:16.376267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:38685 (local address 127.4.201.67:59441)
0812 01:05:16.377001 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:16.377039 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:16.378698 (+ 1659us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:16.379425 (+ 727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:16.379432 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:16.380113 (+ 681us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:16.380724 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:16.380744 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:16.381899 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:16.381903 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:16.383111 (+ 1208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:16.383124 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:16.383877 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:16.383885 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:16.384117 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:16.384743 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:16.384771 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:16.386919 (+ 2148us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:16.389650 (+ 2731us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:16.389658 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:16.389670 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:16.390081 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:16.390363 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:16.390367 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:16.390369 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:16.390546 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:16.390953 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:16.390958 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:16.391260 (+ 302us) client_negotiation.cc:769] Sending connection context
0812 01:05:16.391497 (+ 237us) client_negotiation.cc:240] Negotiation successful
0812 01:05:16.391855 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":266,"threads_started":1}
I20260812 01:05:16.394273 9807 heartbeater.cc:347] Connected to a master server at 127.4.201.126:38685
I20260812 01:05:16.394598 9807 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:16.395376 9807 heartbeater.cc:511] Master 127.4.201.126:38685 requested a full tablet report, sending...
I20260812 01:05:16.396773 9040 ts_manager.cc:194] Registered new tserver with Master: 3a5bb9d508f54e5ca7d0f6ac6a08cd29 (127.4.201.67:43189)
I20260812 01:05:16.397604 9040 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.67@KRBTEST.COM'} at 127.4.201.67:59441
I20260812 01:05:16.407686 4901 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 01:05:16.441619 9809 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:05:16.439305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51544 (local address 127.4.201.126:38685)
0812 01:05:16.439531 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:16.439538 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:16.439843 (+ 305us) server_negotiation.cc:407] Connection header received
0812 01:05:16.439999 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:16.440003 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:16.440101 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:16.440187 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:16.441359 (+ 1172us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51544: BlockingRecv error: recv got EOF from 127.0.0.1:51544 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 01:05:16.445013 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 9139
W20260812 01:05:16.447594 4901 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 9139: Not authorized: Client connection negotiation failed: client connection to 127.4.201.65:37325: server requires authentication, but client does not have Kerberos credentials available
I20260812 01:05:16.447750 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 9139
I20260812 01:05:16.472119 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 9373
W20260812 01:05:16.474835 4901 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 9373: Not authorized: Client connection negotiation failed: client connection to 127.4.201.66:36769: server requires authentication, but client does not have Kerberos credentials available
I20260812 01:05:16.475023 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 9373
I20260812 01:05:16.499270 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 9595
W20260812 01:05:16.502243 4901 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 9595: Not authorized: Client connection negotiation failed: client connection to 127.4.201.67:43189: server requires authentication, but client does not have Kerberos credentials available
I20260812 01:05:16.502364 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 9595
I20260812 01:05:16.520783 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 8978
I20260812 01:05:16.521958 9086 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:16.625355 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 8978
2026-08-12T01:05:16Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (4893 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:05:16 dist-test-slave-bndk krb5kdc[9836](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:05:16 dist-test-slave-bndk krb5kdc[9836](info): set up 2 sockets
Aug 12 01:05:16 dist-test-slave-bndk krb5kdc[9836](info): commencing operation
krb5kdc: starting...
W20260812 01:05:17.837981 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.000s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:05:17 dist-test-slave-bndk krb5kdc[9836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496717, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:05:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:05:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.201.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
I20260812 01:05:18.044140 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:42319
--webserver_interface=127.4.201.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:36063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:42319
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:18.366056 9856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:18.366346 9856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:18.366446 9856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:18.373486 9856 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:05:18.373589 9856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:18.373642 9856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:18.373698 9856 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:05:18.373744 9856 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:05:18.383474 9856 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:36063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:42319
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:42319
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:18.384716 9856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:18.385993 9856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:18.397352 9862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:18.397419 9869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:18.397388 9865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:18.398165 9856 server_base.cc:1034] running on GCE node
I20260812 01:05:18.398941 9856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:18.400250 9856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:18.401445 9856 hybrid_clock.cc:648] HybridClock initialized: now 1786496718401401 us; error 30 us; skew 500 ppm
I20260812 01:05:18.401788 9856 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:18 dist-test-slave-bndk krb5kdc[9836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496718, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:18.404731 9856 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:05:18.406194 9856 webserver.cc:460] Webserver started at http://127.4.201.126:34283/ using document root <none> and password file <none>
I20260812 01:05:18.406839 9856 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:18.406950 9856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:18.407259 9856 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:18.410205 9856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "76eed76d79a34c2b830d7e6f1720d511"
format_stamp: "Formatted at 2026-08-12 01:05:18 on dist-test-slave-bndk"
server_key: "539b41e791d4e8f884fb7937aaae752b"
server_key_iv: "4ab1e442859223c1f59f5681d7e28e20"
server_key_version: "encryptionkey@0"
I20260812 01:05:18.410998 9856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "76eed76d79a34c2b830d7e6f1720d511"
format_stamp: "Formatted at 2026-08-12 01:05:18 on dist-test-slave-bndk"
server_key: "539b41e791d4e8f884fb7937aaae752b"
server_key_iv: "4ab1e442859223c1f59f5681d7e28e20"
server_key_version: "encryptionkey@0"
I20260812 01:05:18.415961 9856 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 01:05:18.419284 9876 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:18.420513 9856 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 01:05:18.420666 9856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "76eed76d79a34c2b830d7e6f1720d511"
format_stamp: "Formatted at 2026-08-12 01:05:18 on dist-test-slave-bndk"
server_key: "539b41e791d4e8f884fb7937aaae752b"
server_key_iv: "4ab1e442859223c1f59f5681d7e28e20"
server_key_version: "encryptionkey@0"
I20260812 01:05:18.420830 9856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:18.436133 9856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:18.439669 9856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:18.439908 9856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:18.456920 9856 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:42319
I20260812 01:05:18.456961 9971 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:42319 every 8 connection(s)
I20260812 01:05:18.458248 9856 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:05:18.461902 9972 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:18.461916 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 9856
I20260812 01:05:18.462103 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:05:18.462733 4901 external_mini_cluster.cc:1428] Setting key 79b16bcdbbfec2d2aed1531d80845f01
I20260812 01:05:18.475590 9972 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76eed76d79a34c2b830d7e6f1720d511: Bootstrap starting.
Aug 12 01:05:18 dist-test-slave-bndk krb5kdc[9836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496717, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:18.478610 9972 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 76eed76d79a34c2b830d7e6f1720d511: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:18.479949 9972 log.cc:824] T 00000000000000000000000000000000 P 76eed76d79a34c2b830d7e6f1720d511: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:18.483171 9972 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76eed76d79a34c2b830d7e6f1720d511: No bootstrap required, opened a new log
I20260812 01:05:18.486765 9975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:18.464445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46962 (local address 127.4.201.126:42319)
0812 01:05:18.465323 (+ 878us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:18.465338 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:18.465387 (+ 49us) server_negotiation.cc:407] Connection header received
0812 01:05:18.468070 (+ 2683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:18.468100 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:18.468589 (+ 489us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:18.469034 (+ 445us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:18.470396 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:18.472362 (+ 1966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:18.473580 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:18.474589 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:18.474767 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:18.478721 (+ 3954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:18.478732 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:18.478751 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:18.478796 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:18.482427 (+ 3631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:18.483087 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:18.483096 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:18.483104 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:18.483314 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:18.483692 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:18.483697 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:18.483700 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:18.484402 (+ 702us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:18.484702 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:18.485013 (+ 311us) server_negotiation.cc:299] Negotiation successful
0812 01:05:18.485473 (+ 460us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":621,"thread_start_us":343,"threads_started":1}
I20260812 01:05:18.490442 4901 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:05:18.491941 9972 raft_consensus.cc:348] T 00000000000000000000000000000000 P 76eed76d79a34c2b830d7e6f1720d511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76eed76d79a34c2b830d7e6f1720d511" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 42319 } }
I20260812 01:05:18.492266 9972 raft_consensus.cc:374] T 00000000000000000000000000000000 P 76eed76d79a34c2b830d7e6f1720d511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:18.492365 9972 raft_consensus.cc:729] T 00000000000000000000000000000000 P 76eed76d79a34c2b830d7e6f1720d511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76eed76d79a34c2b830d7e6f1720d511, State: Initialized, Role: FOLLOWER
I20260812 01:05:18.492923 9972 consensus_queue.cc:260] T 00000000000000000000000000000000 P 76eed76d79a34c2b830d7e6f1720d511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76eed76d79a34c2b830d7e6f1720d511" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 42319 } }
I20260812 01:05:18.493142 9972 raft_consensus.cc:388] T 00000000000000000000000000000000 P 76eed76d79a34c2b830d7e6f1720d511 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:05:18.493287 9972 raft_consensus.cc:482] T 00000000000000000000000000000000 P 76eed76d79a34c2b830d7e6f1720d511 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:05:18.493435 9972 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 76eed76d79a34c2b830d7e6f1720d511 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:18.495500 9972 raft_consensus.cc:504] T 00000000000000000000000000000000 P 76eed76d79a34c2b830d7e6f1720d511 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76eed76d79a34c2b830d7e6f1720d511" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 42319 } }
I20260812 01:05:18.495975 9972 leader_election.cc:302] T 00000000000000000000000000000000 P 76eed76d79a34c2b830d7e6f1720d511 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 76eed76d79a34c2b830d7e6f1720d511; no voters:
I20260812 01:05:18.496523 9972 leader_election.cc:288] T 00000000000000000000000000000000 P 76eed76d79a34c2b830d7e6f1720d511 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:05:18.496662 9978 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 76eed76d79a34c2b830d7e6f1720d511 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:05:18.498477 9972 sys_catalog.cc:564] T 00000000000000000000000000000000 P 76eed76d79a34c2b830d7e6f1720d511 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:05:18.499146 9978 raft_consensus.cc:686] T 00000000000000000000000000000000 P 76eed76d79a34c2b830d7e6f1720d511 [term 1 LEADER]: Becoming Leader. State: Replica: 76eed76d79a34c2b830d7e6f1720d511, State: Running, Role: LEADER
I20260812 01:05:18.499716 9978 consensus_queue.cc:237] T 00000000000000000000000000000000 P 76eed76d79a34c2b830d7e6f1720d511 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76eed76d79a34c2b830d7e6f1720d511" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 42319 } }
I20260812 01:05:18.502552 9982 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76eed76d79a34c2b830d7e6f1720d511 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 76eed76d79a34c2b830d7e6f1720d511. Latest consensus state: current_term: 1 leader_uuid: "76eed76d79a34c2b830d7e6f1720d511" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76eed76d79a34c2b830d7e6f1720d511" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 42319 } } }
I20260812 01:05:18.502898 9982 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76eed76d79a34c2b830d7e6f1720d511 [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:18.503532 9979 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76eed76d79a34c2b830d7e6f1720d511 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "76eed76d79a34c2b830d7e6f1720d511" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76eed76d79a34c2b830d7e6f1720d511" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 42319 } } }
I20260812 01:05:18.503829 9979 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76eed76d79a34c2b830d7e6f1720d511 [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:18.506040 9996 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:05:18.515437 9996 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:05:18.532063 9996 catalog_manager.cc:1347] Generated new cluster ID: d4eb425877694c9bb8497c34e30f1c3e
I20260812 01:05:18.532200 9996 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:05:18.569753 9975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:18.560828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46972 (local address 127.4.201.126:42319)
0812 01:05:18.561002 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:18.561008 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:18.561641 (+ 633us) server_negotiation.cc:407] Connection header received
0812 01:05:18.561819 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:18.561826 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:18.561918 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:18.562055 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:18.563170 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:18.564309 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:18.566085 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:18.566773 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:18.566917 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:18.568032 (+ 1115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:18.568039 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:18.568044 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:05:18.568887 (+ 843us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:18.568988 (+ 101us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:05:18.569026 (+ 38us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:18.569135 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:18.569285 (+ 150us) server_negotiation.cc:299] Negotiation successful
0812 01:05:18.569382 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":63}
I20260812 01:05:18.579906 9996 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:05:18.581205 9996 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:05:18.590487 9996 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 76eed76d79a34c2b830d7e6f1720d511: Generated new TSK 0
I20260812 01:05:18.591261 9996 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:05:18.599445 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 9856
I20260812 01:05:18.600735 9963 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:18.692592 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 9856
2026-08-12T01:05:18Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2062 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:05:18 dist-test-slave-bndk krb5kdc[10031](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:05:18 dist-test-slave-bndk krb5kdc[10031](info): set up 2 sockets
Aug 12 01:05:18 dist-test-slave-bndk krb5kdc[10031](info): commencing operation
krb5kdc: starting...
W20260812 01:05:19.894738 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.160s user 0.000s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:05:20 dist-test-slave-bndk krb5kdc[10031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496720, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:05:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:05:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.201.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
I20260812 01:05:20.090514 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:45537
--webserver_interface=127.4.201.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:40021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:45537
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:20.409705 10058 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:20.410004 10058 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:20.410140 10058 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:20.417156 10058 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:05:20.417294 10058 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:20.417374 10058 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:20.417456 10058 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:05:20.417517 10058 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:05:20.426894 10058 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:40021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:45537
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:45537
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:20.428146 10058 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:20.429399 10058 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:20.440238 10074 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:20.440281 10068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:20.440303 10069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:20.440990 10058 server_base.cc:1034] running on GCE node
I20260812 01:05:20.441695 10058 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:20.442936 10058 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:20.444132 10058 hybrid_clock.cc:648] HybridClock initialized: now 1786496720444090 us; error 27 us; skew 500 ppm
I20260812 01:05:20.444424 10058 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:20 dist-test-slave-bndk krb5kdc[10031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496720, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:20.447350 10058 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:05:20.448658 10058 webserver.cc:460] Webserver started at http://127.4.201.126:42335/ using document root <none> and password file <none>
I20260812 01:05:20.449316 10058 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:20.449438 10058 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:20.449723 10058 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:20.452538 10058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "dbf116dc09954e43bdca5b13eb3d48c4"
format_stamp: "Formatted at 2026-08-12 01:05:20 on dist-test-slave-bndk"
server_key: "8c0f4095c26206e9b79a044d9e040b1a"
server_key_iv: "f0ab1387aeb57390215aa6df3d92b4bb"
server_key_version: "encryptionkey@0"
I20260812 01:05:20.453321 10058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "dbf116dc09954e43bdca5b13eb3d48c4"
format_stamp: "Formatted at 2026-08-12 01:05:20 on dist-test-slave-bndk"
server_key: "8c0f4095c26206e9b79a044d9e040b1a"
server_key_iv: "f0ab1387aeb57390215aa6df3d92b4bb"
server_key_version: "encryptionkey@0"
I20260812 01:05:20.458079 10058 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 01:05:20.461176 10085 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:20.462363 10058 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 01:05:20.462522 10058 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "dbf116dc09954e43bdca5b13eb3d48c4"
format_stamp: "Formatted at 2026-08-12 01:05:20 on dist-test-slave-bndk"
server_key: "8c0f4095c26206e9b79a044d9e040b1a"
server_key_iv: "f0ab1387aeb57390215aa6df3d92b4bb"
server_key_version: "encryptionkey@0"
I20260812 01:05:20.462689 10058 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:20.492545 10058 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:20.496750 10058 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:20.497032 10058 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:20.514364 10058 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:45537
I20260812 01:05:20.514371 10159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:45537 every 8 connection(s)
I20260812 01:05:20.515830 10058 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:05:20.516955 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 10058
I20260812 01:05:20.517180 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:05:20.517995 4901 external_mini_cluster.cc:1428] Setting key a6256abfe8482cc39db02e67b42e2130
I20260812 01:05:20.520417 10162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:20.530936 10162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbf116dc09954e43bdca5b13eb3d48c4: Bootstrap starting.
Aug 12 01:05:20 dist-test-slave-bndk krb5kdc[10031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496720, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:20.533998 10162 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dbf116dc09954e43bdca5b13eb3d48c4: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:20.535022 10162 log.cc:824] T 00000000000000000000000000000000 P dbf116dc09954e43bdca5b13eb3d48c4: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:20.538250 10162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbf116dc09954e43bdca5b13eb3d48c4: No bootstrap required, opened a new log
I20260812 01:05:20.539361 10165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:20.520105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41182 (local address 127.4.201.126:45537)
0812 01:05:20.520906 (+ 801us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:20.520917 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:20.520956 (+ 39us) server_negotiation.cc:407] Connection header received
0812 01:05:20.522587 (+ 1631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:20.522609 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:20.522975 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:20.523330 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:20.524697 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:20.526045 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:20.527237 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:20.527906 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:20.528092 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:20.531992 (+ 3900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:20.531999 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:20.532013 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:20.532051 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:20.535027 (+ 2976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:20.535704 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:20.535711 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:20.535717 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:20.535885 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:20.536322 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:20.536326 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:20.536330 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:20.536987 (+ 657us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:20.537316 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:20.537686 (+ 370us) server_negotiation.cc:299] Negotiation successful
0812 01:05:20.538097 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":591,"thread_start_us":358,"threads_started":1}
I20260812 01:05:20.546243 10162 raft_consensus.cc:348] T 00000000000000000000000000000000 P dbf116dc09954e43bdca5b13eb3d48c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbf116dc09954e43bdca5b13eb3d48c4" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45537 } }
I20260812 01:05:20.546567 10162 raft_consensus.cc:374] T 00000000000000000000000000000000 P dbf116dc09954e43bdca5b13eb3d48c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:20.546648 10162 raft_consensus.cc:729] T 00000000000000000000000000000000 P dbf116dc09954e43bdca5b13eb3d48c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbf116dc09954e43bdca5b13eb3d48c4, State: Initialized, Role: FOLLOWER
I20260812 01:05:20.547247 10162 consensus_queue.cc:260] T 00000000000000000000000000000000 P dbf116dc09954e43bdca5b13eb3d48c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbf116dc09954e43bdca5b13eb3d48c4" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45537 } }
I20260812 01:05:20.547519 10162 raft_consensus.cc:388] T 00000000000000000000000000000000 P dbf116dc09954e43bdca5b13eb3d48c4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:05:20.547657 10162 raft_consensus.cc:482] T 00000000000000000000000000000000 P dbf116dc09954e43bdca5b13eb3d48c4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:05:20.547813 10162 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dbf116dc09954e43bdca5b13eb3d48c4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:20.549995 10162 raft_consensus.cc:504] T 00000000000000000000000000000000 P dbf116dc09954e43bdca5b13eb3d48c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbf116dc09954e43bdca5b13eb3d48c4" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45537 } }
I20260812 01:05:20.550448 10162 leader_election.cc:302] T 00000000000000000000000000000000 P dbf116dc09954e43bdca5b13eb3d48c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dbf116dc09954e43bdca5b13eb3d48c4; no voters:
I20260812 01:05:20.551028 10162 leader_election.cc:288] T 00000000000000000000000000000000 P dbf116dc09954e43bdca5b13eb3d48c4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:05:20.551169 10167 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dbf116dc09954e43bdca5b13eb3d48c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:05:20.552233 10167 raft_consensus.cc:686] T 00000000000000000000000000000000 P dbf116dc09954e43bdca5b13eb3d48c4 [term 1 LEADER]: Becoming Leader. State: Replica: dbf116dc09954e43bdca5b13eb3d48c4, State: Running, Role: LEADER
I20260812 01:05:20.552695 10167 consensus_queue.cc:237] T 00000000000000000000000000000000 P dbf116dc09954e43bdca5b13eb3d48c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbf116dc09954e43bdca5b13eb3d48c4" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45537 } }
I20260812 01:05:20.553104 10162 sys_catalog.cc:564] T 00000000000000000000000000000000 P dbf116dc09954e43bdca5b13eb3d48c4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:05:20.555430 10169 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbf116dc09954e43bdca5b13eb3d48c4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dbf116dc09954e43bdca5b13eb3d48c4. Latest consensus state: current_term: 1 leader_uuid: "dbf116dc09954e43bdca5b13eb3d48c4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbf116dc09954e43bdca5b13eb3d48c4" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45537 } } }
I20260812 01:05:20.555809 10169 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbf116dc09954e43bdca5b13eb3d48c4 [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:20.556270 10168 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbf116dc09954e43bdca5b13eb3d48c4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dbf116dc09954e43bdca5b13eb3d48c4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbf116dc09954e43bdca5b13eb3d48c4" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45537 } } }
I20260812 01:05:20.556565 10168 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbf116dc09954e43bdca5b13eb3d48c4 [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:20.559568 10178 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:05:20.564505 10178 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:05:20.572479 10178 catalog_manager.cc:1347] Generated new cluster ID: ae25666cad82407d96df156eba5eaecf
I20260812 01:05:20.572582 10178 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:05:20.605183 10178 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:05:20.606458 10178 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:05:20.613680 10178 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dbf116dc09954e43bdca5b13eb3d48c4: Generated new TSK 0
I20260812 01:05:20.614404 10178 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.201.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
I20260812 01:05:20.668251 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:0
--local_ip_for_outbound_sockets=127.4.201.65
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:45537
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:40021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:20.989208 10198 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:20.989498 10198 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:20.989619 10198 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:20.996624 10198 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:20.996727 10198 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:20.996884 10198 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:05:21.006385 10198 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:40021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:45537
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:21.007663 10198 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:21.008941 10198 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:21.021600 10204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:21.021562 10205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:21.021517 10210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:21.022348 10198 server_base.cc:1034] running on GCE node
I20260812 01:05:21.022909 10198 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:21.023729 10198 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:21.024915 10198 hybrid_clock.cc:648] HybridClock initialized: now 1786496721024863 us; error 43 us; skew 500 ppm
I20260812 01:05:21.025169 10198 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:21 dist-test-slave-bndk krb5kdc[10031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496721, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:21.028131 10198 init.cc:377] Logged in from keytab as kudu/127.4.201.65@KRBTEST.COM (short username kudu)
I20260812 01:05:21.029526 10198 webserver.cc:460] Webserver started at http://127.4.201.65:36907/ using document root <none> and password file <none>
I20260812 01:05:21.030130 10198 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:21.030226 10198 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:21.030491 10198 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:21.033242 10198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/data/instance:
uuid: "83618b824b0d451ab52f901e0f786f30"
format_stamp: "Formatted at 2026-08-12 01:05:21 on dist-test-slave-bndk"
server_key: "94d2869e27dee58facf20e024b710d51"
server_key_iv: "ed056c2121fffa14a063902c4fdf9ae0"
server_key_version: "encryptionkey@0"
I20260812 01:05:21.033988 10198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance:
uuid: "83618b824b0d451ab52f901e0f786f30"
format_stamp: "Formatted at 2026-08-12 01:05:21 on dist-test-slave-bndk"
server_key: "94d2869e27dee58facf20e024b710d51"
server_key_iv: "ed056c2121fffa14a063902c4fdf9ae0"
server_key_version: "encryptionkey@0"
I20260812 01:05:21.039222 10198 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 01:05:21.042734 10220 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:21.043955 10198 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 01:05:21.044111 10198 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "83618b824b0d451ab52f901e0f786f30"
format_stamp: "Formatted at 2026-08-12 01:05:21 on dist-test-slave-bndk"
server_key: "94d2869e27dee58facf20e024b710d51"
server_key_iv: "ed056c2121fffa14a063902c4fdf9ae0"
server_key_version: "encryptionkey@0"
I20260812 01:05:21.044283 10198 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:21.074575 10198 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:21.078274 10198 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:21.078558 10198 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:21.079481 10198 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:05:21.080786 10198 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:21.080863 10198 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:21.080997 10198 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:21.081053 10198 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:21.111055 10198 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:42595
I20260812 01:05:21.111099 10415 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:42595 every 8 connection(s)
I20260812 01:05:21.112330 10198 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:05:21.117619 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 10198
I20260812 01:05:21.117815 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance
I20260812 01:05:21.118606 4901 external_mini_cluster.cc:1428] Setting key bef8acb40df4cfa586d82428615b277b
Aug 12 01:05:21 dist-test-slave-bndk krb5kdc[10031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496721, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:21.133390 10421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:21.115012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:37089 (local address 127.4.201.126:45537)
0812 01:05:21.115429 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:21.115434 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:21.116513 (+ 1079us) server_negotiation.cc:407] Connection header received
0812 01:05:21.118894 (+ 2381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:21.118899 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:21.118982 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:21.119080 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:21.120603 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:21.121339 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:21.123489 (+ 2150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:21.123869 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:21.123960 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:21.127863 (+ 3903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:21.127868 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:21.127871 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:21.127903 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:21.130368 (+ 2465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:21.131155 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:21.131159 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:21.131161 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:21.131275 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:21.131773 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:21.131776 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:21.131778 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:21.132022 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:21.132142 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:21.132908 (+ 766us) server_negotiation.cc:299] Negotiation successful
0812 01:05:21.133077 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":207,"threads_started":1}
I20260812 01:05:21.134693 10422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:21.115665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45537 (local address 127.4.201.65:37089)
0812 01:05:21.116349 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:21.116388 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:21.118572 (+ 2184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:21.119355 (+ 783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:21.119363 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:21.119867 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:21.120413 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:21.120432 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:21.121520 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:21.121526 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:21.123347 (+ 1821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:21.123363 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:21.124092 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:21.124098 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:21.124355 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:21.125034 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:21.125062 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:21.127649 (+ 2587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:21.130510 (+ 2861us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:21.130519 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:21.130536 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:21.131060 (+ 524us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:21.131391 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:21.131396 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:21.131399 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:21.131681 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:21.132145 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:21.132153 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:21.132557 (+ 404us) client_negotiation.cc:769] Sending connection context
0812 01:05:21.132840 (+ 283us) client_negotiation.cc:240] Negotiation successful
0812 01:05:21.133415 (+ 575us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":274,"threads_started":1}
I20260812 01:05:21.136262 10416 heartbeater.cc:347] Connected to a master server at 127.4.201.126:45537
I20260812 01:05:21.136565 10416 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:21.137375 10416 heartbeater.cc:511] Master 127.4.201.126:45537 requested a full tablet report, sending...
I20260812 01:05:21.139386 10107 ts_manager.cc:194] Registered new tserver with Master: 83618b824b0d451ab52f901e0f786f30 (127.4.201.65:42595)
WARNING: no policy specified for kudu/127.4.201.66@KRBTEST.COM; defaulting to no policy
I20260812 01:05:21.140842 10107 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.65@KRBTEST.COM'} at 127.4.201.65:37089
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
I20260812 01:05:21.167789 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:0
--local_ip_for_outbound_sockets=127.4.201.66
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:45537
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:40021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:21.491734 10428 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:21.492000 10428 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:21.492121 10428 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:21.499171 10428 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:21.499272 10428 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:21.499424 10428 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:05:21.508967 10428 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:40021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:45537
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:21.510248 10428 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:21.511559 10428 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:21.524163 10440 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:21.524209 10444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:21.524501 10439 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:21.525552 10428 server_base.cc:1034] running on GCE node
I20260812 01:05:21.526142 10428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:21.527009 10428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:21.528205 10428 hybrid_clock.cc:648] HybridClock initialized: now 1786496721528154 us; error 44 us; skew 500 ppm
I20260812 01:05:21.528493 10428 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:21 dist-test-slave-bndk krb5kdc[10031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496721, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:21.531529 10428 init.cc:377] Logged in from keytab as kudu/127.4.201.66@KRBTEST.COM (short username kudu)
I20260812 01:05:21.532824 10428 webserver.cc:460] Webserver started at http://127.4.201.66:46455/ using document root <none> and password file <none>
I20260812 01:05:21.533557 10428 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:21.533679 10428 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:21.533959 10428 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:21.536732 10428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/data/instance:
uuid: "3b99974e4b994c58a31c600220f1a9b8"
format_stamp: "Formatted at 2026-08-12 01:05:21 on dist-test-slave-bndk"
server_key: "545cab00fc93a34bd60ae44ee508dded"
server_key_iv: "9175aba95586557d40b582b1b518e992"
server_key_version: "encryptionkey@0"
I20260812 01:05:21.537510 10428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance:
uuid: "3b99974e4b994c58a31c600220f1a9b8"
format_stamp: "Formatted at 2026-08-12 01:05:21 on dist-test-slave-bndk"
server_key: "545cab00fc93a34bd60ae44ee508dded"
server_key_iv: "9175aba95586557d40b582b1b518e992"
server_key_version: "encryptionkey@0"
I20260812 01:05:21.542307 10428 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 01:05:21.545547 10457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:21.546742 10428 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 01:05:21.546892 10428 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "3b99974e4b994c58a31c600220f1a9b8"
format_stamp: "Formatted at 2026-08-12 01:05:21 on dist-test-slave-bndk"
server_key: "545cab00fc93a34bd60ae44ee508dded"
server_key_iv: "9175aba95586557d40b582b1b518e992"
server_key_version: "encryptionkey@0"
I20260812 01:05:21.547096 10428 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:21.570652 10428 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:21.574604 10428 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:21.574868 10428 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:21.575774 10428 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:05:21.577054 10428 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:21.577132 10428 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:21.577275 10428 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:21.577333 10428 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260812 01:05:21.606536 10428 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:46833
I20260812 01:05:21.606578 10628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:46833 every 8 connection(s)
I20260812 01:05:21.607734 10428 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:05:21.616226 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 10428
I20260812 01:05:21.616389 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance
I20260812 01:05:21.616900 4901 external_mini_cluster.cc:1428] Setting key 7e76812ad6b98961fc20ce64cf22f7c7
Aug 12 01:05:21 dist-test-slave-bndk krb5kdc[10031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496721, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:21.627723 10421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:21.610206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:59675 (local address 127.4.201.126:45537)
0812 01:05:21.610381 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:21.610386 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:21.611464 (+ 1078us) server_negotiation.cc:407] Connection header received
0812 01:05:21.613253 (+ 1789us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:21.613259 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:21.613338 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:21.613427 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:21.614907 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:21.615642 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:21.617198 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:21.617752 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:21.617868 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:21.621836 (+ 3968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:21.621843 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:21.621847 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:21.621885 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:21.624806 (+ 2921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:21.625535 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:21.625541 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:21.625544 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:21.625696 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:21.626075 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:21.626079 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:21.626082 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:21.626401 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:21.626544 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:21.627141 (+ 597us) server_negotiation.cc:299] Negotiation successful
0812 01:05:21.627369 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 01:05:21.628636 10635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:21.610625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45537 (local address 127.4.201.66:59675)
0812 01:05:21.611318 (+ 693us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:21.611357 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:21.612969 (+ 1612us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:21.613664 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:21.613672 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:21.614210 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:21.614740 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:21.614757 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:21.615795 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:21.615799 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:21.617063 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:21.617077 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:21.617972 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:21.617989 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:21.618208 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:21.618868 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:21.618897 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:21.621605 (+ 2708us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:21.624935 (+ 3330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:21.624942 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:21.624954 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:21.625428 (+ 474us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:21.625793 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:21.625796 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:21.625798 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:21.625970 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:21.626506 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:21.626511 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:21.626797 (+ 286us) client_negotiation.cc:769] Sending connection context
0812 01:05:21.627045 (+ 248us) client_negotiation.cc:240] Negotiation successful
0812 01:05:21.627534 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":266,"threads_started":1}
I20260812 01:05:21.630106 10630 heartbeater.cc:347] Connected to a master server at 127.4.201.126:45537
I20260812 01:05:21.630389 10630 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:21.631079 10630 heartbeater.cc:511] Master 127.4.201.126:45537 requested a full tablet report, sending...
I20260812 01:05:21.632508 10107 ts_manager.cc:194] Registered new tserver with Master: 3b99974e4b994c58a31c600220f1a9b8 (127.4.201.66:46833)
I20260812 01:05:21.633322 10107 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.66@KRBTEST.COM'} at 127.4.201.66:59675
WARNING: no policy specified for kudu/127.4.201.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
I20260812 01:05:21.662406 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:0
--local_ip_for_outbound_sockets=127.4.201.67
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:45537
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:40021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:21.982349 10646 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:21.982640 10646 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:21.982744 10646 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:21.989910 10646 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:21.990005 10646 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:21.990118 10646 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:05:21.999505 10646 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:40021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:45537
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:22.000700 10646 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:22.002007 10646 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:22.014627 10660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:22.014535 10663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:22.014585 10656 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:22.015529 10646 server_base.cc:1034] running on GCE node
I20260812 01:05:22.016047 10646 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:22.016855 10646 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:22.018045 10646 hybrid_clock.cc:648] HybridClock initialized: now 1786496722018008 us; error 29 us; skew 500 ppm
I20260812 01:05:22.018332 10646 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:22 dist-test-slave-bndk krb5kdc[10031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496722, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:22.025962 10646 init.cc:377] Logged in from keytab as kudu/127.4.201.67@KRBTEST.COM (short username kudu)
I20260812 01:05:22.027345 10646 webserver.cc:460] Webserver started at http://127.4.201.67:38269/ using document root <none> and password file <none>
I20260812 01:05:22.027992 10646 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:22.028110 10646 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:22.028398 10646 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:22.031239 10646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/data/instance:
uuid: "6cfcd46ffea04cb582786c9772585ff2"
format_stamp: "Formatted at 2026-08-12 01:05:22 on dist-test-slave-bndk"
server_key: "b86b4fea1cfd0eaf2059c29a2d463caf"
server_key_iv: "e73725aefa844477597997dccb6a464c"
server_key_version: "encryptionkey@0"
I20260812 01:05:22.032034 10646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance:
uuid: "6cfcd46ffea04cb582786c9772585ff2"
format_stamp: "Formatted at 2026-08-12 01:05:22 on dist-test-slave-bndk"
server_key: "b86b4fea1cfd0eaf2059c29a2d463caf"
server_key_iv: "e73725aefa844477597997dccb6a464c"
server_key_version: "encryptionkey@0"
I20260812 01:05:22.036967 10646 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260812 01:05:22.040341 10677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:22.041632 10646 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:05:22.041783 10646 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "6cfcd46ffea04cb582786c9772585ff2"
format_stamp: "Formatted at 2026-08-12 01:05:22 on dist-test-slave-bndk"
server_key: "b86b4fea1cfd0eaf2059c29a2d463caf"
server_key_iv: "e73725aefa844477597997dccb6a464c"
server_key_version: "encryptionkey@0"
I20260812 01:05:22.041947 10646 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:22.056555 10646 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:22.060047 10646 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:22.060308 10646 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:22.061188 10646 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:05:22.062575 10646 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:22.062649 10646 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:22.062786 10646 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:22.062839 10646 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:22.093086 10646 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:38381
I20260812 01:05:22.093122 10852 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:38381 every 8 connection(s)
I20260812 01:05:22.094341 10646 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:05:22.100545 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 10646
I20260812 01:05:22.100697 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance
I20260812 01:05:22.101120 4901 external_mini_cluster.cc:1428] Setting key 924165c036d724850a73e8b0076c1685
Aug 12 01:05:22 dist-test-slave-bndk krb5kdc[10031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496722, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:22.114243 10421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:22.096698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:45813 (local address 127.4.201.126:45537)
0812 01:05:22.096860 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:22.096865 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:22.098029 (+ 1164us) server_negotiation.cc:407] Connection header received
0812 01:05:22.099883 (+ 1854us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:22.099890 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:22.099978 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:22.100075 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:22.101701 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:22.102681 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:22.104690 (+ 2009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:22.105083 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:22.105178 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:22.108392 (+ 3214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:22.108397 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:22.108400 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:22.108432 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:22.111157 (+ 2725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:22.112036 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:22.112041 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:22.112043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:22.112175 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:22.112626 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:22.112629 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:22.112631 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:22.112894 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:22.113016 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:22.113815 (+ 799us) server_negotiation.cc:299] Negotiation successful
0812 01:05:22.113993 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 01:05:22.115456 10857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:22.097139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45537 (local address 127.4.201.67:45813)
0812 01:05:22.097873 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:22.097910 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:22.099510 (+ 1600us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:22.100336 (+ 826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:22.100345 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:22.100906 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:22.101508 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:22.101527 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:22.102893 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:22.102902 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:22.104563 (+ 1661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:22.104576 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:22.105281 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:22.105287 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:22.105492 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:22.106093 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:22.106116 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:22.108178 (+ 2062us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:22.111308 (+ 3130us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:22.111318 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:22.111332 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:22.111891 (+ 559us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:22.112276 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:22.112280 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:22.112284 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:22.112527 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:22.113020 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:22.113027 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:22.113431 (+ 404us) client_negotiation.cc:769] Sending connection context
0812 01:05:22.113707 (+ 276us) client_negotiation.cc:240] Negotiation successful
0812 01:05:22.114207 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":266,"threads_started":1}
I20260812 01:05:22.116757 10853 heartbeater.cc:347] Connected to a master server at 127.4.201.126:45537
I20260812 01:05:22.117044 10853 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:22.117797 10853 heartbeater.cc:511] Master 127.4.201.126:45537 requested a full tablet report, sending...
I20260812 01:05:22.119164 10106 ts_manager.cc:194] Registered new tserver with Master: 6cfcd46ffea04cb582786c9772585ff2 (127.4.201.67:38381)
I20260812 01:05:22.120066 10106 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.67@KRBTEST.COM'} at 127.4.201.67:45813
I20260812 01:05:22.128389 4901 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:05:22.143923 10416 heartbeater.cc:503] Master 127.4.201.126:45537 was elected leader, sending a full tablet report...
Aug 12 01:05:22 dist-test-slave-bndk krb5kdc[10031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496722, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 12 01:05:22 dist-test-slave-bndk krb5kdc[10031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496722, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:22.180505 10421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:22.167803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41196 (local address 127.4.201.126:45537)
0812 01:05:22.167962 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:22.167967 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:22.168436 (+ 469us) server_negotiation.cc:407] Connection header received
0812 01:05:22.168612 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:22.168616 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:22.168682 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:22.168758 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:22.170110 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:22.170845 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:22.172062 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:22.172445 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:22.172550 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:22.176030 (+ 3480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:22.176035 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:22.176038 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:22.176071 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:22.178493 (+ 2422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:22.179015 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:22.179019 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:22.179022 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:22.179149 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:22.179432 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:22.179435 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:22.179437 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:22.179754 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:22.179944 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:22.180109 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 01:05:22.180265 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260812 01:05:22.181074 10106 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:41196
I20260812 01:05:22.182621 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 10198
Aug 12 01:05:22 dist-test-slave-bndk krb5kdc[10031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496722, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.4.201.65@KRBTEST.COM
I20260812 01:05:22.197938 10873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:22.184138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42576 (local address 127.4.201.65:42595)
0812 01:05:22.184759 (+ 621us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:22.184766 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:22.184792 (+ 26us) server_negotiation.cc:407] Connection header received
0812 01:05:22.184846 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:22.184853 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:22.185069 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:22.185189 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:22.186249 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:22.187276 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:22.188361 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:22.188896 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:22.188995 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:22.192561 (+ 3566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:22.192572 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:22.192587 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:22.192622 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:22.195267 (+ 2645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:22.195888 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:22.195896 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:22.195899 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:22.196024 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:22.196380 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:22.196384 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:22.196386 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:22.196727 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:22.197023 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:22.197359 (+ 336us) server_negotiation.cc:299] Negotiation successful
0812 01:05:22.197630 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":323,"threads_started":1}
W20260812 01:05:22.199150 10406 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:42576
W20260812 01:05:22.200181 4901 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 10198: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 01:05:22.200373 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 10198
I20260812 01:05:22.227375 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 10428
Aug 12 01:05:22 dist-test-slave-bndk krb5kdc[10031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496722, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.4.201.66@KRBTEST.COM
I20260812 01:05:22.247339 10874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:22.228315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60972 (local address 127.4.201.66:46833)
0812 01:05:22.229673 (+ 1358us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:22.229680 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:22.229707 (+ 27us) server_negotiation.cc:407] Connection header received
0812 01:05:22.229770 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:22.229776 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:22.230079 (+ 303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:22.230256 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:22.231880 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:22.233893 (+ 2013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:22.235293 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:22.236433 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:22.236573 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:22.241241 (+ 4668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:22.241256 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:22.241277 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:22.241317 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:22.244207 (+ 2890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:22.244839 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:22.244846 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:22.244849 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:22.245011 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:22.245413 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:22.245419 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:22.245423 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:22.245792 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:22.246094 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:22.246692 (+ 598us) server_negotiation.cc:299] Negotiation successful
0812 01:05:22.246961 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1198,"thread_start_us":1054,"threads_started":1}
W20260812 01:05:22.248980 10622 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:60972
W20260812 01:05:22.250257 4901 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 10428: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 01:05:22.250408 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 10428
I20260812 01:05:22.279119 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 10646
Aug 12 01:05:22 dist-test-slave-bndk krb5kdc[10031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496722, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.4.201.67@KRBTEST.COM
I20260812 01:05:22.294816 10875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:22.280081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59194 (local address 127.4.201.67:38381)
0812 01:05:22.280680 (+ 599us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:22.280688 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:22.280718 (+ 30us) server_negotiation.cc:407] Connection header received
0812 01:05:22.280782 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:22.280788 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:22.281024 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:22.281151 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:22.282424 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:22.283497 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:22.284653 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:22.285206 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:22.285485 (+ 279us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:22.289647 (+ 4162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:22.289658 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:22.289674 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:22.289707 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:22.292220 (+ 2513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:22.292825 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:22.292832 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:22.292834 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:22.292951 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:22.293272 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:22.293275 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:22.293278 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:22.293630 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:22.293870 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:22.294132 (+ 262us) server_negotiation.cc:299] Negotiation successful
0812 01:05:22.294341 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":271,"threads_started":1}
W20260812 01:05:22.296099 10846 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:59194
W20260812 01:05:22.297184 4901 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 10646: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 01:05:22.297369 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 10646
I20260812 01:05:22.323995 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 10058
I20260812 01:05:22.325158 10152 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:22.428556 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 10058
2026-08-12T01:05:22Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3740 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:05:22 dist-test-slave-bndk krb5kdc[10884](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:05:22 dist-test-slave-bndk krb5kdc[10884](info): set up 2 sockets
Aug 12 01:05:22 dist-test-slave-bndk krb5kdc[10884](info): commencing operation
krb5kdc: starting...
W20260812 01:05:23.630861 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.155s user 0.006s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:05:23 dist-test-slave-bndk krb5kdc[10884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496723, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:05:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:05:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.201.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
I20260812 01:05:23.830411 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:44381
--webserver_interface=127.4.201.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:33897
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:44381
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:24.146930 10903 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:24.147203 10903 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:24.147329 10903 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:24.154718 10903 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:05:24.154825 10903 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:24.154898 10903 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:24.154978 10903 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:05:24.155038 10903 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:05:24.164688 10903 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:33897
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:44381
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:44381
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:24.165989 10903 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:24.167253 10903 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:24.179147 10915 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:24.179177 10911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:24.179388 10912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:24.180044 10903 server_base.cc:1034] running on GCE node
I20260812 01:05:24.180787 10903 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:24.182155 10903 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:24.183354 10903 hybrid_clock.cc:648] HybridClock initialized: now 1786496724183286 us; error 60 us; skew 500 ppm
I20260812 01:05:24.183688 10903 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:24 dist-test-slave-bndk krb5kdc[10884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496724, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:24.186686 10903 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:05:24.188056 10903 webserver.cc:460] Webserver started at http://127.4.201.126:39301/ using document root <none> and password file <none>
I20260812 01:05:24.188697 10903 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:24.188799 10903 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:24.189064 10903 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:24.191972 10903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "7f64305a523d4d30aacac5d279686dbf"
format_stamp: "Formatted at 2026-08-12 01:05:24 on dist-test-slave-bndk"
server_key: "b41965dfb777a7108493caa7e679af38"
server_key_iv: "ae02b37d7138093fcb126fd77e2a0fce"
server_key_version: "encryptionkey@0"
I20260812 01:05:24.192693 10903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "7f64305a523d4d30aacac5d279686dbf"
format_stamp: "Formatted at 2026-08-12 01:05:24 on dist-test-slave-bndk"
server_key: "b41965dfb777a7108493caa7e679af38"
server_key_iv: "ae02b37d7138093fcb126fd77e2a0fce"
server_key_version: "encryptionkey@0"
I20260812 01:05:24.197547 10903 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 01:05:24.200722 10923 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:24.201975 10903 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:05:24.202131 10903 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "7f64305a523d4d30aacac5d279686dbf"
format_stamp: "Formatted at 2026-08-12 01:05:24 on dist-test-slave-bndk"
server_key: "b41965dfb777a7108493caa7e679af38"
server_key_iv: "ae02b37d7138093fcb126fd77e2a0fce"
server_key_version: "encryptionkey@0"
I20260812 01:05:24.202304 10903 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:24.217808 10903 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:24.221517 10903 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:24.221767 10903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:24.238794 10903 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:44381
I20260812 01:05:24.238812 10996 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:44381 every 8 connection(s)
I20260812 01:05:24.240053 10903 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:05:24.243613 10997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:24.247493 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 10903
I20260812 01:05:24.247735 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:05:24.248503 4901 external_mini_cluster.cc:1428] Setting key 9e334ff59d5d8d3aaeb9e08dcc538512
I20260812 01:05:24.255230 10997 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f64305a523d4d30aacac5d279686dbf: Bootstrap starting.
I20260812 01:05:24.258715 10997 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f64305a523d4d30aacac5d279686dbf: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:24.259862 10997 log.cc:824] T 00000000000000000000000000000000 P 7f64305a523d4d30aacac5d279686dbf: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:24.263105 10997 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f64305a523d4d30aacac5d279686dbf: No bootstrap required, opened a new log
Aug 12 01:05:24 dist-test-slave-bndk krb5kdc[10884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496723, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:24.271925 11002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:24.250574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43076 (local address 127.4.201.126:44381)
0812 01:05:24.251326 (+ 752us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:24.251338 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:24.251376 (+ 38us) server_negotiation.cc:407] Connection header received
0812 01:05:24.253701 (+ 2325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:24.253726 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:24.254079 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:24.254372 (+ 293us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:24.256257 (+ 1885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:24.257621 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:24.259336 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:24.260027 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:24.260156 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:24.264800 (+ 4644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:24.264809 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:24.264826 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:24.264866 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:24.267964 (+ 3098us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:24.268765 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:24.268771 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:24.268777 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:24.268942 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:24.269335 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:24.269342 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:24.269344 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:24.269881 (+ 537us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:24.270123 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:24.270559 (+ 436us) server_negotiation.cc:299] Negotiation successful
0812 01:05:24.270910 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":536,"thread_start_us":329,"threads_started":1}
I20260812 01:05:24.271950 10997 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f64305a523d4d30aacac5d279686dbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f64305a523d4d30aacac5d279686dbf" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44381 } }
I20260812 01:05:24.272346 10997 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7f64305a523d4d30aacac5d279686dbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:24.272445 10997 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f64305a523d4d30aacac5d279686dbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f64305a523d4d30aacac5d279686dbf, State: Initialized, Role: FOLLOWER
I20260812 01:05:24.272981 10997 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f64305a523d4d30aacac5d279686dbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f64305a523d4d30aacac5d279686dbf" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44381 } }
I20260812 01:05:24.273260 10997 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f64305a523d4d30aacac5d279686dbf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:05:24.273419 10997 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f64305a523d4d30aacac5d279686dbf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:05:24.273600 10997 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f64305a523d4d30aacac5d279686dbf [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:24.276024 10997 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f64305a523d4d30aacac5d279686dbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f64305a523d4d30aacac5d279686dbf" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44381 } }
I20260812 01:05:24.276597 10997 leader_election.cc:302] T 00000000000000000000000000000000 P 7f64305a523d4d30aacac5d279686dbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f64305a523d4d30aacac5d279686dbf; no voters:
I20260812 01:05:24.277186 10997 leader_election.cc:288] T 00000000000000000000000000000000 P 7f64305a523d4d30aacac5d279686dbf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:05:24.277320 11005 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f64305a523d4d30aacac5d279686dbf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:05:24.277983 11005 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f64305a523d4d30aacac5d279686dbf [term 1 LEADER]: Becoming Leader. State: Replica: 7f64305a523d4d30aacac5d279686dbf, State: Running, Role: LEADER
I20260812 01:05:24.278553 11005 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f64305a523d4d30aacac5d279686dbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f64305a523d4d30aacac5d279686dbf" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44381 } }
I20260812 01:05:24.279207 10997 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f64305a523d4d30aacac5d279686dbf [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:05:24.281406 11008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f64305a523d4d30aacac5d279686dbf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7f64305a523d4d30aacac5d279686dbf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f64305a523d4d30aacac5d279686dbf" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44381 } } }
I20260812 01:05:24.281798 11008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f64305a523d4d30aacac5d279686dbf [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:24.282303 11010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f64305a523d4d30aacac5d279686dbf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f64305a523d4d30aacac5d279686dbf. Latest consensus state: current_term: 1 leader_uuid: "7f64305a523d4d30aacac5d279686dbf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f64305a523d4d30aacac5d279686dbf" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44381 } } }
I20260812 01:05:24.282578 11010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f64305a523d4d30aacac5d279686dbf [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:24.283593 11023 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:05:24.288347 11023 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:05:24.297514 11023 catalog_manager.cc:1347] Generated new cluster ID: 3eb1302f59c44ad4aea955f1b9ed63c5
I20260812 01:05:24.297614 11023 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:05:24.316857 11023 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:05:24.318197 11023 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:05:24.332037 11023 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7f64305a523d4d30aacac5d279686dbf: Generated new TSK 0
I20260812 01:05:24.333145 11023 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.201.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
I20260812 01:05:24.392827 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:0
--local_ip_for_outbound_sockets=127.4.201.65
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:44381
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:33897
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:24.718467 11041 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:24.718739 11041 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:24.718858 11041 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:24.726114 11041 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:24.726222 11041 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:24.726367 11041 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:05:24.735863 11041 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:33897
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:44381
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:24.737090 11041 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:24.738397 11041 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:24.750737 11054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:24.750782 11051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:24.750820 11056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:24.751509 11041 server_base.cc:1034] running on GCE node
I20260812 01:05:24.752053 11041 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:24.752861 11041 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:24.754097 11041 hybrid_clock.cc:648] HybridClock initialized: now 1786496724754043 us; error 40 us; skew 500 ppm
I20260812 01:05:24.754403 11041 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:24 dist-test-slave-bndk krb5kdc[10884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496724, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:24.757455 11041 init.cc:377] Logged in from keytab as kudu/127.4.201.65@KRBTEST.COM (short username kudu)
I20260812 01:05:24.758793 11041 webserver.cc:460] Webserver started at http://127.4.201.65:42203/ using document root <none> and password file <none>
I20260812 01:05:24.759421 11041 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:24.759524 11041 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:24.759783 11041 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:24.762650 11041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-0/data/instance:
uuid: "6e42d57df4484eb180db6999f04edbc5"
format_stamp: "Formatted at 2026-08-12 01:05:24 on dist-test-slave-bndk"
server_key: "4112fba1308c9ac401b023b962340445"
server_key_iv: "bce51c5576f4f98e3809cec2b0178ba2"
server_key_version: "encryptionkey@0"
I20260812 01:05:24.763420 11041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance:
uuid: "6e42d57df4484eb180db6999f04edbc5"
format_stamp: "Formatted at 2026-08-12 01:05:24 on dist-test-slave-bndk"
server_key: "4112fba1308c9ac401b023b962340445"
server_key_iv: "bce51c5576f4f98e3809cec2b0178ba2"
server_key_version: "encryptionkey@0"
I20260812 01:05:24.768435 11041 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260812 01:05:24.771788 11064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:24.773049 11041 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 01:05:24.773173 11041 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "6e42d57df4484eb180db6999f04edbc5"
format_stamp: "Formatted at 2026-08-12 01:05:24 on dist-test-slave-bndk"
server_key: "4112fba1308c9ac401b023b962340445"
server_key_iv: "bce51c5576f4f98e3809cec2b0178ba2"
server_key_version: "encryptionkey@0"
I20260812 01:05:24.773394 11041 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:24.795931 11041 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:24.799539 11041 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:24.799764 11041 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:24.800602 11041 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:05:24.801851 11041 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:24.801921 11041 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:24.802018 11041 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:24.802062 11041 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:24.832141 11041 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:42597
I20260812 01:05:24.832252 11234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:42597 every 8 connection(s)
I20260812 01:05:24.833422 11041 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:05:24.833891 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 11041
I20260812 01:05:24.834092 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance
I20260812 01:05:24.834928 4901 external_mini_cluster.cc:1428] Setting key 6b38d18b1aa6b0ee2b9a0993481e2e6f
Aug 12 01:05:24 dist-test-slave-bndk krb5kdc[10884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496724, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:24.853312 11238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:24.836069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:57843 (local address 127.4.201.126:44381)
0812 01:05:24.836501 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:24.836508 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:24.837662 (+ 1154us) server_negotiation.cc:407] Connection header received
0812 01:05:24.839480 (+ 1818us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:24.839485 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:24.839560 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:24.839671 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:24.841105 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:24.842081 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:24.843549 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:24.844090 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:24.844208 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:24.847435 (+ 3227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:24.847443 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:24.847447 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:24.847492 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:24.850412 (+ 2920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:24.851076 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:24.851081 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:24.851084 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:24.851223 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:24.851610 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:24.851614 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:24.851617 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:24.851922 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:24.852107 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:24.852697 (+ 590us) server_negotiation.cc:299] Negotiation successful
0812 01:05:24.852907 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":209,"threads_started":1}
I20260812 01:05:24.854211 11239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:24.836633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:44381 (local address 127.4.201.65:57843)
0812 01:05:24.837491 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:24.837546 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:24.839220 (+ 1674us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:24.839848 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:24.839855 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:24.840363 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:24.840935 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:24.840953 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:24.842211 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:24.842215 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:24.843410 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:24.843423 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:24.844266 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:24.844271 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:24.844456 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:24.845085 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:24.845106 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:24.847208 (+ 2102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:24.850542 (+ 3334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:24.850548 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:24.850560 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:24.850957 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:24.851323 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:24.851326 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:24.851328 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:24.851512 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:24.852047 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:24.852052 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:24.852331 (+ 279us) client_negotiation.cc:769] Sending connection context
0812 01:05:24.852560 (+ 229us) client_negotiation.cc:240] Negotiation successful
0812 01:05:24.853048 (+ 488us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":313,"threads_started":1}
I20260812 01:05:24.855731 11236 heartbeater.cc:347] Connected to a master server at 127.4.201.126:44381
I20260812 01:05:24.856016 11236 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:24.856689 11236 heartbeater.cc:511] Master 127.4.201.126:44381 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.4.201.66@KRBTEST.COM; defaulting to no policy
I20260812 01:05:24.858839 10956 ts_manager.cc:194] Registered new tserver with Master: 6e42d57df4484eb180db6999f04edbc5 (127.4.201.65:42597)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.66@KRBTEST.COM" created.
I20260812 01:05:24.860567 10956 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.65@KRBTEST.COM'} at 127.4.201.65:57843
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
I20260812 01:05:24.883543 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:0
--local_ip_for_outbound_sockets=127.4.201.66
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:44381
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:33897
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:25.205909 11244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:25.206164 11244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:25.206290 11244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:25.213773 11244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:25.213866 11244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:25.213982 11244 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:05:25.223258 11244 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:33897
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:44381
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:25.224387 11244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:25.225653 11244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:25.238088 11249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:25.238015 11250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:25.238265 11255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:25.238924 11244 server_base.cc:1034] running on GCE node
I20260812 01:05:25.239528 11244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:25.240391 11244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:25.241585 11244 hybrid_clock.cc:648] HybridClock initialized: now 1786496725241530 us; error 46 us; skew 500 ppm
I20260812 01:05:25.241870 11244 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:25 dist-test-slave-bndk krb5kdc[10884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496725, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:25.245059 11244 init.cc:377] Logged in from keytab as kudu/127.4.201.66@KRBTEST.COM (short username kudu)
I20260812 01:05:25.250895 11244 webserver.cc:460] Webserver started at http://127.4.201.66:36233/ using document root <none> and password file <none>
I20260812 01:05:25.251564 11244 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:25.251682 11244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:25.251976 11244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:25.254774 11244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-1/data/instance:
uuid: "0c1c439fef89415a90b4891836bc4672"
format_stamp: "Formatted at 2026-08-12 01:05:25 on dist-test-slave-bndk"
server_key: "302e2d76641c5d387060c7f57b5a8f41"
server_key_iv: "75ea9c735fb46b47d94e941fd95d6b97"
server_key_version: "encryptionkey@0"
I20260812 01:05:25.255509 11244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance:
uuid: "0c1c439fef89415a90b4891836bc4672"
format_stamp: "Formatted at 2026-08-12 01:05:25 on dist-test-slave-bndk"
server_key: "302e2d76641c5d387060c7f57b5a8f41"
server_key_iv: "75ea9c735fb46b47d94e941fd95d6b97"
server_key_version: "encryptionkey@0"
I20260812 01:05:25.260354 11244 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260812 01:05:25.263584 11265 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:25.264766 11244 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 01:05:25.264907 11244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "0c1c439fef89415a90b4891836bc4672"
format_stamp: "Formatted at 2026-08-12 01:05:25 on dist-test-slave-bndk"
server_key: "302e2d76641c5d387060c7f57b5a8f41"
server_key_iv: "75ea9c735fb46b47d94e941fd95d6b97"
server_key_version: "encryptionkey@0"
I20260812 01:05:25.265096 11244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:25.278013 11244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:25.281715 11244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:25.281988 11244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:25.282859 11244 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:05:25.284127 11244 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:25.284204 11244 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:25.284323 11244 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:25.284382 11244 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:25.314805 11244 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:34031
I20260812 01:05:25.314854 11461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:34031 every 8 connection(s)
I20260812 01:05:25.316100 11244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:05:25.320871 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 11244
I20260812 01:05:25.321082 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance
I20260812 01:05:25.321633 4901 external_mini_cluster.cc:1428] Setting key 1a04075c4e3677125a4aeddf5170a56b
Aug 12 01:05:25 dist-test-slave-bndk krb5kdc[10884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496725, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:25.337251 11238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:25.318645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:60481 (local address 127.4.201.126:44381)
0812 01:05:25.318852 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:25.318858 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:25.320028 (+ 1170us) server_negotiation.cc:407] Connection header received
0812 01:05:25.322380 (+ 2352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:25.322385 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:25.322479 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:25.322587 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:25.324518 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:25.325535 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:25.327064 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:25.327620 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:25.327749 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:25.331324 (+ 3575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:25.331331 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:25.331335 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:25.331374 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:25.334093 (+ 2719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:25.334906 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:25.334910 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:25.334913 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:25.335039 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:25.335486 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:25.335490 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:25.335492 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:25.335779 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:25.335915 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:25.336634 (+ 719us) server_negotiation.cc:299] Negotiation successful
0812 01:05:25.336872 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 01:05:25.338227 11466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:25.319164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:44381 (local address 127.4.201.66:60481)
0812 01:05:25.319872 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:25.319911 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:25.322068 (+ 2157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:25.322878 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:25.322889 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:25.323643 (+ 754us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:25.324328 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:25.324347 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:25.325683 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:25.325687 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:25.326916 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:25.326930 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:25.327855 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:25.327860 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:25.328076 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:25.328769 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:25.328792 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:25.331080 (+ 2288us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:25.334245 (+ 3165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:25.334255 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:25.334273 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:25.334807 (+ 534us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:25.335160 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:25.335165 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:25.335170 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:25.335365 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:25.335914 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:25.335923 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:25.336263 (+ 340us) client_negotiation.cc:769] Sending connection context
0812 01:05:25.336506 (+ 243us) client_negotiation.cc:240] Negotiation successful
0812 01:05:25.337039 (+ 533us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":265,"threads_started":1}
I20260812 01:05:25.339620 11463 heartbeater.cc:347] Connected to a master server at 127.4.201.126:44381
I20260812 01:05:25.339941 11463 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:25.340679 11463 heartbeater.cc:511] Master 127.4.201.126:44381 requested a full tablet report, sending...
I20260812 01:05:25.342142 10956 ts_manager.cc:194] Registered new tserver with Master: 0c1c439fef89415a90b4891836bc4672 (127.4.201.66:34031)
I20260812 01:05:25.342935 10956 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.66@KRBTEST.COM'} at 127.4.201.66:60481
WARNING: no policy specified for kudu/127.4.201.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
I20260812 01:05:25.370383 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:0
--local_ip_for_outbound_sockets=127.4.201.67
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:44381
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:33897
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:25.693585 11469 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:25.694000 11469 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:25.694154 11469 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:25.704057 11469 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:25.704192 11469 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:25.704384 11469 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:05:25.714629 11469 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:33897
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:44381
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:25.715794 11469 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:25.717013 11469 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:25.729820 11482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:25.730029 11483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:25.730070 11487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:25.730654 11469 server_base.cc:1034] running on GCE node
I20260812 01:05:25.731201 11469 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:25.732112 11469 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:25.733301 11469 hybrid_clock.cc:648] HybridClock initialized: now 1786496725733200 us; error 83 us; skew 500 ppm
I20260812 01:05:25.733609 11469 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:25 dist-test-slave-bndk krb5kdc[10884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496725, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:25.736521 11469 init.cc:377] Logged in from keytab as kudu/127.4.201.67@KRBTEST.COM (short username kudu)
I20260812 01:05:25.737908 11469 webserver.cc:460] Webserver started at http://127.4.201.67:44725/ using document root <none> and password file <none>
I20260812 01:05:25.738547 11469 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:25.738669 11469 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:25.738971 11469 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:25.741806 11469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-2/data/instance:
uuid: "060a4bf7d0b648cea9a4c86639d4d445"
format_stamp: "Formatted at 2026-08-12 01:05:25 on dist-test-slave-bndk"
server_key: "566a3ccc89fbf9605c5e7ca9d00bb402"
server_key_iv: "b2631a549db62d81e8be19b3b6769350"
server_key_version: "encryptionkey@0"
I20260812 01:05:25.742602 11469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance:
uuid: "060a4bf7d0b648cea9a4c86639d4d445"
format_stamp: "Formatted at 2026-08-12 01:05:25 on dist-test-slave-bndk"
server_key: "566a3ccc89fbf9605c5e7ca9d00bb402"
server_key_iv: "b2631a549db62d81e8be19b3b6769350"
server_key_version: "encryptionkey@0"
I20260812 01:05:25.747463 11469 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260812 01:05:25.750772 11500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:25.752084 11469 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 01:05:25.752235 11469 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "060a4bf7d0b648cea9a4c86639d4d445"
format_stamp: "Formatted at 2026-08-12 01:05:25 on dist-test-slave-bndk"
server_key: "566a3ccc89fbf9605c5e7ca9d00bb402"
server_key_iv: "b2631a549db62d81e8be19b3b6769350"
server_key_version: "encryptionkey@0"
I20260812 01:05:25.752413 11469 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:25.764756 11469 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:25.768425 11469 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:25.768687 11469 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:25.769660 11469 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:05:25.770933 11469 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:25.771019 11469 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:25.771139 11469 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:25.771194 11469 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:25.803723 11469 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:39725
I20260812 01:05:25.803771 11700 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:39725 every 8 connection(s)
I20260812 01:05:25.805013 11469 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:05:25.813369 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 11469
I20260812 01:05:25.813548 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance
I20260812 01:05:25.813941 4901 external_mini_cluster.cc:1428] Setting key 7c4016e6a3d1d34a76745683fa219e28
Aug 12 01:05:25 dist-test-slave-bndk krb5kdc[10884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496725, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:25.824137 11238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:25.807598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:58391 (local address 127.4.201.126:44381)
0812 01:05:25.807770 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:25.807775 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:25.808889 (+ 1114us) server_negotiation.cc:407] Connection header received
0812 01:05:25.810708 (+ 1819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:25.810714 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:25.810794 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:25.810881 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:25.812365 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:25.813206 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:25.814957 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:25.815437 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:25.815542 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:25.819044 (+ 3502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:25.819049 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:25.819053 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:25.819094 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:25.821570 (+ 2476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:25.822214 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:25.822218 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:25.822221 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:25.822379 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:25.822717 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:25.822719 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:25.822721 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:25.822985 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:25.823103 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:25.823700 (+ 597us) server_negotiation.cc:299] Negotiation successful
0812 01:05:25.823883 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 01:05:25.824980 11705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:25.808039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:44381 (local address 127.4.201.67:58391)
0812 01:05:25.808724 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:25.808767 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:25.810450 (+ 1683us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:25.811115 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:25.811123 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:25.811645 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:25.812189 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:25.812207 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:25.813378 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:25.813383 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:25.814824 (+ 1441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:25.814840 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:25.815640 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:25.815645 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:25.815925 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:25.816618 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:25.816649 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:25.818847 (+ 2198us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:25.821669 (+ 2822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:25.821675 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:25.821686 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:25.822087 (+ 401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:25.822467 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:25.822471 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:25.822474 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:25.822638 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:25.823081 (+ 443us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:25.823086 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:25.823354 (+ 268us) client_negotiation.cc:769] Sending connection context
0812 01:05:25.823570 (+ 216us) client_negotiation.cc:240] Negotiation successful
0812 01:05:25.823924 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":271,"threads_started":1}
I20260812 01:05:25.826284 11701 heartbeater.cc:347] Connected to a master server at 127.4.201.126:44381
I20260812 01:05:25.826571 11701 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:25.827289 11701 heartbeater.cc:511] Master 127.4.201.126:44381 requested a full tablet report, sending...
I20260812 01:05:25.828961 10954 ts_manager.cc:194] Registered new tserver with Master: 060a4bf7d0b648cea9a4c86639d4d445 (127.4.201.67:39725)
I20260812 01:05:25.829818 10954 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.67@KRBTEST.COM'} at 127.4.201.67:58391
I20260812 01:05:25.841006 4901 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:05:25.863528 11236 heartbeater.cc:503] Master 127.4.201.126:44381 was elected leader, sending a full tablet report...
Aug 12 01:05:25 dist-test-slave-bndk krb5kdc[10884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496725, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 01:05:25 dist-test-slave-bndk krb5kdc[10884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496725, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.65@KRBTEST.COM
I20260812 01:05:25.893467 11714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:25.878870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36110 (local address 127.4.201.65:42597)
0812 01:05:25.879657 (+ 787us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:25.879665 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:25.879692 (+ 27us) server_negotiation.cc:407] Connection header received
0812 01:05:25.879756 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:25.879763 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:25.879981 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:25.880160 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:25.881476 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:25.882536 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:25.883748 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:25.884297 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:25.884394 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:25.888108 (+ 3714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:25.888119 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:25.888134 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:25.888167 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:25.890826 (+ 2659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:25.891465 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:25.891473 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:25.891476 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:25.891614 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:25.892028 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:25.892031 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:25.892033 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:25.892360 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:25.892585 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:25.892861 (+ 276us) server_negotiation.cc:299] Negotiation successful
0812 01:05:25.893099 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":642,"thread_start_us":478,"threads_started":1}
Aug 12 01:05:25 dist-test-slave-bndk krb5kdc[10884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496725, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:25.910527 11238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:25.897622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43086 (local address 127.4.201.126:44381)
0812 01:05:25.897843 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:25.897849 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:25.898010 (+ 161us) server_negotiation.cc:407] Connection header received
0812 01:05:25.898171 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:25.898177 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:25.898245 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:25.898324 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:25.899501 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:25.900220 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:25.901485 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:25.901905 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:25.902016 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:25.905594 (+ 3578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:25.905600 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:25.905603 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:25.905634 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:25.908112 (+ 2478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:25.908681 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:25.908687 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:25.908691 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:25.908833 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:25.909163 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:25.909168 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:25.909172 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:25.909506 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:25.909731 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:25.910035 (+ 304us) server_negotiation.cc:299] Negotiation successful
0812 01:05:25.910239 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260812 01:05:25.911029 10954 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43086
I20260812 01:05:25.911940 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 11041
I20260812 01:05:25.923098 11714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:25.912833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36122 (local address 127.4.201.65:42597)
0812 01:05:25.913036 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:25.913042 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:25.913137 (+ 95us) server_negotiation.cc:407] Connection header received
0812 01:05:25.913296 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:25.913300 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:25.913387 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:25.913460 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:25.914499 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:25.915147 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:25.916289 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:25.916696 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:25.916786 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:25.918821 (+ 2035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:25.918826 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:25.918829 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:25.918855 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:25.921039 (+ 2184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:25.921631 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:25.921635 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:25.921637 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:25.921749 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:25.922018 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:25.922020 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:25.922022 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:25.922245 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:25.922409 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:25.922668 (+ 259us) server_negotiation.cc:299] Negotiation successful
0812 01:05:25.922817 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 01:05:25.923673 11228 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:26.005141 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 11041
I20260812 01:05:26.029017 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 11244
Aug 12 01:05:26 dist-test-slave-bndk krb5kdc[10884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496725, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.66@KRBTEST.COM
I20260812 01:05:26.044301 11724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:26.029988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47878 (local address 127.4.201.66:34031)
0812 01:05:26.030581 (+ 593us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:26.030589 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:26.030616 (+ 27us) server_negotiation.cc:407] Connection header received
0812 01:05:26.030681 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:26.030688 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:26.030917 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:26.031048 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:26.032277 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:26.033360 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:26.034623 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:26.035153 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:26.035251 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:26.039167 (+ 3916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:26.039179 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:26.039194 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:26.039226 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:26.042029 (+ 2803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:26.042602 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:26.042609 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:26.042611 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:26.042732 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:26.043009 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:26.043012 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:26.043014 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:26.043339 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:26.043610 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:26.043822 (+ 212us) server_negotiation.cc:299] Negotiation successful
0812 01:05:26.044015 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":305,"threads_started":1}
I20260812 01:05:26.045624 11453 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:26.126425 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 11244
I20260812 01:05:26.148584 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 11469
Aug 12 01:05:26 dist-test-slave-bndk krb5kdc[10884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496725, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.67@KRBTEST.COM
I20260812 01:05:26.164196 11726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:26.149590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53446 (local address 127.4.201.67:39725)
0812 01:05:26.150261 (+ 671us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:26.150269 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:26.150299 (+ 30us) server_negotiation.cc:407] Connection header received
0812 01:05:26.150360 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:26.150367 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:26.150584 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:26.150731 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:26.152056 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:26.153095 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:26.154422 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:26.154995 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:26.155113 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:26.159204 (+ 4091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:26.159216 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:26.159232 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:26.159264 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:26.161809 (+ 2545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:26.162414 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:26.162421 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:26.162423 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:26.162546 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:26.162848 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:26.162851 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:26.162853 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:26.163179 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:26.163413 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:26.163645 (+ 232us) server_negotiation.cc:299] Negotiation successful
0812 01:05:26.163847 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":518,"thread_start_us":333,"threads_started":1}
I20260812 01:05:26.165629 11691 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:26.247394 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 11469
I20260812 01:05:26.267704 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 10903
I20260812 01:05:26.268872 10992 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:26.371043 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 10903
2026-08-12T01:05:26Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (3945 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:05:26 dist-test-slave-bndk krb5kdc[11732](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:05:26 dist-test-slave-bndk krb5kdc[11732](info): set up 2 sockets
Aug 12 01:05:26 dist-test-slave-bndk krb5kdc[11732](info): commencing operation
krb5kdc: starting...
W20260812 01:05:27.574559 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.153s user 0.003s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:05:27 dist-test-slave-bndk krb5kdc[11732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:05:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:05:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.201.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
I20260812 01:05:27.791164 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:43193
--webserver_interface=127.4.201.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:42185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:43193
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:28.117125 11756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:28.117447 11756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:28.117594 11756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:28.124723 11756 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:05:28.124838 11756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:28.124914 11756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:28.124995 11756 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:05:28.125061 11756 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:05:28.134737 11756 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:42185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:43193
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:43193
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:28.135994 11756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:28.137290 11756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:28.148104 11768 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:28.148149 11769 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:28.148181 11771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:28.149020 11756 server_base.cc:1034] running on GCE node
I20260812 01:05:28.149801 11756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:28.151048 11756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:28.152244 11756 hybrid_clock.cc:648] HybridClock initialized: now 1786496728152192 us; error 37 us; skew 500 ppm
I20260812 01:05:28.152583 11756 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:28 dist-test-slave-bndk krb5kdc[11732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496728, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:28.159003 11756 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:05:28.160156 11756 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:28.160262 11756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:28.160593 11756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:28.163589 11756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "7d19b9eb2ba740428a2f6a59c0e49452"
format_stamp: "Formatted at 2026-08-12 01:05:28 on dist-test-slave-bndk"
server_key: "a3b86f523b0679cfa335a0c16bd77c9f"
server_key_iv: "2db3925ca009df58591c9bf5e412878d"
server_key_version: "encryptionkey@0"
I20260812 01:05:28.164458 11756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "7d19b9eb2ba740428a2f6a59c0e49452"
format_stamp: "Formatted at 2026-08-12 01:05:28 on dist-test-slave-bndk"
server_key: "a3b86f523b0679cfa335a0c16bd77c9f"
server_key_iv: "2db3925ca009df58591c9bf5e412878d"
server_key_version: "encryptionkey@0"
I20260812 01:05:28.169432 11756 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260812 01:05:28.172781 11780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:28.174036 11756 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:05:28.174193 11756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "7d19b9eb2ba740428a2f6a59c0e49452"
format_stamp: "Formatted at 2026-08-12 01:05:28 on dist-test-slave-bndk"
server_key: "a3b86f523b0679cfa335a0c16bd77c9f"
server_key_iv: "2db3925ca009df58591c9bf5e412878d"
server_key_version: "encryptionkey@0"
I20260812 01:05:28.174391 11756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:28.186273 11756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:28.190259 11756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:28.190502 11756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:28.207590 11756 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:43193
I20260812 01:05:28.207562 11860 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:43193 every 8 connection(s)
I20260812 01:05:28.208457 11756 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:05:28.210800 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 11756
I20260812 01:05:28.211024 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:05:28.211717 4901 external_mini_cluster.cc:1428] Setting key 89924578112c53e5891f8aeb41fd56b5
I20260812 01:05:28.212193 11861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:28.226409 11861 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d19b9eb2ba740428a2f6a59c0e49452: Bootstrap starting.
Aug 12 01:05:28 dist-test-slave-bndk krb5kdc[11732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:28.229671 11861 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7d19b9eb2ba740428a2f6a59c0e49452: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:28.230713 11861 log.cc:824] T 00000000000000000000000000000000 P 7d19b9eb2ba740428a2f6a59c0e49452: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:28.233366 11861 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d19b9eb2ba740428a2f6a59c0e49452: No bootstrap required, opened a new log
I20260812 01:05:28.234731 11867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:28.213622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43840 (local address 127.4.201.126:43193)
0812 01:05:28.214381 (+ 759us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:28.214392 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:28.214433 (+ 41us) server_negotiation.cc:407] Connection header received
0812 01:05:28.216708 (+ 2275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:28.216732 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:28.217140 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:28.217531 (+ 391us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:28.219466 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:28.220818 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:28.222563 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:28.223262 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:28.223411 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:28.227919 (+ 4508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:28.227928 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:28.227942 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:28.227981 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:28.230882 (+ 2901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:28.231571 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:28.231578 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:28.231584 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:28.231756 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:28.232130 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:28.232135 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:28.232137 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:28.232659 (+ 522us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:28.232942 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:28.233425 (+ 483us) server_negotiation.cc:299] Negotiation successful
0812 01:05:28.233834 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":560,"thread_start_us":344,"threads_started":1}
I20260812 01:05:28.240849 11861 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7d19b9eb2ba740428a2f6a59c0e49452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d19b9eb2ba740428a2f6a59c0e49452" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43193 } }
I20260812 01:05:28.241304 11861 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7d19b9eb2ba740428a2f6a59c0e49452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:28.241423 11861 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7d19b9eb2ba740428a2f6a59c0e49452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d19b9eb2ba740428a2f6a59c0e49452, State: Initialized, Role: FOLLOWER
I20260812 01:05:28.242026 11861 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7d19b9eb2ba740428a2f6a59c0e49452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d19b9eb2ba740428a2f6a59c0e49452" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43193 } }
I20260812 01:05:28.242252 11861 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7d19b9eb2ba740428a2f6a59c0e49452 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:05:28.242360 11861 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7d19b9eb2ba740428a2f6a59c0e49452 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:05:28.242479 11861 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7d19b9eb2ba740428a2f6a59c0e49452 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:28.244503 11861 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7d19b9eb2ba740428a2f6a59c0e49452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d19b9eb2ba740428a2f6a59c0e49452" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43193 } }
I20260812 01:05:28.244944 11861 leader_election.cc:302] T 00000000000000000000000000000000 P 7d19b9eb2ba740428a2f6a59c0e49452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7d19b9eb2ba740428a2f6a59c0e49452; no voters:
I20260812 01:05:28.245445 11861 leader_election.cc:288] T 00000000000000000000000000000000 P 7d19b9eb2ba740428a2f6a59c0e49452 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:05:28.245563 11870 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7d19b9eb2ba740428a2f6a59c0e49452 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:05:28.246179 11870 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7d19b9eb2ba740428a2f6a59c0e49452 [term 1 LEADER]: Becoming Leader. State: Replica: 7d19b9eb2ba740428a2f6a59c0e49452, State: Running, Role: LEADER
I20260812 01:05:28.246651 11870 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7d19b9eb2ba740428a2f6a59c0e49452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d19b9eb2ba740428a2f6a59c0e49452" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43193 } }
I20260812 01:05:28.247417 11861 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7d19b9eb2ba740428a2f6a59c0e49452 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:05:28.249387 11877 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d19b9eb2ba740428a2f6a59c0e49452 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7d19b9eb2ba740428a2f6a59c0e49452. Latest consensus state: current_term: 1 leader_uuid: "7d19b9eb2ba740428a2f6a59c0e49452" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d19b9eb2ba740428a2f6a59c0e49452" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43193 } } }
I20260812 01:05:28.249853 11877 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d19b9eb2ba740428a2f6a59c0e49452 [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:28.249603 11871 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d19b9eb2ba740428a2f6a59c0e49452 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7d19b9eb2ba740428a2f6a59c0e49452" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d19b9eb2ba740428a2f6a59c0e49452" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43193 } } }
I20260812 01:05:28.250121 11871 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d19b9eb2ba740428a2f6a59c0e49452 [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:28.251854 11884 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:05:28.257083 11884 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:05:28.265554 11884 catalog_manager.cc:1347] Generated new cluster ID: 9b600e6cac404dccb69a7fe115699025
I20260812 01:05:28.265662 11884 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:05:28.289557 11884 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:05:28.290835 11884 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:05:28.296119 11884 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7d19b9eb2ba740428a2f6a59c0e49452: Generated new TSK 0
I20260812 01:05:28.296916 11884 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.201.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
I20260812 01:05:28.350886 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:0
--local_ip_for_outbound_sockets=127.4.201.65
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:43193
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:42185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:28.686865 11910 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:28.687129 11910 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:28.687263 11910 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:28.694588 11910 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:28.694685 11910 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:28.694835 11910 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:05:28.705271 11910 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:42185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:43193
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:28.706473 11910 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:28.707778 11910 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:28.720309 11923 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:28.720280 11924 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:28.720371 11928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:28.721017 11910 server_base.cc:1034] running on GCE node
I20260812 01:05:28.721622 11910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:28.722497 11910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:28.723685 11910 hybrid_clock.cc:648] HybridClock initialized: now 1786496728723634 us; error 44 us; skew 500 ppm
I20260812 01:05:28.723984 11910 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:28 dist-test-slave-bndk krb5kdc[11732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496728, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:28.727018 11910 init.cc:377] Logged in from keytab as kudu/127.4.201.65@KRBTEST.COM (short username kudu)
I20260812 01:05:28.728112 11910 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:28.728202 11910 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:28.728544 11910 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:28.731433 11910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-0/data/instance:
uuid: "36ee01d554074361884ba62a55dab4cd"
format_stamp: "Formatted at 2026-08-12 01:05:28 on dist-test-slave-bndk"
server_key: "35d6641226bc32bdc3434204cbedc630"
server_key_iv: "cacdc55ec346fc15f8b3dd4a11c818c0"
server_key_version: "encryptionkey@0"
I20260812 01:05:28.732300 11910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance:
uuid: "36ee01d554074361884ba62a55dab4cd"
format_stamp: "Formatted at 2026-08-12 01:05:28 on dist-test-slave-bndk"
server_key: "35d6641226bc32bdc3434204cbedc630"
server_key_iv: "cacdc55ec346fc15f8b3dd4a11c818c0"
server_key_version: "encryptionkey@0"
I20260812 01:05:28.737270 11910 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260812 01:05:28.740522 11936 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:28.741818 11910 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 01:05:28.741971 11910 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "36ee01d554074361884ba62a55dab4cd"
format_stamp: "Formatted at 2026-08-12 01:05:28 on dist-test-slave-bndk"
server_key: "35d6641226bc32bdc3434204cbedc630"
server_key_iv: "cacdc55ec346fc15f8b3dd4a11c818c0"
server_key_version: "encryptionkey@0"
I20260812 01:05:28.742165 11910 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:28.762848 11910 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:28.766491 11910 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:28.766729 11910 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:28.767614 11910 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:05:28.768911 11910 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:28.769011 11910 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:28.769116 11910 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:28.769186 11910 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:28.799271 11910 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:35291
I20260812 01:05:28.799319 12126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:35291 every 8 connection(s)
I20260812 01:05:28.800100 11910 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:05:28.803329 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 11910
I20260812 01:05:28.803570 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance
I20260812 01:05:28.804363 4901 external_mini_cluster.cc:1428] Setting key 1ffc4e380c961897e969682ee1c7ec1a
Aug 12 01:05:28 dist-test-slave-bndk krb5kdc[11732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496728, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:28.820413 12135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:28.802476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:57861 (local address 127.4.201.126:43193)
0812 01:05:28.802888 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:28.802893 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:28.804014 (+ 1121us) server_negotiation.cc:407] Connection header received
0812 01:05:28.806002 (+ 1988us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:28.806008 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:28.806087 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:28.806192 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:28.808116 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:28.808820 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:28.810845 (+ 2025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:28.811247 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:28.811356 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:28.815034 (+ 3678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:28.815040 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:28.815043 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:28.815075 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:28.817463 (+ 2388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:28.818160 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:28.818164 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:28.818167 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:28.818288 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:28.818706 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:28.818709 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:28.818711 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:28.818979 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:28.819114 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:28.819815 (+ 701us) server_negotiation.cc:299] Negotiation successful
0812 01:05:28.820059 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":200,"threads_started":1}
I20260812 01:05:28.821415 12136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:28.803065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:43193 (local address 127.4.201.65:57861)
0812 01:05:28.803861 (+ 796us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:28.803910 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:28.805726 (+ 1816us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:28.806480 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:28.806491 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:28.807206 (+ 715us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:28.807959 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:28.807985 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:28.808967 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:28.808972 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:28.810710 (+ 1738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:28.810727 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:28.811478 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:28.811485 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:28.811736 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:28.812390 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:28.812419 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:28.814819 (+ 2400us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:28.817592 (+ 2773us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:28.817601 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:28.817618 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:28.818038 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:28.818390 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:28.818395 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:28.818399 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:28.818589 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:28.819104 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:28.819111 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:28.819427 (+ 316us) client_negotiation.cc:769] Sending connection context
0812 01:05:28.819674 (+ 247us) client_negotiation.cc:240] Negotiation successful
0812 01:05:28.820177 (+ 503us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":342,"threads_started":1}
I20260812 01:05:28.822882 12131 heartbeater.cc:347] Connected to a master server at 127.4.201.126:43193
I20260812 01:05:28.823177 12131 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:28.823807 12131 heartbeater.cc:511] Master 127.4.201.126:43193 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.4.201.66@KRBTEST.COM; defaulting to no policy
I20260812 01:05:28.825982 11804 ts_manager.cc:194] Registered new tserver with Master: 36ee01d554074361884ba62a55dab4cd (127.4.201.65:35291)
I20260812 01:05:28.827473 11804 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.65@KRBTEST.COM'} at 127.4.201.65:57861
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
I20260812 01:05:28.851552 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:0
--local_ip_for_outbound_sockets=127.4.201.66
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:43193
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:42185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:29.170241 12142 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:29.170503 12142 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:29.170641 12142 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:29.177644 12142 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:29.177739 12142 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:29.177892 12142 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:05:29.187443 12142 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:42185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:43193
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:29.188694 12142 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:29.189993 12142 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:29.202401 12149 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:29.202332 12152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:29.202375 12154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:29.203349 12142 server_base.cc:1034] running on GCE node
I20260812 01:05:29.203926 12142 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:29.204793 12142 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:29.206002 12142 hybrid_clock.cc:648] HybridClock initialized: now 1786496729205950 us; error 43 us; skew 500 ppm
I20260812 01:05:29.206310 12142 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:29 dist-test-slave-bndk krb5kdc[11732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496729, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:29.209923 12142 init.cc:377] Logged in from keytab as kudu/127.4.201.66@KRBTEST.COM (short username kudu)
I20260812 01:05:29.211009 12142 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:29.211099 12142 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:29.211406 12142 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:29.214167 12142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-1/data/instance:
uuid: "7c9e5a258fc74ea6ae85976a8d37a217"
format_stamp: "Formatted at 2026-08-12 01:05:29 on dist-test-slave-bndk"
server_key: "23c8b1dd7e2d9cbd80ea96ba4d408274"
server_key_iv: "c3a383ba7051e48bd99b2257b1da74d6"
server_key_version: "encryptionkey@0"
I20260812 01:05:29.214941 12142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance:
uuid: "7c9e5a258fc74ea6ae85976a8d37a217"
format_stamp: "Formatted at 2026-08-12 01:05:29 on dist-test-slave-bndk"
server_key: "23c8b1dd7e2d9cbd80ea96ba4d408274"
server_key_iv: "c3a383ba7051e48bd99b2257b1da74d6"
server_key_version: "encryptionkey@0"
I20260812 01:05:29.219834 12142 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 01:05:29.223169 12161 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:29.224331 12142 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 01:05:29.224489 12142 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "7c9e5a258fc74ea6ae85976a8d37a217"
format_stamp: "Formatted at 2026-08-12 01:05:29 on dist-test-slave-bndk"
server_key: "23c8b1dd7e2d9cbd80ea96ba4d408274"
server_key_iv: "c3a383ba7051e48bd99b2257b1da74d6"
server_key_version: "encryptionkey@0"
I20260812 01:05:29.224680 12142 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:29.249897 12142 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:29.254127 12142 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:29.254374 12142 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:29.255285 12142 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:05:29.256596 12142 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:29.256686 12142 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:29.256788 12142 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:29.256856 12142 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:29.287508 12142 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:46743
I20260812 01:05:29.287583 12345 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:46743 every 8 connection(s)
I20260812 01:05:29.288336 12142 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:05:29.289321 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 12142
I20260812 01:05:29.289535 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance
I20260812 01:05:29.290068 4901 external_mini_cluster.cc:1428] Setting key 09e29bf75407b697aac0bc90676aa85e
Aug 12 01:05:29 dist-test-slave-bndk krb5kdc[11732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496729, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:29.308549 12135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:29.291018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:42269 (local address 127.4.201.126:43193)
0812 01:05:29.291223 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:29.291229 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:29.292568 (+ 1339us) server_negotiation.cc:407] Connection header received
0812 01:05:29.294428 (+ 1860us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:29.294433 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:29.294520 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:29.294625 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:29.296117 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:29.297083 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:29.298629 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:29.299190 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:29.299364 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:29.302822 (+ 3458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:29.302828 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:29.302832 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:29.302866 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:29.305389 (+ 2523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:29.306219 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:29.306224 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:29.306226 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:29.306364 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:29.306900 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:29.306904 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:29.306906 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:29.307174 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:29.307285 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:29.308133 (+ 848us) server_negotiation.cc:299] Negotiation successful
0812 01:05:29.308315 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 01:05:29.309906 12351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:29.291599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:43193 (local address 127.4.201.66:42269)
0812 01:05:29.292389 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:29.292434 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:29.294165 (+ 1731us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:29.294809 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:29.294816 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:29.295363 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:29.295928 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:29.295945 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:29.297260 (+ 1315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:29.297265 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:29.298458 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:29.298497 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:29.299447 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:29.299453 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:29.299658 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:29.300271 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:29.300292 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:29.302576 (+ 2284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:29.305525 (+ 2949us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:29.305534 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:29.305550 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:29.306077 (+ 527us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:29.306498 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:29.306503 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:29.306506 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:29.306779 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:29.307297 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:29.307305 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:29.307692 (+ 387us) client_negotiation.cc:769] Sending connection context
0812 01:05:29.308014 (+ 322us) client_negotiation.cc:240] Negotiation successful
0812 01:05:29.308526 (+ 512us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":328,"threads_started":1}
I20260812 01:05:29.311241 12349 heartbeater.cc:347] Connected to a master server at 127.4.201.126:43193
I20260812 01:05:29.311561 12349 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:29.312206 12349 heartbeater.cc:511] Master 127.4.201.126:43193 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.4.201.67@KRBTEST.COM; defaulting to no policy
I20260812 01:05:29.313650 11804 ts_manager.cc:194] Registered new tserver with Master: 7c9e5a258fc74ea6ae85976a8d37a217 (127.4.201.66:46743)
I20260812 01:05:29.314451 11804 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.66@KRBTEST.COM'} at 127.4.201.66:42269
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
I20260812 01:05:29.340524 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:0
--local_ip_for_outbound_sockets=127.4.201.67
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:43193
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:42185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:29.660617 12354 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:29.660898 12354 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:29.661041 12354 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:29.668159 12354 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:29.668272 12354 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:29.668455 12354 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:05:29.678953 12354 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:42185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:43193
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:29.680298 12354 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:29.681658 12354 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:29.695283 12366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:29.695863 12368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:29.695307 12365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:29.697727 12354 server_base.cc:1034] running on GCE node
I20260812 01:05:29.698303 12354 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:29.699218 12354 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:29.700404 12354 hybrid_clock.cc:648] HybridClock initialized: now 1786496729700358 us; error 34 us; skew 500 ppm
I20260812 01:05:29.700714 12354 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:29 dist-test-slave-bndk krb5kdc[11732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496729, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:29.703649 12354 init.cc:377] Logged in from keytab as kudu/127.4.201.67@KRBTEST.COM (short username kudu)
I20260812 01:05:29.704913 12354 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:29.705013 12354 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:29.705360 12354 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:29.708177 12354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-2/data/instance:
uuid: "8160fa26f4af4102a010ebb0de71963c"
format_stamp: "Formatted at 2026-08-12 01:05:29 on dist-test-slave-bndk"
server_key: "d63cfa6556bac8ba5cdfd3276c5f98dd"
server_key_iv: "54f2a129f5c6a8bffd3c4a8011fc3ec6"
server_key_version: "encryptionkey@0"
I20260812 01:05:29.708981 12354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance:
uuid: "8160fa26f4af4102a010ebb0de71963c"
format_stamp: "Formatted at 2026-08-12 01:05:29 on dist-test-slave-bndk"
server_key: "d63cfa6556bac8ba5cdfd3276c5f98dd"
server_key_iv: "54f2a129f5c6a8bffd3c4a8011fc3ec6"
server_key_version: "encryptionkey@0"
I20260812 01:05:29.713922 12354 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260812 01:05:29.717199 12375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:29.718609 12354 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 01:05:29.718760 12354 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "8160fa26f4af4102a010ebb0de71963c"
format_stamp: "Formatted at 2026-08-12 01:05:29 on dist-test-slave-bndk"
server_key: "d63cfa6556bac8ba5cdfd3276c5f98dd"
server_key_iv: "54f2a129f5c6a8bffd3c4a8011fc3ec6"
server_key_version: "encryptionkey@0"
I20260812 01:05:29.718990 12354 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:29.734777 12354 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:29.738523 12354 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:29.738771 12354 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:29.739694 12354 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:05:29.741016 12354 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:29.741117 12354 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:29.741243 12354 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:29.741333 12354 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260812 01:05:29.771555 12354 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:32887
I20260812 01:05:29.771605 12573 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:32887 every 8 connection(s)
I20260812 01:05:29.772465 12354 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:05:29.779582 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 12354
I20260812 01:05:29.779790 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance
I20260812 01:05:29.780260 4901 external_mini_cluster.cc:1428] Setting key fc16d04f7c90e29076f5f90d4675b2f7
Aug 12 01:05:29 dist-test-slave-bndk krb5kdc[11732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496729, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:29.792127 12135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:29.774897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:47119 (local address 127.4.201.126:43193)
0812 01:05:29.775073 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:29.775078 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:29.776205 (+ 1127us) server_negotiation.cc:407] Connection header received
0812 01:05:29.778109 (+ 1904us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:29.778115 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:29.778198 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:29.778284 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:29.780033 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:29.780843 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:29.782895 (+ 2052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:29.783455 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:29.783556 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:29.786718 (+ 3162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:29.786723 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:29.786726 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:29.786758 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:29.789197 (+ 2439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:29.789916 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:29.789920 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:29.789922 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:29.790058 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:29.790458 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:29.790462 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:29.790464 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:29.790728 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:29.790868 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:29.791559 (+ 691us) server_negotiation.cc:299] Negotiation successful
0812 01:05:29.791780 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 01:05:29.792984 12576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:29.775362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:43193 (local address 127.4.201.67:47119)
0812 01:05:29.776060 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:29.776097 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:29.777814 (+ 1717us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:29.778542 (+ 728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:29.778550 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:29.779032 (+ 482us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:29.779785 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:29.779812 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:29.781037 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:29.781042 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:29.782755 (+ 1713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:29.782769 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:29.783648 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:29.783653 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:29.783827 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:29.784400 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:29.784421 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:29.786526 (+ 2105us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:29.789350 (+ 2824us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:29.789359 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:29.789374 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:29.789794 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:29.790163 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:29.790168 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:29.790172 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:29.790340 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:29.790859 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:29.790867 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:29.791162 (+ 295us) client_negotiation.cc:769] Sending connection context
0812 01:05:29.791398 (+ 236us) client_negotiation.cc:240] Negotiation successful
0812 01:05:29.791892 (+ 494us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":276,"threads_started":1}
I20260812 01:05:29.794211 12574 heartbeater.cc:347] Connected to a master server at 127.4.201.126:43193
I20260812 01:05:29.794517 12574 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:29.795156 12574 heartbeater.cc:511] Master 127.4.201.126:43193 requested a full tablet report, sending...
I20260812 01:05:29.796474 11804 ts_manager.cc:194] Registered new tserver with Master: 8160fa26f4af4102a010ebb0de71963c (127.4.201.67:32887)
I20260812 01:05:29.797320 11804 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.67@KRBTEST.COM'} at 127.4.201.67:47119
I20260812 01:05:29.807089 4901 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:05:29.822798 12135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:29.811398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43842 (local address 127.4.201.126:43193)
0812 01:05:29.811551 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:29.811555 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:29.812057 (+ 502us) server_negotiation.cc:407] Connection header received
0812 01:05:29.812191 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:29.812194 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:29.812252 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:29.812320 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:29.813733 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:29.814416 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:29.815563 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:29.815954 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:29.816049 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:29.818170 (+ 2121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:29.818175 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:29.818179 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:29.818206 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:29.820459 (+ 2253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:29.821053 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:29.821056 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:29.821059 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:29.821195 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:29.821523 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:29.821526 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:29.821528 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:29.821846 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:29.822050 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:29.822333 (+ 283us) server_negotiation.cc:299] Negotiation successful
0812 01:05:29.822496 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 01:05:29.830309 12131 heartbeater.cc:503] Master 127.4.201.126:43193 was elected leader, sending a full tablet report...
I20260812 01:05:29.826586 11804 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43842:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:05:29.833694 11804 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:05:29.869740 12596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:29.845273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:35291 (local address 127.0.0.1:54000)
0812 01:05:29.859974 (+ 14701us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:29.859994 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:29.860108 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:29.861513 (+ 1405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:29.861521 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:29.861564 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:29.862042 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:29.862056 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:29.864182 (+ 2126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:29.864187 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:29.866871 (+ 2684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:29.866888 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:29.868640 (+ 1752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:29.868646 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:29.868850 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:29.868906 (+ 56us) client_negotiation.cc:769] Sending connection context
0812 01:05:29.869026 (+ 120us) client_negotiation.cc:240] Negotiation successful
0812 01:05:29.869258 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14555,"mutex_wait_us":31,"thread_start_us":19688,"threads_started":1}
I20260812 01:05:29.869808 12601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:29.845619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54000 (local address 127.4.201.65:35291)
0812 01:05:29.860612 (+ 14993us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:29.860621 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:29.860652 (+ 31us) server_negotiation.cc:407] Connection header received
0812 01:05:29.860760 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:29.860767 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:29.861040 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:29.862284 (+ 1244us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:29.862600 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:29.864056 (+ 1456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:29.867069 (+ 3013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:29.868397 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:29.868548 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:29.869188 (+ 640us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:29.869297 (+ 109us) server_negotiation.cc:299] Negotiation successful
0812 01:05:29.869460 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14800,"thread_start_us":15586,"threads_started":1}
I20260812 01:05:29.870424 12600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:29.845273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34480 (local address 127.4.201.67:32887)
0812 01:05:29.860808 (+ 15535us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:29.860815 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:29.860844 (+ 29us) server_negotiation.cc:407] Connection header received
0812 01:05:29.860923 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:29.860930 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:29.861106 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:29.861302 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:29.862308 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:29.863967 (+ 1659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:29.867615 (+ 3648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:29.868959 (+ 1344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:29.869088 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:29.869338 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:29.869997 (+ 659us) server_negotiation.cc:299] Negotiation successful
0812 01:05:29.870130 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15377,"thread_start_us":15224,"threads_started":1}
I20260812 01:05:29.871052 12606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:29.845043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:32887 (local address 127.0.0.1:34480)
0812 01:05:29.859016 (+ 13973us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:29.859063 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:29.859260 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:29.861592 (+ 2332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:29.861596 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:29.861616 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:29.862075 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:29.862086 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:29.864149 (+ 2063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:29.864154 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:29.867448 (+ 3294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:29.867462 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:29.869490 (+ 2028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:29.869496 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:29.869699 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:29.869734 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 01:05:29.870626 (+ 892us) client_negotiation.cc:240] Negotiation successful
0812 01:05:29.870757 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13701,"mutex_wait_us":185,"thread_start_us":15134,"threads_started":1}
I20260812 01:05:29.874625 12598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:29.847617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:46743 (local address 127.0.0.1:51726)
0812 01:05:29.865817 (+ 18200us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:29.865831 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:29.865948 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:29.866663 (+ 715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:29.866667 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:29.866692 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:29.867108 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:29.867121 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:29.868518 (+ 1397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:29.868523 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:29.871395 (+ 2872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:29.871411 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:29.873840 (+ 2429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:29.873848 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:29.874023 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:29.874054 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 01:05:29.874150 (+ 96us) client_negotiation.cc:240] Negotiation successful
0812 01:05:29.874270 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18090,"mutex_wait_us":879,"thread_start_us":5729,"threads_started":1}
I20260812 01:05:29.874691 12607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:29.847727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51726 (local address 127.4.201.66:46743)
0812 01:05:29.865003 (+ 17276us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:29.865011 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:29.865944 (+ 933us) server_negotiation.cc:407] Connection header received
0812 01:05:29.866095 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:29.866100 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:29.866262 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:29.866429 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:29.867314 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:29.868368 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:29.871585 (+ 3217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:29.873387 (+ 1802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:29.873524 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:29.873699 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:29.874234 (+ 535us) server_negotiation.cc:299] Negotiation successful
0812 01:05:29.874395 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17088,"thread_start_us":17277,"threads_started":1}
I20260812 01:05:29.874150 12005 tablet_service.cc:1467] Processing CreateTablet for tablet c7cc1f3f8af7416986940b756d09d706 (DEFAULT_TABLE table=test-table [id=8acd9d38d9c1420ba7f65b1fd4237a8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:29.874809 12454 tablet_service.cc:1467] Processing CreateTablet for tablet c7cc1f3f8af7416986940b756d09d706 (DEFAULT_TABLE table=test-table [id=8acd9d38d9c1420ba7f65b1fd4237a8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:29.875576 12005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7cc1f3f8af7416986940b756d09d706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:29.876186 12454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7cc1f3f8af7416986940b756d09d706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:29.878691 12232 tablet_service.cc:1467] Processing CreateTablet for tablet c7cc1f3f8af7416986940b756d09d706 (DEFAULT_TABLE table=test-table [id=8acd9d38d9c1420ba7f65b1fd4237a8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:29.879976 12232 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7cc1f3f8af7416986940b756d09d706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:29.888866 12608 tablet_bootstrap.cc:492] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c: Bootstrap starting.
I20260812 01:05:29.890096 12609 tablet_bootstrap.cc:492] T c7cc1f3f8af7416986940b756d09d706 P 36ee01d554074361884ba62a55dab4cd: Bootstrap starting.
I20260812 01:05:29.892506 12608 tablet_bootstrap.cc:654] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:29.893114 12611 tablet_bootstrap.cc:492] T c7cc1f3f8af7416986940b756d09d706 P 7c9e5a258fc74ea6ae85976a8d37a217: Bootstrap starting.
I20260812 01:05:29.893882 12608 log.cc:824] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:29.894042 12609 tablet_bootstrap.cc:654] T c7cc1f3f8af7416986940b756d09d706 P 36ee01d554074361884ba62a55dab4cd: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:29.895401 12609 log.cc:824] T c7cc1f3f8af7416986940b756d09d706 P 36ee01d554074361884ba62a55dab4cd: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:29.896202 12611 tablet_bootstrap.cc:654] T c7cc1f3f8af7416986940b756d09d706 P 7c9e5a258fc74ea6ae85976a8d37a217: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:29.897112 12611 log.cc:824] T c7cc1f3f8af7416986940b756d09d706 P 7c9e5a258fc74ea6ae85976a8d37a217: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:29.897925 12608 tablet_bootstrap.cc:492] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c: No bootstrap required, opened a new log
I20260812 01:05:29.898219 12608 ts_tablet_manager.cc:1397] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260812 01:05:29.899555 12611 tablet_bootstrap.cc:492] T c7cc1f3f8af7416986940b756d09d706 P 7c9e5a258fc74ea6ae85976a8d37a217: No bootstrap required, opened a new log
I20260812 01:05:29.899791 12611 ts_tablet_manager.cc:1397] T c7cc1f3f8af7416986940b756d09d706 P 7c9e5a258fc74ea6ae85976a8d37a217: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260812 01:05:29.901742 12609 tablet_bootstrap.cc:492] T c7cc1f3f8af7416986940b756d09d706 P 36ee01d554074361884ba62a55dab4cd: No bootstrap required, opened a new log
I20260812 01:05:29.902000 12609 ts_tablet_manager.cc:1397] T c7cc1f3f8af7416986940b756d09d706 P 36ee01d554074361884ba62a55dab4cd: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.007s
I20260812 01:05:29.905812 12608 raft_consensus.cc:348] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8160fa26f4af4102a010ebb0de71963c" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 32887 } } peers { permanent_uuid: "36ee01d554074361884ba62a55dab4cd" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 35291 } } peers { permanent_uuid: "7c9e5a258fc74ea6ae85976a8d37a217" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46743 } }
I20260812 01:05:29.906163 12608 raft_consensus.cc:374] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:29.906289 12608 raft_consensus.cc:729] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8160fa26f4af4102a010ebb0de71963c, State: Initialized, Role: FOLLOWER
I20260812 01:05:29.906911 12608 consensus_queue.cc:260] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8160fa26f4af4102a010ebb0de71963c" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 32887 } } peers { permanent_uuid: "36ee01d554074361884ba62a55dab4cd" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 35291 } } peers { permanent_uuid: "7c9e5a258fc74ea6ae85976a8d37a217" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46743 } }
I20260812 01:05:29.907943 12574 heartbeater.cc:503] Master 127.4.201.126:43193 was elected leader, sending a full tablet report...
I20260812 01:05:29.908622 12608 ts_tablet_manager.cc:1428] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20260812 01:05:29.909956 12611 raft_consensus.cc:348] T c7cc1f3f8af7416986940b756d09d706 P 7c9e5a258fc74ea6ae85976a8d37a217 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8160fa26f4af4102a010ebb0de71963c" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 32887 } } peers { permanent_uuid: "36ee01d554074361884ba62a55dab4cd" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 35291 } } peers { permanent_uuid: "7c9e5a258fc74ea6ae85976a8d37a217" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46743 } }
I20260812 01:05:29.910374 12611 raft_consensus.cc:374] T c7cc1f3f8af7416986940b756d09d706 P 7c9e5a258fc74ea6ae85976a8d37a217 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:29.910470 12611 raft_consensus.cc:729] T c7cc1f3f8af7416986940b756d09d706 P 7c9e5a258fc74ea6ae85976a8d37a217 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c9e5a258fc74ea6ae85976a8d37a217, State: Initialized, Role: FOLLOWER
I20260812 01:05:29.911038 12611 consensus_queue.cc:260] T c7cc1f3f8af7416986940b756d09d706 P 7c9e5a258fc74ea6ae85976a8d37a217 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8160fa26f4af4102a010ebb0de71963c" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 32887 } } peers { permanent_uuid: "36ee01d554074361884ba62a55dab4cd" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 35291 } } peers { permanent_uuid: "7c9e5a258fc74ea6ae85976a8d37a217" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46743 } }
I20260812 01:05:29.912189 12349 heartbeater.cc:503] Master 127.4.201.126:43193 was elected leader, sending a full tablet report...
I20260812 01:05:29.911999 12609 raft_consensus.cc:348] T c7cc1f3f8af7416986940b756d09d706 P 36ee01d554074361884ba62a55dab4cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8160fa26f4af4102a010ebb0de71963c" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 32887 } } peers { permanent_uuid: "36ee01d554074361884ba62a55dab4cd" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 35291 } } peers { permanent_uuid: "7c9e5a258fc74ea6ae85976a8d37a217" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46743 } }
I20260812 01:05:29.912405 12609 raft_consensus.cc:374] T c7cc1f3f8af7416986940b756d09d706 P 36ee01d554074361884ba62a55dab4cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:29.912528 12609 raft_consensus.cc:729] T c7cc1f3f8af7416986940b756d09d706 P 36ee01d554074361884ba62a55dab4cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36ee01d554074361884ba62a55dab4cd, State: Initialized, Role: FOLLOWER
I20260812 01:05:29.912817 12611 ts_tablet_manager.cc:1428] T c7cc1f3f8af7416986940b756d09d706 P 7c9e5a258fc74ea6ae85976a8d37a217: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260812 01:05:29.913084 12609 consensus_queue.cc:260] T c7cc1f3f8af7416986940b756d09d706 P 36ee01d554074361884ba62a55dab4cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8160fa26f4af4102a010ebb0de71963c" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 32887 } } peers { permanent_uuid: "36ee01d554074361884ba62a55dab4cd" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 35291 } } peers { permanent_uuid: "7c9e5a258fc74ea6ae85976a8d37a217" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46743 } }
I20260812 01:05:29.913394 12617 raft_consensus.cc:482] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:05:29.914323 12617 raft_consensus.cc:504] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8160fa26f4af4102a010ebb0de71963c" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 32887 } } peers { permanent_uuid: "36ee01d554074361884ba62a55dab4cd" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 35291 } } peers { permanent_uuid: "7c9e5a258fc74ea6ae85976a8d37a217" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46743 } }
I20260812 01:05:29.914944 12609 ts_tablet_manager.cc:1428] T c7cc1f3f8af7416986940b756d09d706 P 36ee01d554074361884ba62a55dab4cd: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260812 01:05:29.921331 12617 leader_election.cc:288] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36ee01d554074361884ba62a55dab4cd (127.4.201.65:35291), 7c9e5a258fc74ea6ae85976a8d37a217 (127.4.201.66:46743)
I20260812 01:05:29.922847 12601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:29.917046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:56577 (local address 127.4.201.65:35291)
0812 01:05:29.917260 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:29.917266 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:29.917285 (+ 19us) server_negotiation.cc:407] Connection header received
0812 01:05:29.917346 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:29.917351 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:29.917444 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:29.917536 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:29.918090 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:29.919256 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:29.920868 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:29.922066 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:29.922214 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:29.922287 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:29.922552 (+ 265us) server_negotiation.cc:299] Negotiation successful
0812 01:05:29.922667 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56,"spinlock_wait_cycles":2816}
I20260812 01:05:29.922960 12576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:29.916593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:35291 (local address 127.4.201.67:56577)
0812 01:05:29.916774 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:29.916794 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:29.916905 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:29.917711 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:29.917715 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:29.917749 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:29.917925 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:29.917936 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:29.919388 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:29.919392 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:29.920718 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:29.920731 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:29.922190 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:29.922194 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:29.922352 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:29.922386 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 01:05:29.922522 (+ 136us) client_negotiation.cc:240] Negotiation successful
0812 01:05:29.922680 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260812 01:05:29.923945 12047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7cc1f3f8af7416986940b756d09d706" candidate_uuid: "8160fa26f4af4102a010ebb0de71963c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36ee01d554074361884ba62a55dab4cd" is_pre_election: true
I20260812 01:05:29.924499 12047 raft_consensus.cc:2454] T c7cc1f3f8af7416986940b756d09d706 P 36ee01d554074361884ba62a55dab4cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8160fa26f4af4102a010ebb0de71963c in term 0.
I20260812 01:05:29.925177 12376 leader_election.cc:302] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36ee01d554074361884ba62a55dab4cd, 8160fa26f4af4102a010ebb0de71963c; no voters:
I20260812 01:05:29.925591 12617 raft_consensus.cc:2781] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:05:29.925727 12617 raft_consensus.cc:482] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:05:29.925828 12617 raft_consensus.cc:3037] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:29.927944 12607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:29.918055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:35429 (local address 127.4.201.66:46743)
0812 01:05:29.919551 (+ 1496us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:29.919557 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:29.921978 (+ 2421us) server_negotiation.cc:407] Connection header received
0812 01:05:29.922159 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:29.922165 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:29.922233 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:29.922315 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:29.922921 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:29.923810 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:29.926011 (+ 2201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:29.927144 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:29.927302 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:29.927370 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:29.927591 (+ 221us) server_negotiation.cc:299] Negotiation successful
0812 01:05:29.927708 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1338}
I20260812 01:05:29.927984 12623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:29.917569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:46743 (local address 127.4.201.67:35429)
0812 01:05:29.921875 (+ 4306us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:29.921897 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:29.922029 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:29.922340 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:29.922344 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:29.922369 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:29.922742 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:29.922754 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:29.923938 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:29.923943 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:29.925866 (+ 1923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:29.925882 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:29.927324 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:29.927329 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:29.927455 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:29.927481 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 01:05:29.927557 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 01:05:29.927685 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4207,"thread_start_us":4057,"threads_started":1}
I20260812 01:05:29.928819 12267 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7cc1f3f8af7416986940b756d09d706" candidate_uuid: "8160fa26f4af4102a010ebb0de71963c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c9e5a258fc74ea6ae85976a8d37a217" is_pre_election: true
I20260812 01:05:29.928963 12617 raft_consensus.cc:504] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8160fa26f4af4102a010ebb0de71963c" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 32887 } } peers { permanent_uuid: "36ee01d554074361884ba62a55dab4cd" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 35291 } } peers { permanent_uuid: "7c9e5a258fc74ea6ae85976a8d37a217" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46743 } }
I20260812 01:05:29.929347 12267 raft_consensus.cc:2454] T c7cc1f3f8af7416986940b756d09d706 P 7c9e5a258fc74ea6ae85976a8d37a217 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8160fa26f4af4102a010ebb0de71963c in term 0.
I20260812 01:05:29.929718 12617 leader_election.cc:288] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c [CANDIDATE]: Term 1 election: Requested vote from peers 36ee01d554074361884ba62a55dab4cd (127.4.201.65:35291), 7c9e5a258fc74ea6ae85976a8d37a217 (127.4.201.66:46743)
I20260812 01:05:29.930047 12047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7cc1f3f8af7416986940b756d09d706" candidate_uuid: "8160fa26f4af4102a010ebb0de71963c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36ee01d554074361884ba62a55dab4cd"
I20260812 01:05:29.930210 12047 raft_consensus.cc:3037] T c7cc1f3f8af7416986940b756d09d706 P 36ee01d554074361884ba62a55dab4cd [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:29.930306 12267 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7cc1f3f8af7416986940b756d09d706" candidate_uuid: "8160fa26f4af4102a010ebb0de71963c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c9e5a258fc74ea6ae85976a8d37a217"
I20260812 01:05:29.930498 12267 raft_consensus.cc:3037] T c7cc1f3f8af7416986940b756d09d706 P 7c9e5a258fc74ea6ae85976a8d37a217 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:29.933462 12047 raft_consensus.cc:2454] T c7cc1f3f8af7416986940b756d09d706 P 36ee01d554074361884ba62a55dab4cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8160fa26f4af4102a010ebb0de71963c in term 1.
I20260812 01:05:29.933498 12267 raft_consensus.cc:2454] T c7cc1f3f8af7416986940b756d09d706 P 7c9e5a258fc74ea6ae85976a8d37a217 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8160fa26f4af4102a010ebb0de71963c in term 1.
I20260812 01:05:29.933856 12379 leader_election.cc:302] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c9e5a258fc74ea6ae85976a8d37a217, 8160fa26f4af4102a010ebb0de71963c; no voters:
I20260812 01:05:29.934201 12617 raft_consensus.cc:2781] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:05:29.934578 12617 raft_consensus.cc:686] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c [term 1 LEADER]: Becoming Leader. State: Replica: 8160fa26f4af4102a010ebb0de71963c, State: Running, Role: LEADER
I20260812 01:05:29.935051 12617 consensus_queue.cc:237] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8160fa26f4af4102a010ebb0de71963c" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 32887 } } peers { permanent_uuid: "36ee01d554074361884ba62a55dab4cd" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 35291 } } peers { permanent_uuid: "7c9e5a258fc74ea6ae85976a8d37a217" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46743 } }
I20260812 01:05:29.938707 11804 catalog_manager.cc:5495] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c reported cstate change: term changed from 0 to 1, leader changed from <none> to 8160fa26f4af4102a010ebb0de71963c (127.4.201.67). New cstate: current_term: 1 leader_uuid: "8160fa26f4af4102a010ebb0de71963c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8160fa26f4af4102a010ebb0de71963c" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 32887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36ee01d554074361884ba62a55dab4cd" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 35291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c9e5a258fc74ea6ae85976a8d37a217" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46743 } health_report { overall_health: UNKNOWN } } }
I20260812 01:05:29.958312 12600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:29.953625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34486 (local address 127.4.201.67:32887)
0812 01:05:29.953780 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:29.953784 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:29.953984 (+ 200us) server_negotiation.cc:407] Connection header received
0812 01:05:29.954154 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:29.954157 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:29.954234 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:29.954350 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:05:29.954631 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:29.955308 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:29.956537 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:29.956906 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:29.956992 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:29.957412 (+ 420us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:05:29.957877 (+ 465us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:05:29.958003 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:29.958070 (+ 67us) server_negotiation.cc:299] Negotiation successful
0812 01:05:29.958130 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 01:05:29.965791 12267 raft_consensus.cc:1261] T c7cc1f3f8af7416986940b756d09d706 P 7c9e5a258fc74ea6ae85976a8d37a217 [term 1 FOLLOWER]: Refusing update from remote peer 8160fa26f4af4102a010ebb0de71963c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:29.965790 12047 raft_consensus.cc:1261] T c7cc1f3f8af7416986940b756d09d706 P 36ee01d554074361884ba62a55dab4cd [term 1 FOLLOWER]: Refusing update from remote peer 8160fa26f4af4102a010ebb0de71963c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:29.966660 12625 consensus_queue.cc:1035] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c [LEADER]: Connected to new peer: Peer: permanent_uuid: "36ee01d554074361884ba62a55dab4cd" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 35291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:29.966980 12617 consensus_queue.cc:1035] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c9e5a258fc74ea6ae85976a8d37a217" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:29.978582 12638 mvcc.cc:205] Tried to move back new op lower bound from 7317490605930786816 to 7317490605817798656. Current Snapshot: MvccSnapshot[applied={T|T < 7317490605930786816}]
I20260812 01:05:29.990587 11804 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43842:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:05:29.990801 11804 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43842:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:05:29.994179 11804 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7d19b9eb2ba740428a2f6a59c0e49452: Sending DeleteTablet for 3 replicas of tablet c7cc1f3f8af7416986940b756d09d706
I20260812 01:05:29.995195 12454 tablet_service.cc:1514] Processing DeleteTablet for tablet c7cc1f3f8af7416986940b756d09d706 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:29 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:34480
I20260812 01:05:29.995247 12005 tablet_service.cc:1514] Processing DeleteTablet for tablet c7cc1f3f8af7416986940b756d09d706 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:29 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:54000
I20260812 01:05:29.995366 12232 tablet_service.cc:1514] Processing DeleteTablet for tablet c7cc1f3f8af7416986940b756d09d706 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:29 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:51726
I20260812 01:05:29.999928 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 11910
I20260812 01:05:30.009443 12649 tablet_replica.cc:330] T c7cc1f3f8af7416986940b756d09d706 P 36ee01d554074361884ba62a55dab4cd: stopping tablet replica
I20260812 01:05:30.010083 12649 raft_consensus.cc:2229] T c7cc1f3f8af7416986940b756d09d706 P 36ee01d554074361884ba62a55dab4cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:05:30.014087 12649 raft_consensus.cc:2258] T c7cc1f3f8af7416986940b756d09d706 P 36ee01d554074361884ba62a55dab4cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:30.017310 12650 tablet_replica.cc:330] T c7cc1f3f8af7416986940b756d09d706 P 7c9e5a258fc74ea6ae85976a8d37a217: stopping tablet replica
I20260812 01:05:30.017482 12648 tablet_replica.cc:330] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c: stopping tablet replica
I20260812 01:05:30.017516 12649 ts_tablet_manager.cc:1905] T c7cc1f3f8af7416986940b756d09d706 P 36ee01d554074361884ba62a55dab4cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:30.018023 12648 raft_consensus.cc:2229] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:05:30.018723 12648 raft_consensus.cc:2258] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c [term 1 FOLLOWER]: Raft consensus is shut down!
Aug 12 01:05:30 dist-test-slave-bndk krb5kdc[11732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.65@KRBTEST.COM
I20260812 01:05:30.020922 12648 ts_tablet_manager.cc:1905] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:30.021669 12650 raft_consensus.cc:2229] T c7cc1f3f8af7416986940b756d09d706 P 7c9e5a258fc74ea6ae85976a8d37a217 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:05:30.024601 12650 raft_consensus.cc:2258] T c7cc1f3f8af7416986940b756d09d706 P 7c9e5a258fc74ea6ae85976a8d37a217 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:30.024857 12649 ts_tablet_manager.cc:1918] T c7cc1f3f8af7416986940b756d09d706 P 36ee01d554074361884ba62a55dab4cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:05:30.025076 12649 log.cc:1196] T c7cc1f3f8af7416986940b756d09d706 P 36ee01d554074361884ba62a55dab4cd: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-0/wal/wals/c7cc1f3f8af7416986940b756d09d706
I20260812 01:05:30.025722 12649 ts_tablet_manager.cc:1939] T c7cc1f3f8af7416986940b756d09d706 P 36ee01d554074361884ba62a55dab4cd: Deleting consensus metadata
I20260812 01:05:30.027585 11781 catalog_manager.cc:4841] TS 36ee01d554074361884ba62a55dab4cd (127.4.201.65:35291): tablet c7cc1f3f8af7416986940b756d09d706 (table test-table [id=8acd9d38d9c1420ba7f65b1fd4237a8f]) successfully deleted
I20260812 01:05:30.028832 12648 ts_tablet_manager.cc:1918] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:05:30.029045 12648 log.cc:1196] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-2/wal/wals/c7cc1f3f8af7416986940b756d09d706
I20260812 01:05:30.029647 12648 ts_tablet_manager.cc:1939] T c7cc1f3f8af7416986940b756d09d706 P 8160fa26f4af4102a010ebb0de71963c: Deleting consensus metadata
I20260812 01:05:30.029657 12650 ts_tablet_manager.cc:1905] T c7cc1f3f8af7416986940b756d09d706 P 7c9e5a258fc74ea6ae85976a8d37a217: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:30.030908 12601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:30.001865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54016 (local address 127.4.201.65:35291)
0812 01:05:30.002056 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:30.002062 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:30.005704 (+ 3642us) server_negotiation.cc:407] Connection header received
0812 01:05:30.006243 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:30.006249 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:30.006354 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:30.006429 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:30.010401 (+ 3972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:30.011639 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:30.015087 (+ 3448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:30.015842 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:30.015948 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:30.022637 (+ 6689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:30.022650 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:30.022672 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:30.022714 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:30.026545 (+ 3831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:30.028036 (+ 1491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:30.028045 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:30.028048 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:30.028266 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:30.028745 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:30.028751 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:30.028754 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:30.029449 (+ 695us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:30.029757 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:30.030333 (+ 576us) server_negotiation.cc:299] Negotiation successful
0812 01:05:30.030554 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 01:05:30.031286 11785 catalog_manager.cc:4841] TS 8160fa26f4af4102a010ebb0de71963c (127.4.201.67:32887): tablet c7cc1f3f8af7416986940b756d09d706 (table test-table [id=8acd9d38d9c1420ba7f65b1fd4237a8f]) successfully deleted
I20260812 01:05:30.032594 12121 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:30.037169 12650 ts_tablet_manager.cc:1918] T c7cc1f3f8af7416986940b756d09d706 P 7c9e5a258fc74ea6ae85976a8d37a217: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:05:30.037358 12650 log.cc:1196] T c7cc1f3f8af7416986940b756d09d706 P 7c9e5a258fc74ea6ae85976a8d37a217: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786496689953932-4901-0/minicluster-data/ts-1/wal/wals/c7cc1f3f8af7416986940b756d09d706
I20260812 01:05:30.037858 12650 ts_tablet_manager.cc:1939] T c7cc1f3f8af7416986940b756d09d706 P 7c9e5a258fc74ea6ae85976a8d37a217: Deleting consensus metadata
I20260812 01:05:30.039487 11788 catalog_manager.cc:4841] TS 7c9e5a258fc74ea6ae85976a8d37a217 (127.4.201.66:46743): tablet c7cc1f3f8af7416986940b756d09d706 (table test-table [id=8acd9d38d9c1420ba7f65b1fd4237a8f]) successfully deleted
I20260812 01:05:30.121544 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 11910
I20260812 01:05:30.145545 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 12142
Aug 12 01:05:30 dist-test-slave-bndk krb5kdc[11732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.66@KRBTEST.COM
I20260812 01:05:30.160427 12607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:30.146573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51740 (local address 127.4.201.66:46743)
0812 01:05:30.146773 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:30.146777 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:30.146793 (+ 16us) server_negotiation.cc:407] Connection header received
0812 01:05:30.146848 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:30.146851 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:30.146954 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:30.147040 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:30.148420 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:30.149196 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:30.150462 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:30.150856 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:30.150972 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:30.155010 (+ 4038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:30.155026 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:30.155044 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:30.155079 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:30.157845 (+ 2766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:30.158462 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:30.158470 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:30.158473 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:30.158598 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:30.158946 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:30.158949 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:30.158952 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:30.159303 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:30.159579 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:30.159880 (+ 301us) server_negotiation.cc:299] Negotiation successful
0812 01:05:30.160106 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 01:05:30.161113 12338 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:30.261612 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 12142
I20260812 01:05:30.294656 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 12354
Aug 12 01:05:30 dist-test-slave-bndk krb5kdc[11732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.67@KRBTEST.COM
I20260812 01:05:30.312412 12600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:30.295522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34490 (local address 127.4.201.67:32887)
0812 01:05:30.295698 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:30.295702 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:30.295720 (+ 18us) server_negotiation.cc:407] Connection header received
0812 01:05:30.295957 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:30.295961 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:30.296054 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:30.296131 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:30.297865 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:30.298694 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:30.300491 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:30.300934 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:30.301077 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:30.306495 (+ 5418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:30.306508 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:30.306526 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:30.306563 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:30.309460 (+ 2897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:30.310255 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:30.310263 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:30.310265 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:30.310427 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:30.310841 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:30.310844 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:30.310846 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:30.311219 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:30.311467 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:30.311848 (+ 381us) server_negotiation.cc:299] Negotiation successful
0812 01:05:30.312016 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 01:05:30.313123 12564 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:30.434615 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 12354
I20260812 01:05:30.455507 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 11756
I20260812 01:05:30.456606 11851 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:30.563411 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 11756
2026-08-12T01:05:30Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4191 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-12T01:05:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:05:30Z Disabled control of system clock
I20260812 01:05:30.640157 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:43783
--webserver_interface=127.4.201.126
--webserver_port=0
--builtin_ntp_servers=127.4.201.84:43109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:43783
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 01:05:30.960387 12664 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:30.960649 12664 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:30.960781 12664 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:30.967923 12664 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:05:30.968025 12664 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:30.968087 12664 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:30.968160 12664 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:05:30.968215 12664 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:05:30.977841 12664 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:43109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:43783
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:43783
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:30.979065 12664 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:30.980999 12664 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:30.992547 12673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:30.992573 12675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:30.992528 12677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:30.993551 12664 server_base.cc:1034] running on GCE node
I20260812 01:05:30.994263 12664 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:30.995534 12664 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:30.996740 12664 hybrid_clock.cc:648] HybridClock initialized: now 1786496730996706 us; error 68 us; skew 500 ppm
I20260812 01:05:30.997056 12664 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:05:30.999394 12664 webserver.cc:460] Webserver started at http://127.4.201.126:44591/ using document root <none> and password file <none>
I20260812 01:05:31.000038 12664 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:31.000126 12664 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:31.000406 12664 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:31.003305 12664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "4b94a95001ad473c9c6335073c929f33"
format_stamp: "Formatted at 2026-08-12 01:05:30 on dist-test-slave-bndk"
server_key: "fa55ffe55150b9dafa66eb0283a56c26"
server_key_iv: "2a1c68ecf0471011a1c65d318459020c"
server_key_version: "encryptionkey@0"
I20260812 01:05:31.004042 12664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "4b94a95001ad473c9c6335073c929f33"
format_stamp: "Formatted at 2026-08-12 01:05:30 on dist-test-slave-bndk"
server_key: "fa55ffe55150b9dafa66eb0283a56c26"
server_key_iv: "2a1c68ecf0471011a1c65d318459020c"
server_key_version: "encryptionkey@0"
I20260812 01:05:31.009027 12664 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 01:05:31.012404 12684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:31.013743 12664 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:05:31.013901 12664 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "4b94a95001ad473c9c6335073c929f33"
format_stamp: "Formatted at 2026-08-12 01:05:30 on dist-test-slave-bndk"
server_key: "fa55ffe55150b9dafa66eb0283a56c26"
server_key_iv: "2a1c68ecf0471011a1c65d318459020c"
server_key_version: "encryptionkey@0"
I20260812 01:05:31.014096 12664 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:31.019676 12664 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:31.020406 12664 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:31.020689 12664 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:31.037447 12664 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:43783
I20260812 01:05:31.037498 12783 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:43783 every 8 connection(s)
I20260812 01:05:31.038697 12664 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:05:31.042254 12786 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:31.047461 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 12664
I20260812 01:05:31.047652 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:05:31.048482 4901 external_mini_cluster.cc:1428] Setting key d07fd5cf7b7a93f0d04cc128a98f460c
I20260812 01:05:31.053299 12786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b94a95001ad473c9c6335073c929f33: Bootstrap starting.
I20260812 01:05:31.056577 12789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:31.050586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40744 (local address 127.4.201.126:43783)
0812 01:05:31.051628 (+ 1042us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:31.051639 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:31.051700 (+ 61us) server_negotiation.cc:407] Connection header received
0812 01:05:31.053338 (+ 1638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:31.053361 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:31.053754 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:31.054053 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:31.055074 (+ 1021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:31.055080 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:31.055092 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:05:31.055107 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:31.055165 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:05:31.055180 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:31.055349 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:31.055441 (+ 92us) server_negotiation.cc:299] Negotiation successful
0812 01:05:31.055650 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":628,"thread_start_us":383,"threads_started":1}
I20260812 01:05:31.056825 12786 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b94a95001ad473c9c6335073c929f33: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:31.058130 12786 log.cc:824] T 00000000000000000000000000000000 P 4b94a95001ad473c9c6335073c929f33: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:31.060892 12786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b94a95001ad473c9c6335073c929f33: No bootstrap required, opened a new log
I20260812 01:05:31.068184 12786 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b94a95001ad473c9c6335073c929f33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b94a95001ad473c9c6335073c929f33" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43783 } }
I20260812 01:05:31.068497 12786 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4b94a95001ad473c9c6335073c929f33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:31.068593 12786 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b94a95001ad473c9c6335073c929f33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b94a95001ad473c9c6335073c929f33, State: Initialized, Role: FOLLOWER
I20260812 01:05:31.069114 12786 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b94a95001ad473c9c6335073c929f33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b94a95001ad473c9c6335073c929f33" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43783 } }
I20260812 01:05:31.069386 12786 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4b94a95001ad473c9c6335073c929f33 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:05:31.069517 12786 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4b94a95001ad473c9c6335073c929f33 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:05:31.069670 12786 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b94a95001ad473c9c6335073c929f33 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:31.071853 12786 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4b94a95001ad473c9c6335073c929f33 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b94a95001ad473c9c6335073c929f33" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43783 } }
I20260812 01:05:31.072326 12786 leader_election.cc:302] T 00000000000000000000000000000000 P 4b94a95001ad473c9c6335073c929f33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b94a95001ad473c9c6335073c929f33; no voters:
I20260812 01:05:31.072844 12786 leader_election.cc:288] T 00000000000000000000000000000000 P 4b94a95001ad473c9c6335073c929f33 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:05:31.072960 12792 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4b94a95001ad473c9c6335073c929f33 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:05:31.073634 12792 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4b94a95001ad473c9c6335073c929f33 [term 1 LEADER]: Becoming Leader. State: Replica: 4b94a95001ad473c9c6335073c929f33, State: Running, Role: LEADER
I20260812 01:05:31.074188 12792 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b94a95001ad473c9c6335073c929f33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b94a95001ad473c9c6335073c929f33" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43783 } }
I20260812 01:05:31.074735 12786 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b94a95001ad473c9c6335073c929f33 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:05:31.078966 12794 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b94a95001ad473c9c6335073c929f33 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b94a95001ad473c9c6335073c929f33. Latest consensus state: current_term: 1 leader_uuid: "4b94a95001ad473c9c6335073c929f33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b94a95001ad473c9c6335073c929f33" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43783 } } }
I20260812 01:05:31.078963 12793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b94a95001ad473c9c6335073c929f33 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b94a95001ad473c9c6335073c929f33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b94a95001ad473c9c6335073c929f33" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43783 } } }
I20260812 01:05:31.079406 12793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b94a95001ad473c9c6335073c929f33 [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:31.079382 12794 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b94a95001ad473c9c6335073c929f33 [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:31.083320 12815 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:05:31.087427 12815 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:05:31.095060 12815 catalog_manager.cc:1347] Generated new cluster ID: e479931a94ef489697db5513796e391a
I20260812 01:05:31.095168 12815 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:05:31.119634 12815 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:05:31.120150 12815 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:05:31.130318 12815 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4b94a95001ad473c9c6335073c929f33: Generated new TSK 0
I20260812 01:05:31.131311 12815 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:05:31.141003 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:0
--local_ip_for_outbound_sockets=127.4.201.65
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:43783
--builtin_ntp_servers=127.4.201.84:43109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 01:05:31.472779 12821 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:31.473048 12821 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:31.473151 12821 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:31.480304 12821 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:31.480396 12821 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:31.480508 12821 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:05:31.489239 12821 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:43109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:43783
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:31.490453 12821 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:31.492237 12821 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:31.505232 12827 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:31.505188 12828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:31.505162 12830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:31.506017 12821 server_base.cc:1034] running on GCE node
I20260812 01:05:31.506631 12821 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:31.507531 12821 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:31.508731 12821 hybrid_clock.cc:648] HybridClock initialized: now 1786496731508684 us; error 35 us; skew 500 ppm
I20260812 01:05:31.509045 12821 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:05:31.511139 12821 webserver.cc:460] Webserver started at http://127.4.201.65:37159/ using document root <none> and password file <none>
I20260812 01:05:31.511891 12821 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:31.512022 12821 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:31.512352 12821 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:31.515244 12821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-0/data/instance:
uuid: "06be0088b10e4223986f3f2e48a9cd68"
format_stamp: "Formatted at 2026-08-12 01:05:31 on dist-test-slave-bndk"
server_key: "46a03a8da16384feeba8ffa06664b5fd"
server_key_iv: "3404dc2acb16aa10f1b70d0d07640222"
server_key_version: "encryptionkey@0"
I20260812 01:05:31.516086 12821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance:
uuid: "06be0088b10e4223986f3f2e48a9cd68"
format_stamp: "Formatted at 2026-08-12 01:05:31 on dist-test-slave-bndk"
server_key: "46a03a8da16384feeba8ffa06664b5fd"
server_key_iv: "3404dc2acb16aa10f1b70d0d07640222"
server_key_version: "encryptionkey@0"
I20260812 01:05:31.521273 12821 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.007s
I20260812 01:05:31.524521 12839 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:31.526155 12821 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 01:05:31.526309 12821 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "06be0088b10e4223986f3f2e48a9cd68"
format_stamp: "Formatted at 2026-08-12 01:05:31 on dist-test-slave-bndk"
server_key: "46a03a8da16384feeba8ffa06664b5fd"
server_key_iv: "3404dc2acb16aa10f1b70d0d07640222"
server_key_version: "encryptionkey@0"
I20260812 01:05:31.526530 12821 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:31.531785 12821 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:31.532519 12821 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:31.532752 12821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:31.533656 12821 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:05:31.534961 12821 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:31.535051 12821 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:31.535153 12821 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:31.535226 12821 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:31.563352 12821 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:45837
I20260812 01:05:31.563397 13030 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:45837 every 8 connection(s)
I20260812 01:05:31.564591 12821 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:05:31.572100 13034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:31.567016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:53475 (local address 127.4.201.126:43783)
0812 01:05:31.567438 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:31.567443 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:31.568598 (+ 1155us) server_negotiation.cc:407] Connection header received
0812 01:05:31.570251 (+ 1653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:31.570255 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:31.570308 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:31.570403 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:31.571526 (+ 1123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:31.571531 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:31.571534 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:05:31.571550 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:31.571593 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:05:31.571605 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:31.571701 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:31.571839 (+ 138us) server_negotiation.cc:299] Negotiation successful
0812 01:05:31.571886 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316,"thread_start_us":204,"threads_started":1}
I20260812 01:05:31.572928 13035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:31.567571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:43783 (local address 127.4.201.65:53475)
0812 01:05:31.568441 (+ 870us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:31.568486 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:31.570025 (+ 1539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:31.570577 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:31.570585 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:31.570667 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:31.571228 (+ 561us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:05:31.571230 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:31.571265 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:05:31.571360 (+ 95us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:31.571678 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:31.571684 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:31.571688 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:05:31.571900 (+ 212us) client_negotiation.cc:240] Negotiation successful
0812 01:05:31.572098 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":249,"threads_started":1}
I20260812 01:05:31.573362 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 12821
I20260812 01:05:31.573542 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance
I20260812 01:05:31.574244 4901 external_mini_cluster.cc:1428] Setting key 6c8a10a78b49aed4c182d58a4c4e9fd7
I20260812 01:05:31.574424 13032 heartbeater.cc:347] Connected to a master server at 127.4.201.126:43783
I20260812 01:05:31.574702 13032 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:31.575362 13032 heartbeater.cc:511] Master 127.4.201.126:43783 requested a full tablet report, sending...
I20260812 01:05:31.577196 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:0
--local_ip_for_outbound_sockets=127.4.201.66
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:43783
--builtin_ntp_servers=127.4.201.84:43109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260812 01:05:31.577649 12718 ts_manager.cc:194] Registered new tserver with Master: 06be0088b10e4223986f3f2e48a9cd68 (127.4.201.65:45837)
W20260812 01:05:31.904386 13037 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:31.904644 13037 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:31.904774 13037 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:31.912384 13037 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:31.912473 13037 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:31.912607 13037 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:05:31.921445 13037 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:43109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:43783
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:31.922611 13037 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:31.924337 13037 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:31.936815 13045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:31.936885 13050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:31.936815 13046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:31.937723 13037 server_base.cc:1034] running on GCE node
I20260812 01:05:31.938253 13037 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:31.939086 13037 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:31.940279 13037 hybrid_clock.cc:648] HybridClock initialized: now 1786496731940238 us; error 31 us; skew 500 ppm
I20260812 01:05:31.940572 13037 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:05:31.942611 13037 webserver.cc:460] Webserver started at http://127.4.201.66:45267/ using document root <none> and password file <none>
I20260812 01:05:31.943238 13037 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:31.943328 13037 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:31.943630 13037 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:31.946455 13037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-1/data/instance:
uuid: "9856bbefdac6409dbe1f0c490c21b4ea"
format_stamp: "Formatted at 2026-08-12 01:05:31 on dist-test-slave-bndk"
server_key: "0e38a3b80caa0441461a4dfba601e6ac"
server_key_iv: "f97f2b23236e13d983ba69fa308336eb"
server_key_version: "encryptionkey@0"
I20260812 01:05:31.947227 13037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance:
uuid: "9856bbefdac6409dbe1f0c490c21b4ea"
format_stamp: "Formatted at 2026-08-12 01:05:31 on dist-test-slave-bndk"
server_key: "0e38a3b80caa0441461a4dfba601e6ac"
server_key_iv: "f97f2b23236e13d983ba69fa308336eb"
server_key_version: "encryptionkey@0"
I20260812 01:05:31.951951 13037 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 01:05:31.955164 13058 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:31.956393 13037 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 01:05:31.956550 13037 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "9856bbefdac6409dbe1f0c490c21b4ea"
format_stamp: "Formatted at 2026-08-12 01:05:31 on dist-test-slave-bndk"
server_key: "0e38a3b80caa0441461a4dfba601e6ac"
server_key_iv: "f97f2b23236e13d983ba69fa308336eb"
server_key_version: "encryptionkey@0"
I20260812 01:05:31.956760 13037 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:31.962182 13037 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:31.962920 13037 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:31.963171 13037 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:31.964035 13037 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:05:31.965412 13037 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:31.965508 13037 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:31.965613 13037 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:31.965684 13037 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:31.995790 13037 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:46545
I20260812 01:05:31.995839 13250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:46545 every 8 connection(s)
I20260812 01:05:31.997099 13037 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:05:31.998018 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 13037
I20260812 01:05:31.998191 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance
I20260812 01:05:31.998733 4901 external_mini_cluster.cc:1428] Setting key 2412899226802e6b6c3067d18c2bcc86
I20260812 01:05:32.002077 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:0
--local_ip_for_outbound_sockets=127.4.201.67
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:43783
--builtin_ntp_servers=127.4.201.84:43109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260812 01:05:32.006053 13034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:32.000186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:46659 (local address 127.4.201.126:43783)
0812 01:05:32.000386 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:32.000392 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:32.002047 (+ 1655us) server_negotiation.cc:407] Connection header received
0812 01:05:32.003743 (+ 1696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:32.003749 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:32.003835 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:32.003932 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:32.005418 (+ 1486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:32.005423 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:32.005426 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:05:32.005443 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:32.005477 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:05:32.005490 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:32.005593 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:32.005774 (+ 181us) server_negotiation.cc:299] Negotiation successful
0812 01:05:32.005824 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 01:05:32.007263 13254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:32.000871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:43783 (local address 127.4.201.66:46659)
0812 01:05:32.001886 (+ 1015us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:32.001930 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:32.003468 (+ 1538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:32.004253 (+ 785us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:32.004263 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:32.004376 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:32.005052 (+ 676us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:05:32.005055 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:32.005105 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:05:32.005240 (+ 135us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:32.005582 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:32.005592 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:32.005599 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 01:05:32.005862 (+ 263us) client_negotiation.cc:240] Negotiation successful
0812 01:05:32.006126 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":350,"threads_started":1}
I20260812 01:05:32.008561 13251 heartbeater.cc:347] Connected to a master server at 127.4.201.126:43783
I20260812 01:05:32.008838 13251 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:32.009454 13251 heartbeater.cc:511] Master 127.4.201.126:43783 requested a full tablet report, sending...
I20260812 01:05:32.010787 12718 ts_manager.cc:194] Registered new tserver with Master: 9856bbefdac6409dbe1f0c490c21b4ea (127.4.201.66:46545)
W20260812 01:05:32.336740 13256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:32.337004 13256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:32.337146 13256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:32.344535 13256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:32.344645 13256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:32.344806 13256 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:05:32.353971 13256 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:43109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:43783
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:32.355257 13256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:32.357064 13256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:32.369856 13270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:32.369822 13266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:32.370270 13264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:32.370800 13256 server_base.cc:1034] running on GCE node
I20260812 01:05:32.371347 13256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:32.372198 13256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:32.373401 13256 hybrid_clock.cc:648] HybridClock initialized: now 1786496732373342 us; error 46 us; skew 500 ppm
I20260812 01:05:32.373704 13256 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:05:32.375909 13256 webserver.cc:460] Webserver started at http://127.4.201.67:45921/ using document root <none> and password file <none>
I20260812 01:05:32.376591 13256 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:32.376683 13256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:32.376987 13256 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:32.379964 13256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-2/data/instance:
uuid: "3035f0f06033421b9ab057939138e4f9"
format_stamp: "Formatted at 2026-08-12 01:05:32 on dist-test-slave-bndk"
server_key: "61f7346690e42a832a2d0e719a5a05ae"
server_key_iv: "f56cd036d11e5f4ba42ab724b516f9c7"
server_key_version: "encryptionkey@0"
I20260812 01:05:32.380784 13256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance:
uuid: "3035f0f06033421b9ab057939138e4f9"
format_stamp: "Formatted at 2026-08-12 01:05:32 on dist-test-slave-bndk"
server_key: "61f7346690e42a832a2d0e719a5a05ae"
server_key_iv: "f56cd036d11e5f4ba42ab724b516f9c7"
server_key_version: "encryptionkey@0"
I20260812 01:05:32.386149 13256 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260812 01:05:32.389487 13278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:32.390820 13256 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 01:05:32.390954 13256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "3035f0f06033421b9ab057939138e4f9"
format_stamp: "Formatted at 2026-08-12 01:05:32 on dist-test-slave-bndk"
server_key: "61f7346690e42a832a2d0e719a5a05ae"
server_key_iv: "f56cd036d11e5f4ba42ab724b516f9c7"
server_key_version: "encryptionkey@0"
I20260812 01:05:32.391158 13256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:32.396633 13256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:32.397382 13256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:32.397599 13256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:32.398440 13256 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:05:32.399741 13256 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:32.399827 13256 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:32.399906 13256 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:32.399959 13256 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:32.430902 13256 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:39519
I20260812 01:05:32.430971 13463 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:39519 every 8 connection(s)
I20260812 01:05:32.432188 13256 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:05:32.434352 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 13256
I20260812 01:05:32.434531 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance
I20260812 01:05:32.434984 4901 external_mini_cluster.cc:1428] Setting key 4bdd1e4cbace00a90007245bb0702f84
I20260812 01:05:32.440135 13034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:32.434632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:39669 (local address 127.4.201.126:43783)
0812 01:05:32.434846 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:32.434852 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:32.436343 (+ 1491us) server_negotiation.cc:407] Connection header received
0812 01:05:32.438353 (+ 2010us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:32.438357 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:32.438409 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:32.438503 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:32.439597 (+ 1094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:32.439602 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:32.439605 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:05:32.439620 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:32.439653 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:05:32.439664 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:32.439750 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:32.439881 (+ 131us) server_negotiation.cc:299] Negotiation successful
0812 01:05:32.439927 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 01:05:32.440971 13468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:32.435190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:43783 (local address 127.4.201.67:39669)
0812 01:05:32.436174 (+ 984us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:32.436234 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:32.438094 (+ 1860us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:32.438678 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:32.438685 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:32.438769 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:32.439325 (+ 556us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:05:32.439327 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:32.439361 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:05:32.439442 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:32.439735 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:32.439741 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:32.439745 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:05:32.439941 (+ 196us) client_negotiation.cc:240] Negotiation successful
0812 01:05:32.440120 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":293,"threads_started":1}
I20260812 01:05:32.442171 13464 heartbeater.cc:347] Connected to a master server at 127.4.201.126:43783
I20260812 01:05:32.442447 13464 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:32.443002 13464 heartbeater.cc:511] Master 127.4.201.126:43783 requested a full tablet report, sending...
I20260812 01:05:32.444284 12718 ts_manager.cc:194] Registered new tserver with Master: 3035f0f06033421b9ab057939138e4f9 (127.4.201.67:39519)
I20260812 01:05:32.449967 4901 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:05:32.456297 13034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:32.454073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40748 (local address 127.4.201.126:43783)
0812 01:05:32.454255 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:32.454261 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:32.454791 (+ 530us) server_negotiation.cc:407] Connection header received
0812 01:05:32.454920 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:32.454924 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:32.454974 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:32.455049 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:32.455815 (+ 766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:32.455820 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:32.455823 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:05:32.455837 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:32.455867 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:05:32.455878 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:32.455965 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:32.456016 (+ 51us) server_negotiation.cc:299] Negotiation successful
0812 01:05:32.456058 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 01:05:32.459872 12718 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40748:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:05:32.466497 12718 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:05:32.486233 13481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:32.478164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44322 (local address 127.4.201.66:46545)
0812 01:05:32.478908 (+ 744us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:32.478917 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:32.481951 (+ 3034us) server_negotiation.cc:407] Connection header received
0812 01:05:32.482232 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:32.482240 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:32.482477 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:32.482620 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:32.485098 (+ 2478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:32.485108 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:32.485122 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:05:32.485142 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:32.485206 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:05:32.485261 (+ 55us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:32.485441 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:32.485723 (+ 282us) server_negotiation.cc:299] Negotiation successful
0812 01:05:32.485847 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":527,"thread_start_us":354,"threads_started":1}
I20260812 01:05:32.487387 13478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:32.477712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:46545 (local address 127.0.0.1:44322)
0812 01:05:32.481804 (+ 4092us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:32.481842 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:32.482059 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:32.483808 (+ 1749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:32.483817 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:32.483916 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:32.484753 (+ 837us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:05:32.484757 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:32.484802 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:05:32.484899 (+ 97us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:32.485505 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:32.485518 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:32.485528 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 01:05:32.486795 (+ 1267us) client_negotiation.cc:240] Negotiation successful
0812 01:05:32.486902 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3844,"thread_start_us":3690,"threads_started":1}
I20260812 01:05:32.489089 13479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:32.477946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:45837 (local address 127.0.0.1:56326)
0812 01:05:32.485437 (+ 7491us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:32.485456 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:32.485551 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:32.487276 (+ 1725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:32.487281 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:32.487306 (+ 25us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:32.488000 (+ 694us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:05:32.488004 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:32.488021 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:05:32.488067 (+ 46us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:32.488491 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:32.488496 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:32.488501 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 01:05:32.488665 (+ 164us) client_negotiation.cc:240] Negotiation successful
0812 01:05:32.488719 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7339,"thread_start_us":7154,"threads_started":1}
I20260812 01:05:32.489677 13483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:32.478180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56326 (local address 127.4.201.65:45837)
0812 01:05:32.485900 (+ 7720us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:32.485909 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:32.485941 (+ 32us) server_negotiation.cc:407] Connection header received
0812 01:05:32.486013 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:32.486021 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:32.486226 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:32.486371 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:32.488253 (+ 1882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:32.488263 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:32.488278 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:05:32.488297 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:32.488364 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:05:32.488391 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:32.488522 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:32.489313 (+ 791us) server_negotiation.cc:299] Negotiation successful
0812 01:05:32.489420 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7524,"thread_start_us":6437,"threads_started":1}
I20260812 01:05:32.492213 13478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:32.482439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:39519 (local address 127.0.0.1:39644)
0812 01:05:32.488080 (+ 5641us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:32.488099 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:32.488177 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:32.490638 (+ 2461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:32.490644 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:32.490689 (+ 45us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:32.491315 (+ 626us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:05:32.491318 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:32.491335 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:05:32.491379 (+ 44us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:32.491828 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:32.491833 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:32.491838 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 01:05:32.491932 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 01:05:32.491976 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5520,"thread_start_us":8577,"threads_started":1}
I20260812 01:05:32.492430 13486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:32.482574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39644 (local address 127.4.201.67:39519)
0812 01:05:32.489078 (+ 6504us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:32.489087 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:32.489122 (+ 35us) server_negotiation.cc:407] Connection header received
0812 01:05:32.489195 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:32.489202 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:32.489424 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:32.489568 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:32.491579 (+ 2011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:32.491588 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:32.491601 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:05:32.491621 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:32.491676 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:05:32.491695 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:32.491899 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:32.491960 (+ 61us) server_negotiation.cc:299] Negotiation successful
0812 01:05:32.492059 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6332,"thread_start_us":6142,"threads_started":1}
I20260812 01:05:32.493244 12928 tablet_service.cc:1467] Processing CreateTablet for tablet 67dd2fa71e5049feaf870e7474f36ef2 (DEFAULT_TABLE table=test-table [id=f02160582d8841a4bdd1628abfcd1080]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:32.494493 12928 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67dd2fa71e5049feaf870e7474f36ef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:32.494699 13149 tablet_service.cc:1467] Processing CreateTablet for tablet 67dd2fa71e5049feaf870e7474f36ef2 (DEFAULT_TABLE table=test-table [id=f02160582d8841a4bdd1628abfcd1080]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:32.496042 13149 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67dd2fa71e5049feaf870e7474f36ef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:32.502556 13353 tablet_service.cc:1467] Processing CreateTablet for tablet 67dd2fa71e5049feaf870e7474f36ef2 (DEFAULT_TABLE table=test-table [id=f02160582d8841a4bdd1628abfcd1080]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:32.504092 13353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67dd2fa71e5049feaf870e7474f36ef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:32.507488 13487 tablet_bootstrap.cc:492] T 67dd2fa71e5049feaf870e7474f36ef2 P 9856bbefdac6409dbe1f0c490c21b4ea: Bootstrap starting.
I20260812 01:05:32.509590 13488 tablet_bootstrap.cc:492] T 67dd2fa71e5049feaf870e7474f36ef2 P 06be0088b10e4223986f3f2e48a9cd68: Bootstrap starting.
I20260812 01:05:32.512410 13487 tablet_bootstrap.cc:654] T 67dd2fa71e5049feaf870e7474f36ef2 P 9856bbefdac6409dbe1f0c490c21b4ea: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:32.513132 13488 tablet_bootstrap.cc:654] T 67dd2fa71e5049feaf870e7474f36ef2 P 06be0088b10e4223986f3f2e48a9cd68: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:32.513728 13487 log.cc:824] T 67dd2fa71e5049feaf870e7474f36ef2 P 9856bbefdac6409dbe1f0c490c21b4ea: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:32.514408 13488 log.cc:824] T 67dd2fa71e5049feaf870e7474f36ef2 P 06be0088b10e4223986f3f2e48a9cd68: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:32.516762 13491 tablet_bootstrap.cc:492] T 67dd2fa71e5049feaf870e7474f36ef2 P 3035f0f06033421b9ab057939138e4f9: Bootstrap starting.
I20260812 01:05:32.518167 13487 tablet_bootstrap.cc:492] T 67dd2fa71e5049feaf870e7474f36ef2 P 9856bbefdac6409dbe1f0c490c21b4ea: No bootstrap required, opened a new log
I20260812 01:05:32.518455 13487 ts_tablet_manager.cc:1397] T 67dd2fa71e5049feaf870e7474f36ef2 P 9856bbefdac6409dbe1f0c490c21b4ea: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260812 01:05:32.518877 13488 tablet_bootstrap.cc:492] T 67dd2fa71e5049feaf870e7474f36ef2 P 06be0088b10e4223986f3f2e48a9cd68: No bootstrap required, opened a new log
I20260812 01:05:32.519100 13488 ts_tablet_manager.cc:1397] T 67dd2fa71e5049feaf870e7474f36ef2 P 06be0088b10e4223986f3f2e48a9cd68: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260812 01:05:32.520218 13491 tablet_bootstrap.cc:654] T 67dd2fa71e5049feaf870e7474f36ef2 P 3035f0f06033421b9ab057939138e4f9: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:32.521359 13491 log.cc:824] T 67dd2fa71e5049feaf870e7474f36ef2 P 3035f0f06033421b9ab057939138e4f9: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:32.524978 13491 tablet_bootstrap.cc:492] T 67dd2fa71e5049feaf870e7474f36ef2 P 3035f0f06033421b9ab057939138e4f9: No bootstrap required, opened a new log
I20260812 01:05:32.525282 13491 ts_tablet_manager.cc:1397] T 67dd2fa71e5049feaf870e7474f36ef2 P 3035f0f06033421b9ab057939138e4f9: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260812 01:05:32.526499 13488 raft_consensus.cc:348] T 67dd2fa71e5049feaf870e7474f36ef2 P 06be0088b10e4223986f3f2e48a9cd68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9856bbefdac6409dbe1f0c490c21b4ea" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46545 } } peers { permanent_uuid: "06be0088b10e4223986f3f2e48a9cd68" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 45837 } } peers { permanent_uuid: "3035f0f06033421b9ab057939138e4f9" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39519 } }
I20260812 01:05:32.526831 13488 raft_consensus.cc:374] T 67dd2fa71e5049feaf870e7474f36ef2 P 06be0088b10e4223986f3f2e48a9cd68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:32.526921 13488 raft_consensus.cc:729] T 67dd2fa71e5049feaf870e7474f36ef2 P 06be0088b10e4223986f3f2e48a9cd68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06be0088b10e4223986f3f2e48a9cd68, State: Initialized, Role: FOLLOWER
I20260812 01:05:32.527472 13488 consensus_queue.cc:260] T 67dd2fa71e5049feaf870e7474f36ef2 P 06be0088b10e4223986f3f2e48a9cd68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9856bbefdac6409dbe1f0c490c21b4ea" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46545 } } peers { permanent_uuid: "06be0088b10e4223986f3f2e48a9cd68" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 45837 } } peers { permanent_uuid: "3035f0f06033421b9ab057939138e4f9" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39519 } }
I20260812 01:05:32.528131 13487 raft_consensus.cc:348] T 67dd2fa71e5049feaf870e7474f36ef2 P 9856bbefdac6409dbe1f0c490c21b4ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9856bbefdac6409dbe1f0c490c21b4ea" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46545 } } peers { permanent_uuid: "06be0088b10e4223986f3f2e48a9cd68" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 45837 } } peers { permanent_uuid: "3035f0f06033421b9ab057939138e4f9" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39519 } }
I20260812 01:05:32.528434 13032 heartbeater.cc:503] Master 127.4.201.126:43783 was elected leader, sending a full tablet report...
I20260812 01:05:32.528546 13487 raft_consensus.cc:374] T 67dd2fa71e5049feaf870e7474f36ef2 P 9856bbefdac6409dbe1f0c490c21b4ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:32.528642 13487 raft_consensus.cc:729] T 67dd2fa71e5049feaf870e7474f36ef2 P 9856bbefdac6409dbe1f0c490c21b4ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9856bbefdac6409dbe1f0c490c21b4ea, State: Initialized, Role: FOLLOWER
I20260812 01:05:32.529250 13487 consensus_queue.cc:260] T 67dd2fa71e5049feaf870e7474f36ef2 P 9856bbefdac6409dbe1f0c490c21b4ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9856bbefdac6409dbe1f0c490c21b4ea" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46545 } } peers { permanent_uuid: "06be0088b10e4223986f3f2e48a9cd68" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 45837 } } peers { permanent_uuid: "3035f0f06033421b9ab057939138e4f9" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39519 } }
I20260812 01:05:32.530596 13488 ts_tablet_manager.cc:1428] T 67dd2fa71e5049feaf870e7474f36ef2 P 06be0088b10e4223986f3f2e48a9cd68: Time spent starting tablet: real 0.011s user 0.005s sys 0.005s
I20260812 01:05:32.535640 13491 raft_consensus.cc:348] T 67dd2fa71e5049feaf870e7474f36ef2 P 3035f0f06033421b9ab057939138e4f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9856bbefdac6409dbe1f0c490c21b4ea" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46545 } } peers { permanent_uuid: "06be0088b10e4223986f3f2e48a9cd68" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 45837 } } peers { permanent_uuid: "3035f0f06033421b9ab057939138e4f9" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39519 } }
I20260812 01:05:32.536108 13491 raft_consensus.cc:374] T 67dd2fa71e5049feaf870e7474f36ef2 P 3035f0f06033421b9ab057939138e4f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:32.536211 13491 raft_consensus.cc:729] T 67dd2fa71e5049feaf870e7474f36ef2 P 3035f0f06033421b9ab057939138e4f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3035f0f06033421b9ab057939138e4f9, State: Initialized, Role: FOLLOWER
I20260812 01:05:32.536837 13491 consensus_queue.cc:260] T 67dd2fa71e5049feaf870e7474f36ef2 P 3035f0f06033421b9ab057939138e4f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9856bbefdac6409dbe1f0c490c21b4ea" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46545 } } peers { permanent_uuid: "06be0088b10e4223986f3f2e48a9cd68" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 45837 } } peers { permanent_uuid: "3035f0f06033421b9ab057939138e4f9" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39519 } }
I20260812 01:05:32.537854 13251 heartbeater.cc:503] Master 127.4.201.126:43783 was elected leader, sending a full tablet report...
I20260812 01:05:32.538697 13487 ts_tablet_manager.cc:1428] T 67dd2fa71e5049feaf870e7474f36ef2 P 9856bbefdac6409dbe1f0c490c21b4ea: Time spent starting tablet: real 0.020s user 0.012s sys 0.008s
I20260812 01:05:32.539628 13464 heartbeater.cc:503] Master 127.4.201.126:43783 was elected leader, sending a full tablet report...
I20260812 01:05:32.540108 13491 ts_tablet_manager.cc:1428] T 67dd2fa71e5049feaf870e7474f36ef2 P 3035f0f06033421b9ab057939138e4f9: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
W20260812 01:05:32.566591 13033 tablet.cc:2369] T 67dd2fa71e5049feaf870e7474f36ef2 P 06be0088b10e4223986f3f2e48a9cd68: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:05:32.606091 13494 raft_consensus.cc:482] T 67dd2fa71e5049feaf870e7474f36ef2 P 06be0088b10e4223986f3f2e48a9cd68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:05:32.606419 13494 raft_consensus.cc:504] T 67dd2fa71e5049feaf870e7474f36ef2 P 06be0088b10e4223986f3f2e48a9cd68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9856bbefdac6409dbe1f0c490c21b4ea" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46545 } } peers { permanent_uuid: "06be0088b10e4223986f3f2e48a9cd68" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 45837 } } peers { permanent_uuid: "3035f0f06033421b9ab057939138e4f9" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39519 } }
I20260812 01:05:32.608132 13494 leader_election.cc:288] T 67dd2fa71e5049feaf870e7474f36ef2 P 06be0088b10e4223986f3f2e48a9cd68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9856bbefdac6409dbe1f0c490c21b4ea (127.4.201.66:46545), 3035f0f06033421b9ab057939138e4f9 (127.4.201.67:39519)
I20260812 01:05:32.611243 13481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:32.608528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:42991 (local address 127.4.201.66:46545)
0812 01:05:32.608730 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:32.608736 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:32.609264 (+ 528us) server_negotiation.cc:407] Connection header received
0812 01:05:32.609453 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:32.609459 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:32.609537 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:32.609634 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:32.610666 (+ 1032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:32.610672 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:32.610677 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:05:32.610695 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:32.610729 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:05:32.610744 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:32.610870 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:32.610954 (+ 84us) server_negotiation.cc:299] Negotiation successful
0812 01:05:32.611019 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 01:05:32.611465 13501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:32.608534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:46545 (local address 127.4.201.65:42991)
0812 01:05:32.609129 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:32.609146 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:32.609306 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:32.609739 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:32.609743 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:32.609764 (+ 21us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:32.610455 (+ 691us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:05:32.610457 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:32.610472 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:05:32.610514 (+ 42us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:32.610853 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:32.610856 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:32.610860 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:05:32.610979 (+ 119us) client_negotiation.cc:240] Negotiation successful
0812 01:05:32.611028 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":319,"threads_started":1}
I20260812 01:05:32.611886 13486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:32.609441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:48719 (local address 127.4.201.67:39519)
0812 01:05:32.609625 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:32.609631 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:32.609978 (+ 347us) server_negotiation.cc:407] Connection header received
0812 01:05:32.610124 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:32.610129 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:32.610179 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:32.610258 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:32.611113 (+ 855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:32.611119 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:32.611124 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:05:32.611145 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:32.611205 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:05:32.611220 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:32.611364 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:32.611592 (+ 228us) server_negotiation.cc:299] Negotiation successful
0812 01:05:32.611656 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 01:05:32.612068 13504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:32.609276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:39519 (local address 127.4.201.65:48719)
0812 01:05:32.609872 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:32.609887 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:32.610002 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:32.610294 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:32.610298 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:32.610320 (+ 22us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:32.610883 (+ 563us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:05:32.610887 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:32.610903 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:05:32.610947 (+ 44us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:32.611467 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:32.611471 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:32.611475 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 01:05:32.611621 (+ 146us) client_negotiation.cc:240] Negotiation successful
0812 01:05:32.611671 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":266,"threads_started":1}
I20260812 01:05:32.612494 13179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67dd2fa71e5049feaf870e7474f36ef2" candidate_uuid: "06be0088b10e4223986f3f2e48a9cd68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9856bbefdac6409dbe1f0c490c21b4ea" is_pre_election: true
I20260812 01:05:32.612969 13179 raft_consensus.cc:2454] T 67dd2fa71e5049feaf870e7474f36ef2 P 9856bbefdac6409dbe1f0c490c21b4ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06be0088b10e4223986f3f2e48a9cd68 in term 0.
I20260812 01:05:32.612911 13389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67dd2fa71e5049feaf870e7474f36ef2" candidate_uuid: "06be0088b10e4223986f3f2e48a9cd68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3035f0f06033421b9ab057939138e4f9" is_pre_election: true
I20260812 01:05:32.613405 13389 raft_consensus.cc:2454] T 67dd2fa71e5049feaf870e7474f36ef2 P 3035f0f06033421b9ab057939138e4f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06be0088b10e4223986f3f2e48a9cd68 in term 0.
I20260812 01:05:32.613610 12841 leader_election.cc:302] T 67dd2fa71e5049feaf870e7474f36ef2 P 06be0088b10e4223986f3f2e48a9cd68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06be0088b10e4223986f3f2e48a9cd68, 9856bbefdac6409dbe1f0c490c21b4ea; no voters:
I20260812 01:05:32.613970 13494 raft_consensus.cc:2781] T 67dd2fa71e5049feaf870e7474f36ef2 P 06be0088b10e4223986f3f2e48a9cd68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:05:32.614094 13494 raft_consensus.cc:482] T 67dd2fa71e5049feaf870e7474f36ef2 P 06be0088b10e4223986f3f2e48a9cd68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:05:32.614194 13494 raft_consensus.cc:3037] T 67dd2fa71e5049feaf870e7474f36ef2 P 06be0088b10e4223986f3f2e48a9cd68 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:32.616650 13494 raft_consensus.cc:504] T 67dd2fa71e5049feaf870e7474f36ef2 P 06be0088b10e4223986f3f2e48a9cd68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9856bbefdac6409dbe1f0c490c21b4ea" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46545 } } peers { permanent_uuid: "06be0088b10e4223986f3f2e48a9cd68" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 45837 } } peers { permanent_uuid: "3035f0f06033421b9ab057939138e4f9" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39519 } }
I20260812 01:05:32.617208 13494 leader_election.cc:288] T 67dd2fa71e5049feaf870e7474f36ef2 P 06be0088b10e4223986f3f2e48a9cd68 [CANDIDATE]: Term 1 election: Requested vote from peers 9856bbefdac6409dbe1f0c490c21b4ea (127.4.201.66:46545), 3035f0f06033421b9ab057939138e4f9 (127.4.201.67:39519)
I20260812 01:05:32.617676 13179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67dd2fa71e5049feaf870e7474f36ef2" candidate_uuid: "06be0088b10e4223986f3f2e48a9cd68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9856bbefdac6409dbe1f0c490c21b4ea"
I20260812 01:05:32.617733 13389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67dd2fa71e5049feaf870e7474f36ef2" candidate_uuid: "06be0088b10e4223986f3f2e48a9cd68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3035f0f06033421b9ab057939138e4f9"
I20260812 01:05:32.617918 13389 raft_consensus.cc:3037] T 67dd2fa71e5049feaf870e7474f36ef2 P 3035f0f06033421b9ab057939138e4f9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:32.617918 13179 raft_consensus.cc:3037] T 67dd2fa71e5049feaf870e7474f36ef2 P 9856bbefdac6409dbe1f0c490c21b4ea [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:32.621111 13389 raft_consensus.cc:2454] T 67dd2fa71e5049feaf870e7474f36ef2 P 3035f0f06033421b9ab057939138e4f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06be0088b10e4223986f3f2e48a9cd68 in term 1.
I20260812 01:05:32.621111 13179 raft_consensus.cc:2454] T 67dd2fa71e5049feaf870e7474f36ef2 P 9856bbefdac6409dbe1f0c490c21b4ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06be0088b10e4223986f3f2e48a9cd68 in term 1.
I20260812 01:05:32.621505 12841 leader_election.cc:302] T 67dd2fa71e5049feaf870e7474f36ef2 P 06be0088b10e4223986f3f2e48a9cd68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06be0088b10e4223986f3f2e48a9cd68, 3035f0f06033421b9ab057939138e4f9; no voters:
I20260812 01:05:32.621748 13494 raft_consensus.cc:2781] T 67dd2fa71e5049feaf870e7474f36ef2 P 06be0088b10e4223986f3f2e48a9cd68 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:05:32.622203 13494 raft_consensus.cc:686] T 67dd2fa71e5049feaf870e7474f36ef2 P 06be0088b10e4223986f3f2e48a9cd68 [term 1 LEADER]: Becoming Leader. State: Replica: 06be0088b10e4223986f3f2e48a9cd68, State: Running, Role: LEADER
I20260812 01:05:32.622658 13494 consensus_queue.cc:237] T 67dd2fa71e5049feaf870e7474f36ef2 P 06be0088b10e4223986f3f2e48a9cd68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9856bbefdac6409dbe1f0c490c21b4ea" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46545 } } peers { permanent_uuid: "06be0088b10e4223986f3f2e48a9cd68" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 45837 } } peers { permanent_uuid: "3035f0f06033421b9ab057939138e4f9" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39519 } }
I20260812 01:05:32.627617 12717 catalog_manager.cc:5495] T 67dd2fa71e5049feaf870e7474f36ef2 P 06be0088b10e4223986f3f2e48a9cd68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06be0088b10e4223986f3f2e48a9cd68 (127.4.201.65). New cstate: current_term: 1 leader_uuid: "06be0088b10e4223986f3f2e48a9cd68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9856bbefdac6409dbe1f0c490c21b4ea" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06be0088b10e4223986f3f2e48a9cd68" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 45837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3035f0f06033421b9ab057939138e4f9" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39519 } health_report { overall_health: UNKNOWN } } }
I20260812 01:05:32.653697 13483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:32.651756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56338 (local address 127.4.201.65:45837)
0812 01:05:32.651951 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:32.651957 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:32.652065 (+ 108us) server_negotiation.cc:407] Connection header received
0812 01:05:32.652240 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:32.652244 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:32.652324 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:32.652435 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:32.653196 (+ 761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:32.653201 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:32.653205 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:05:32.653247 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:32.653284 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:05:32.653298 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:32.653407 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:32.653446 (+ 39us) server_negotiation.cc:299] Negotiation successful
0812 01:05:32.653492 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 01:05:32.661406 13389 raft_consensus.cc:1261] T 67dd2fa71e5049feaf870e7474f36ef2 P 3035f0f06033421b9ab057939138e4f9 [term 1 FOLLOWER]: Refusing update from remote peer 06be0088b10e4223986f3f2e48a9cd68: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:32.661463 13179 raft_consensus.cc:1261] T 67dd2fa71e5049feaf870e7474f36ef2 P 9856bbefdac6409dbe1f0c490c21b4ea [term 1 FOLLOWER]: Refusing update from remote peer 06be0088b10e4223986f3f2e48a9cd68: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:32.662307 13505 consensus_queue.cc:1035] T 67dd2fa71e5049feaf870e7474f36ef2 P 06be0088b10e4223986f3f2e48a9cd68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9856bbefdac6409dbe1f0c490c21b4ea" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:32.662642 13494 consensus_queue.cc:1035] T 67dd2fa71e5049feaf870e7474f36ef2 P 06be0088b10e4223986f3f2e48a9cd68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3035f0f06033421b9ab057939138e4f9" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:32.672632 13510 mvcc.cc:205] Tried to move back new op lower bound from 7317490616971735040 to 7317490616825966592. Current Snapshot: MvccSnapshot[applied={T|T < 7317490616971735040}]
I20260812 01:05:32.674907 13512 mvcc.cc:205] Tried to move back new op lower bound from 7317490616971735040 to 7317490616825966592. Current Snapshot: MvccSnapshot[applied={T|T < 7317490616971735040}]
I20260812 01:05:32.675622 13511 mvcc.cc:205] Tried to move back new op lower bound from 7317490616971735040 to 7317490616825966592. Current Snapshot: MvccSnapshot[applied={T|T < 7317490616971735040}]
I20260812 01:05:32.686200 12717 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40748:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:05:32.686496 12717 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40748:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:05:32.690491 12717 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4b94a95001ad473c9c6335073c929f33: Sending DeleteTablet for 3 replicas of tablet 67dd2fa71e5049feaf870e7474f36ef2
I20260812 01:05:32.691525 12928 tablet_service.cc:1514] Processing DeleteTablet for tablet 67dd2fa71e5049feaf870e7474f36ef2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:32 UTC) from {username='slave'} at 127.0.0.1:56326
I20260812 01:05:32.691681 13149 tablet_service.cc:1514] Processing DeleteTablet for tablet 67dd2fa71e5049feaf870e7474f36ef2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:32 UTC) from {username='slave'} at 127.0.0.1:44322
I20260812 01:05:32.692677 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 12821
I20260812 01:05:32.692818 13353 tablet_service.cc:1514] Processing DeleteTablet for tablet 67dd2fa71e5049feaf870e7474f36ef2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:32 UTC) from {username='slave'} at 127.0.0.1:39644
I20260812 01:05:32.701719 13528 tablet_replica.cc:330] T 67dd2fa71e5049feaf870e7474f36ef2 P 9856bbefdac6409dbe1f0c490c21b4ea: stopping tablet replica
I20260812 01:05:32.702159 13528 raft_consensus.cc:2229] T 67dd2fa71e5049feaf870e7474f36ef2 P 9856bbefdac6409dbe1f0c490c21b4ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:05:32.702666 13528 raft_consensus.cc:2258] T 67dd2fa71e5049feaf870e7474f36ef2 P 9856bbefdac6409dbe1f0c490c21b4ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:32.706911 13527 tablet_replica.cc:330] T 67dd2fa71e5049feaf870e7474f36ef2 P 06be0088b10e4223986f3f2e48a9cd68: stopping tablet replica
I20260812 01:05:32.707016 13483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:32.694429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56344 (local address 127.4.201.65:45837)
0812 01:05:32.694605 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:32.694616 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:32.704239 (+ 9623us) server_negotiation.cc:407] Connection header received
0812 01:05:32.704693 (+ 454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:32.704700 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:32.704770 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:32.704844 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:32.706155 (+ 1311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:32.706162 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:32.706168 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:05:32.706189 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:32.706229 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:05:32.706246 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:32.706357 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:32.706625 (+ 268us) server_negotiation.cc:299] Negotiation successful
0812 01:05:32.706697 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 01:05:32.706933 13528 ts_tablet_manager.cc:1905] T 67dd2fa71e5049feaf870e7474f36ef2 P 9856bbefdac6409dbe1f0c490c21b4ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:32.707321 13527 raft_consensus.cc:2229] T 67dd2fa71e5049feaf870e7474f36ef2 P 06be0088b10e4223986f3f2e48a9cd68 [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:05:32.707991 13527 raft_consensus.cc:2258] T 67dd2fa71e5049feaf870e7474f36ef2 P 06be0088b10e4223986f3f2e48a9cd68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:32.708037 13026 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:32.710141 13529 tablet_replica.cc:330] T 67dd2fa71e5049feaf870e7474f36ef2 P 3035f0f06033421b9ab057939138e4f9: stopping tablet replica
I20260812 01:05:32.710536 13529 raft_consensus.cc:2229] T 67dd2fa71e5049feaf870e7474f36ef2 P 3035f0f06033421b9ab057939138e4f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:05:32.710996 13529 raft_consensus.cc:2258] T 67dd2fa71e5049feaf870e7474f36ef2 P 3035f0f06033421b9ab057939138e4f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:32.712940 13529 ts_tablet_manager.cc:1905] T 67dd2fa71e5049feaf870e7474f36ef2 P 3035f0f06033421b9ab057939138e4f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:32.715816 13528 ts_tablet_manager.cc:1918] T 67dd2fa71e5049feaf870e7474f36ef2 P 9856bbefdac6409dbe1f0c490c21b4ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:05:32.715991 13528 log.cc:1196] T 67dd2fa71e5049feaf870e7474f36ef2 P 9856bbefdac6409dbe1f0c490c21b4ea: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-1/wal/wals/67dd2fa71e5049feaf870e7474f36ef2
I20260812 01:05:32.716540 13528 ts_tablet_manager.cc:1939] T 67dd2fa71e5049feaf870e7474f36ef2 P 9856bbefdac6409dbe1f0c490c21b4ea: Deleting consensus metadata
I20260812 01:05:32.718529 12685 catalog_manager.cc:4841] TS 9856bbefdac6409dbe1f0c490c21b4ea (127.4.201.66:46545): tablet 67dd2fa71e5049feaf870e7474f36ef2 (table test-table [id=f02160582d8841a4bdd1628abfcd1080]) successfully deleted
I20260812 01:05:32.719282 13529 ts_tablet_manager.cc:1918] T 67dd2fa71e5049feaf870e7474f36ef2 P 3035f0f06033421b9ab057939138e4f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:05:32.719420 13529 log.cc:1196] T 67dd2fa71e5049feaf870e7474f36ef2 P 3035f0f06033421b9ab057939138e4f9: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786496689953932-4901-0/minicluster-data/ts-2/wal/wals/67dd2fa71e5049feaf870e7474f36ef2
I20260812 01:05:32.719825 13529 ts_tablet_manager.cc:1939] T 67dd2fa71e5049feaf870e7474f36ef2 P 3035f0f06033421b9ab057939138e4f9: Deleting consensus metadata
I20260812 01:05:32.721161 12685 catalog_manager.cc:4841] TS 3035f0f06033421b9ab057939138e4f9 (127.4.201.67:39519): tablet 67dd2fa71e5049feaf870e7474f36ef2 (table test-table [id=f02160582d8841a4bdd1628abfcd1080]) successfully deleted
I20260812 01:05:32.801738 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 12821
W20260812 01:05:32.825397 12693 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.201.65:45837 (error 108)
I20260812 01:05:32.825695 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 13037
I20260812 01:05:32.827414 13478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:32.826870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:45837 (local address 127.0.0.1:56346)
0812 01:05:32.827063 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:32.827214 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:45837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260812 01:05:32.827693 12693 catalog_manager.cc:4584] TS 06be0088b10e4223986f3f2e48a9cd68 (127.4.201.65:45837): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 67dd2fa71e5049feaf870e7474f36ef2: Network error: Client connection negotiation failed: client connection to 127.4.201.65:45837: connect: Connection refused (error 111)
I20260812 01:05:32.828518 13481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:32.826580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44324 (local address 127.4.201.66:46545)
0812 01:05:32.826760 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:32.826766 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:32.826786 (+ 20us) server_negotiation.cc:407] Connection header received
0812 01:05:32.826926 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:32.826931 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:32.827048 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:32.827152 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:32.828047 (+ 895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:32.828052 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:32.828056 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:05:32.828071 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:32.828104 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:05:32.828116 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:32.828217 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:32.828272 (+ 55us) server_negotiation.cc:299] Negotiation successful
0812 01:05:32.828317 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 01:05:32.829166 13243 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:32.881295 13478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:32.880743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:45837 (local address 127.0.0.1:56356)
0812 01:05:32.880993 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:32.881098 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:45837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260812 01:05:32.882427 13478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:32.882041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:45837 (local address 127.0.0.1:56360)
0812 01:05:32.882208 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:32.882288 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:45837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260812 01:05:32.915541 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 13037
I20260812 01:05:32.941843 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 13256
I20260812 01:05:32.943420 13478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:32.942924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:45837 (local address 127.0.0.1:56364)
0812 01:05:32.943147 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:32.943245 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:45837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260812 01:05:32.944536 13478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:32.944124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:45837 (local address 127.0.0.1:56378)
0812 01:05:32.944292 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:32.944362 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:45837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260812 01:05:32.944914 13486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:32.942612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39646 (local address 127.4.201.67:39519)
0812 01:05:32.942802 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:32.942808 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:32.942847 (+ 39us) server_negotiation.cc:407] Connection header received
0812 01:05:32.943123 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:32.943128 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:32.943226 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:32.943310 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:32.944280 (+ 970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:32.944284 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:32.944287 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:05:32.944305 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:32.944335 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:05:32.944347 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:32.944468 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:32.944587 (+ 119us) server_negotiation.cc:299] Negotiation successful
0812 01:05:32.944649 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 01:05:32.945534 13453 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:33.025188 13478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:33.024720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:45837 (local address 127.0.0.1:56380)
0812 01:05:33.024929 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:33.025035 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:45837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260812 01:05:33.026363 13478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:33.025888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:45837 (local address 127.0.0.1:56390)
0812 01:05:33.026130 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:33.026221 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:45837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125}
I20260812 01:05:33.031641 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 13256
I20260812 01:05:33.061782 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 12664
I20260812 01:05:33.062884 12778 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:33.167070 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 12664
2026-08-12T01:05:33Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2602 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260812 01:05:33.215822 4901 mini_oidc.cc:152] Starting JWKS server
I20260812 01:05:33.218667 4901 webserver.cc:460] Webserver started at https://127.0.0.1:35447/ using document root <none> and password file <none>
I20260812 01:05:33.219022 4901 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 01:05:33.219687 4901 webserver.cc:460] Webserver started at http://127.0.0.1:43239/ using document root <none> and password file <none>
2026-08-12T01:05:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:05:33Z Disabled control of system clock
I20260812 01:05:33.249462 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:33153
--webserver_interface=127.4.201.126
--webserver_port=0
--builtin_ntp_servers=127.4.201.84:41727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:33153
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35447/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786496689953932-4901-0/testchainca.cert with env {}
W20260812 01:05:33.569902 13550 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:33.570184 13550 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:33.570328 13550 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:33.577318 13550 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:05:33.577425 13550 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:33.577491 13550 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:33.577570 13550 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:05:33.577632 13550 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 01:05:33.577715 13550 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 01:05:33.577770 13550 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35447/jwks.json
I20260812 01:05:33.587643 13550 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:41727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:33153
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:33153
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35447/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786496689953932-4901-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:33.588814 13550 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:33.590356 13550 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:33.601593 13559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:33.601660 13558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:33.601636 13561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:33.602375 13550 server_base.cc:1034] running on GCE node
I20260812 01:05:33.603088 13550 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:33.604420 13550 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:33.605628 13550 hybrid_clock.cc:648] HybridClock initialized: now 1786496733605583 us; error 39 us; skew 500 ppm
I20260812 01:05:33.605949 13550 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:05:33.611161 13550 webserver.cc:460] Webserver started at http://127.4.201.126:39989/ using document root <none> and password file <none>
I20260812 01:05:33.611851 13550 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:33.611963 13550 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:33.612254 13550 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:33.615109 13550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "ab5659fe11bc437b9571b0a45530e406"
format_stamp: "Formatted at 2026-08-12 01:05:33 on dist-test-slave-bndk"
server_key: "440245efc947ef71b6f08fc73f2017c6"
server_key_iv: "fc9b46606906352673d1b879360f3b50"
server_key_version: "encryptionkey@0"
I20260812 01:05:33.615913 13550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "ab5659fe11bc437b9571b0a45530e406"
format_stamp: "Formatted at 2026-08-12 01:05:33 on dist-test-slave-bndk"
server_key: "440245efc947ef71b6f08fc73f2017c6"
server_key_iv: "fc9b46606906352673d1b879360f3b50"
server_key_version: "encryptionkey@0"
I20260812 01:05:33.620926 13550 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 01:05:33.624197 13567 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:33.625519 13550 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:05:33.625681 13550 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "ab5659fe11bc437b9571b0a45530e406"
format_stamp: "Formatted at 2026-08-12 01:05:33 on dist-test-slave-bndk"
server_key: "440245efc947ef71b6f08fc73f2017c6"
server_key_iv: "fc9b46606906352673d1b879360f3b50"
server_key_version: "encryptionkey@0"
I20260812 01:05:33.625867 13550 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:33.649860 13550 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:33.650678 13550 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:33.650967 13550 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:33.667761 13550 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:33153
I20260812 01:05:33.667779 13643 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:33153 every 8 connection(s)
I20260812 01:05:33.669060 13550 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:05:33.672763 13646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:33.675447 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 13550
I20260812 01:05:33.675668 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:05:33.676710 4901 external_mini_cluster.cc:1428] Setting key 6e286fc5e36dc55b9cdaa5ed150a3dec
I20260812 01:05:33.685041 13646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab5659fe11bc437b9571b0a45530e406: Bootstrap starting.
I20260812 01:05:33.689126 13646 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ab5659fe11bc437b9571b0a45530e406: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:33.690442 13646 log.cc:824] T 00000000000000000000000000000000 P ab5659fe11bc437b9571b0a45530e406: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:33.691069 13652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:33.678687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53942 (local address 127.4.201.126:33153)
0812 01:05:33.679599 (+ 912us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:33.679609 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:33.679648 (+ 39us) server_negotiation.cc:407] Connection header received
0812 01:05:33.681322 (+ 1674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:33.681347 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:33.681806 (+ 459us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:33.682118 (+ 312us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:33.682801 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:33.684060 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:33.685847 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:33.686808 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:33.687006 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:33.688381 (+ 1375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:33.688390 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:33.688403 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:05:33.689007 (+ 604us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:33.689136 (+ 129us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:05:33.689169 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:33.689356 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:33.689573 (+ 217us) server_negotiation.cc:299] Negotiation successful
0812 01:05:33.689881 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":517,"thread_start_us":331,"threads_started":1}
I20260812 01:05:33.694656 13646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab5659fe11bc437b9571b0a45530e406: No bootstrap required, opened a new log
I20260812 01:05:33.695426 4901 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:05:33.702943 13646 raft_consensus.cc:348] T 00000000000000000000000000000000 P ab5659fe11bc437b9571b0a45530e406 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab5659fe11bc437b9571b0a45530e406" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33153 } }
I20260812 01:05:33.703253 13646 raft_consensus.cc:374] T 00000000000000000000000000000000 P ab5659fe11bc437b9571b0a45530e406 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:33.703325 13646 raft_consensus.cc:729] T 00000000000000000000000000000000 P ab5659fe11bc437b9571b0a45530e406 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab5659fe11bc437b9571b0a45530e406, State: Initialized, Role: FOLLOWER
I20260812 01:05:33.703794 13646 consensus_queue.cc:260] T 00000000000000000000000000000000 P ab5659fe11bc437b9571b0a45530e406 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab5659fe11bc437b9571b0a45530e406" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33153 } }
I20260812 01:05:33.704023 13646 raft_consensus.cc:388] T 00000000000000000000000000000000 P ab5659fe11bc437b9571b0a45530e406 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:05:33.704172 13646 raft_consensus.cc:482] T 00000000000000000000000000000000 P ab5659fe11bc437b9571b0a45530e406 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:05:33.704348 13646 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ab5659fe11bc437b9571b0a45530e406 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:33.706499 13646 raft_consensus.cc:504] T 00000000000000000000000000000000 P ab5659fe11bc437b9571b0a45530e406 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab5659fe11bc437b9571b0a45530e406" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33153 } }
I20260812 01:05:33.707021 13646 leader_election.cc:302] T 00000000000000000000000000000000 P ab5659fe11bc437b9571b0a45530e406 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ab5659fe11bc437b9571b0a45530e406; no voters:
I20260812 01:05:33.707628 13646 leader_election.cc:288] T 00000000000000000000000000000000 P ab5659fe11bc437b9571b0a45530e406 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:05:33.707737 13655 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ab5659fe11bc437b9571b0a45530e406 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:05:33.708911 13655 raft_consensus.cc:686] T 00000000000000000000000000000000 P ab5659fe11bc437b9571b0a45530e406 [term 1 LEADER]: Becoming Leader. State: Replica: ab5659fe11bc437b9571b0a45530e406, State: Running, Role: LEADER
I20260812 01:05:33.709431 13655 consensus_queue.cc:237] T 00000000000000000000000000000000 P ab5659fe11bc437b9571b0a45530e406 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab5659fe11bc437b9571b0a45530e406" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33153 } }
I20260812 01:05:33.709638 13646 sys_catalog.cc:564] T 00000000000000000000000000000000 P ab5659fe11bc437b9571b0a45530e406 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:05:33.712595 13657 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab5659fe11bc437b9571b0a45530e406 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab5659fe11bc437b9571b0a45530e406. Latest consensus state: current_term: 1 leader_uuid: "ab5659fe11bc437b9571b0a45530e406" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab5659fe11bc437b9571b0a45530e406" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33153 } } }
I20260812 01:05:33.712608 13656 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab5659fe11bc437b9571b0a45530e406 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ab5659fe11bc437b9571b0a45530e406" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab5659fe11bc437b9571b0a45530e406" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33153 } } }
I20260812 01:05:33.713049 13656 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab5659fe11bc437b9571b0a45530e406 [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:33.713050 13657 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab5659fe11bc437b9571b0a45530e406 [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:33.714435 13673 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:05:33.719129 13673 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:05:33.726912 13673 catalog_manager.cc:1347] Generated new cluster ID: 8049a07488c74627802fee40e79be5b3
I20260812 01:05:33.727020 13673 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:05:33.739373 13673 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:05:33.741072 13673 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:05:33.766278 13673 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ab5659fe11bc437b9571b0a45530e406: Generated new TSK 0
I20260812 01:05:33.767300 13673 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 01:05:33.817173 13697 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260812 01:05:33.817413 13697 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 01:05:33.819186 13652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:33.788792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53952 (local address 127.4.201.126:33153)
0812 01:05:33.788995 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:33.789003 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:33.789516 (+ 513us) server_negotiation.cc:407] Connection header received
0812 01:05:33.789904 (+ 388us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:33.789907 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:33.789976 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:33.790096 (+ 120us) server_negotiation.cc:226] Negotiated authn=JWT
0812 01:05:33.790703 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:33.791434 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:33.793531 (+ 2097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:33.793986 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:33.794082 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:33.794697 (+ 615us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 01:05:33.818674 (+ 23977us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35447/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 01:05:33.818944 (+ 270us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53952: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35447/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":54}
W20260812 01:05:33.819320 13652 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53952: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35447/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260812 01:05:33.821353 13696 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:05:33.788668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33153 (local address 127.0.0.1:53952)
0812 01:05:33.789415 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:33.789435 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:33.789615 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:33.790144 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:33.790150 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:33.790164 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0812 01:05:33.790522 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:33.790535 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:33.791592 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:33.791598 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:33.793383 (+ 1785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:33.793400 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:33.794162 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:33.794169 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:33.794359 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:33.794442 (+ 83us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 01:05:33.818946 (+ 24504us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35447/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 01:05:33.819278 (+ 332us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.4.201.126:33153: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35447/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":345,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.4.201.126:33153: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35447/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260812 01:05:33.823206 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 13550
I20260812 01:05:33.824388 13637 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:33.916811 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 13550
2026-08-12T01:05:33Z chronyd exiting
I20260812 01:05:33.971958 4901 test_util.cc:175] -----------------------------------------------
I20260812 01:05:33.972097 4901 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786496689953932-4901-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (760 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260812 01:05:33.975935 4901 mini_oidc.cc:152] Starting JWKS server
I20260812 01:05:33.977764 4901 webserver.cc:460] Webserver started at https://127.0.0.1:38277/ using document root <none> and password file <none>
I20260812 01:05:33.977965 4901 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 01:05:33.978578 4901 webserver.cc:460] Webserver started at http://127.0.0.1:46741/ using document root <none> and password file <none>
2026-08-12T01:05:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:05:33Z Disabled control of system clock
I20260812 01:05:34.009680 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:39265
--webserver_interface=127.4.201.126
--webserver_port=0
--builtin_ntp_servers=127.4.201.84:34429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:39265
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38277/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786496689953932-4901-0/testchainca.cert with env {}
W20260812 01:05:34.327322 13708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:34.327638 13708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:34.327785 13708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:34.334982 13708 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:05:34.335108 13708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:34.335177 13708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:34.335258 13708 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:05:34.335323 13708 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 01:05:34.335407 13708 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 01:05:34.335461 13708 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38277/jwks.json
I20260812 01:05:34.345399 13708 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:34429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:39265
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:39265
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38277/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786496689953932-4901-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:34.346707 13708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:34.348235 13708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:34.359660 13713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:34.359669 13714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:34.359879 13717 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:34.360363 13708 server_base.cc:1034] running on GCE node
I20260812 01:05:34.361140 13708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:34.362499 13708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:34.363700 13708 hybrid_clock.cc:648] HybridClock initialized: now 1786496734363652 us; error 39 us; skew 500 ppm
I20260812 01:05:34.364017 13708 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:05:34.366215 13708 webserver.cc:460] Webserver started at http://127.4.201.126:32953/ using document root <none> and password file <none>
I20260812 01:05:34.366870 13708 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:34.366964 13708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:34.367236 13708 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:34.370102 13708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "60d96c1a0e9c470681502273cf52e0bc"
format_stamp: "Formatted at 2026-08-12 01:05:34 on dist-test-slave-bndk"
server_key: "b1bc67e09f2aca4bb10dc5b9880c2499"
server_key_iv: "aa36be16dfb8b247277562923a0cb674"
server_key_version: "encryptionkey@0"
I20260812 01:05:34.370842 13708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "60d96c1a0e9c470681502273cf52e0bc"
format_stamp: "Formatted at 2026-08-12 01:05:34 on dist-test-slave-bndk"
server_key: "b1bc67e09f2aca4bb10dc5b9880c2499"
server_key_iv: "aa36be16dfb8b247277562923a0cb674"
server_key_version: "encryptionkey@0"
I20260812 01:05:34.375818 13708 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260812 01:05:34.379168 13727 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:34.380411 13708 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 01:05:34.380558 13708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "60d96c1a0e9c470681502273cf52e0bc"
format_stamp: "Formatted at 2026-08-12 01:05:34 on dist-test-slave-bndk"
server_key: "b1bc67e09f2aca4bb10dc5b9880c2499"
server_key_iv: "aa36be16dfb8b247277562923a0cb674"
server_key_version: "encryptionkey@0"
I20260812 01:05:34.380738 13708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:34.400405 13708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:34.401151 13708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:34.401436 13708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:34.417971 13708 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:39265
I20260812 01:05:34.418004 13808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:39265 every 8 connection(s)
I20260812 01:05:34.419205 13708 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:05:34.422830 13809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:34.425958 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 13708
I20260812 01:05:34.426128 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:05:34.426760 4901 external_mini_cluster.cc:1428] Setting key 9b964dcab500e0619b27ef93a2260eb3
I20260812 01:05:34.434295 13809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60d96c1a0e9c470681502273cf52e0bc: Bootstrap starting.
I20260812 01:05:34.437201 13809 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 60d96c1a0e9c470681502273cf52e0bc: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:34.438316 13809 log.cc:824] T 00000000000000000000000000000000 P 60d96c1a0e9c470681502273cf52e0bc: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:34.439294 13813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:34.428512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57758 (local address 127.4.201.126:39265)
0812 01:05:34.429439 (+ 927us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:34.429449 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:34.429489 (+ 40us) server_negotiation.cc:407] Connection header received
0812 01:05:34.431030 (+ 1541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:34.431051 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:34.431507 (+ 456us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:34.431859 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:34.432427 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:34.433720 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:34.434987 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:34.435637 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:34.435803 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:34.436891 (+ 1088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:34.436899 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:34.436913 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:05:34.437471 (+ 558us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:34.437574 (+ 103us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:05:34.437599 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:34.437705 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:34.437925 (+ 220us) server_negotiation.cc:299] Negotiation successful
0812 01:05:34.438206 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":528,"thread_start_us":330,"threads_started":1}
I20260812 01:05:34.441413 13809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60d96c1a0e9c470681502273cf52e0bc: No bootstrap required, opened a new log
I20260812 01:05:34.442854 4901 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:05:34.448616 13809 raft_consensus.cc:348] T 00000000000000000000000000000000 P 60d96c1a0e9c470681502273cf52e0bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60d96c1a0e9c470681502273cf52e0bc" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 39265 } }
I20260812 01:05:34.448937 13809 raft_consensus.cc:374] T 00000000000000000000000000000000 P 60d96c1a0e9c470681502273cf52e0bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:34.449025 13809 raft_consensus.cc:729] T 00000000000000000000000000000000 P 60d96c1a0e9c470681502273cf52e0bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d96c1a0e9c470681502273cf52e0bc, State: Initialized, Role: FOLLOWER
I20260812 01:05:34.449594 13809 consensus_queue.cc:260] T 00000000000000000000000000000000 P 60d96c1a0e9c470681502273cf52e0bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60d96c1a0e9c470681502273cf52e0bc" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 39265 } }
I20260812 01:05:34.449868 13809 raft_consensus.cc:388] T 00000000000000000000000000000000 P 60d96c1a0e9c470681502273cf52e0bc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:05:34.450021 13809 raft_consensus.cc:482] T 00000000000000000000000000000000 P 60d96c1a0e9c470681502273cf52e0bc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:05:34.450176 13809 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 60d96c1a0e9c470681502273cf52e0bc [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:34.452162 13809 raft_consensus.cc:504] T 00000000000000000000000000000000 P 60d96c1a0e9c470681502273cf52e0bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60d96c1a0e9c470681502273cf52e0bc" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 39265 } }
I20260812 01:05:34.452623 13809 leader_election.cc:302] T 00000000000000000000000000000000 P 60d96c1a0e9c470681502273cf52e0bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 60d96c1a0e9c470681502273cf52e0bc; no voters:
I20260812 01:05:34.453123 13809 leader_election.cc:288] T 00000000000000000000000000000000 P 60d96c1a0e9c470681502273cf52e0bc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:05:34.453295 13815 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 60d96c1a0e9c470681502273cf52e0bc [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:05:34.454306 13815 raft_consensus.cc:686] T 00000000000000000000000000000000 P 60d96c1a0e9c470681502273cf52e0bc [term 1 LEADER]: Becoming Leader. State: Replica: 60d96c1a0e9c470681502273cf52e0bc, State: Running, Role: LEADER
I20260812 01:05:34.454828 13815 consensus_queue.cc:237] T 00000000000000000000000000000000 P 60d96c1a0e9c470681502273cf52e0bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60d96c1a0e9c470681502273cf52e0bc" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 39265 } }
I20260812 01:05:34.455163 13809 sys_catalog.cc:564] T 00000000000000000000000000000000 P 60d96c1a0e9c470681502273cf52e0bc [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:05:34.457587 13817 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60d96c1a0e9c470681502273cf52e0bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "60d96c1a0e9c470681502273cf52e0bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60d96c1a0e9c470681502273cf52e0bc" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 39265 } } }
I20260812 01:05:34.458025 13817 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60d96c1a0e9c470681502273cf52e0bc [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:34.458755 13818 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60d96c1a0e9c470681502273cf52e0bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 60d96c1a0e9c470681502273cf52e0bc. Latest consensus state: current_term: 1 leader_uuid: "60d96c1a0e9c470681502273cf52e0bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60d96c1a0e9c470681502273cf52e0bc" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 39265 } } }
I20260812 01:05:34.459074 13818 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60d96c1a0e9c470681502273cf52e0bc [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:34.460384 13831 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:05:34.464421 13831 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:05:34.472570 13831 catalog_manager.cc:1347] Generated new cluster ID: aab95ad2e81e496e82da1d9961d0f3d4
I20260812 01:05:34.472677 13831 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:05:34.501179 13831 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:05:34.502535 13831 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:05:34.510344 13831 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 60d96c1a0e9c470681502273cf52e0bc: Generated new TSK 0
I20260812 01:05:34.511121 13831 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 01:05:34.549997 13861 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260812 01:05:34.550112 13861 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 01:05:34.551340 13813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:34.531788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57760 (local address 127.4.201.126:39265)
0812 01:05:34.531977 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:34.531984 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:34.532388 (+ 404us) server_negotiation.cc:407] Connection header received
0812 01:05:34.532624 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:34.532630 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:34.532720 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:34.532871 (+ 151us) server_negotiation.cc:226] Negotiated authn=JWT
0812 01:05:34.533297 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:34.534404 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:34.535724 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:34.536408 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:34.536564 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:34.537009 (+ 445us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 01:05:34.550698 (+ 13689us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38277/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 01:05:34.551043 (+ 345us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57760: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38277/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":59}
W20260812 01:05:34.551407 13860 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:05:34.531661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:39265 (local address 127.0.0.1:57760)
0812 01:05:34.532292 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:34.532312 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:34.532427 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:34.532879 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:34.532882 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:34.532891 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0812 01:05:34.533136 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:34.533144 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:34.534530 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:34.534533 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:34.535580 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:34.535591 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:34.536602 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:34.536606 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:34.536732 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:34.536763 (+ 31us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 01:05:34.550912 (+ 14149us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38277/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 01:05:34.551099 (+ 187us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.4.201.126:39265: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38277/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":354,"threads_started":1}
W20260812 01:05:34.551463 13813 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57760: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38277/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
I20260812 01:05:34.552832 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 13708
I20260812 01:05:34.554024 13803 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:34.648064 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 13708
2026-08-12T01:05:34Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (730 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260812 01:05:34.706262 4901 mini_oidc.cc:152] Starting JWKS server
I20260812 01:05:34.708068 4901 webserver.cc:460] Webserver started at https://127.0.0.1:33205/ using document root <none> and password file <none>
I20260812 01:05:34.708305 4901 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 01:05:34.708881 4901 webserver.cc:460] Webserver started at http://127.0.0.1:40687/ using document root <none> and password file <none>
2026-08-12T01:05:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:05:34Z Disabled control of system clock
I20260812 01:05:34.739933 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:44261
--webserver_interface=127.4.201.126
--webserver_port=0
--builtin_ntp_servers=127.4.201.84:42617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:44261
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33205/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 01:05:35.056403 13869 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:35.056684 13869 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:35.056775 13869 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:35.063815 13869 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:05:35.063922 13869 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:35.063967 13869 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:35.064030 13869 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:05:35.064075 13869 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 01:05:35.064146 13869 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 01:05:35.064188 13869 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33205/jwks.json
I20260812 01:05:35.073153 13869 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:42617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:44261
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:44261
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33205/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:35.074440 13869 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:35.076201 13869 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:35.087637 13882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:35.087818 13877 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:35.087857 13880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:35.088445 13869 server_base.cc:1034] running on GCE node
I20260812 01:05:35.089143 13869 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:35.090462 13869 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:35.091660 13869 hybrid_clock.cc:648] HybridClock initialized: now 1786496735091620 us; error 32 us; skew 500 ppm
I20260812 01:05:35.091991 13869 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:05:35.094158 13869 webserver.cc:460] Webserver started at http://127.4.201.126:42337/ using document root <none> and password file <none>
I20260812 01:05:35.094801 13869 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:35.094907 13869 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:35.095221 13869 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:35.098035 13869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "4e04c98f3ecc491daf9fd10bfa7345f9"
format_stamp: "Formatted at 2026-08-12 01:05:35 on dist-test-slave-bndk"
server_key: "ab1dc1c36912ea5ad1b35f9b0730ee87"
server_key_iv: "403ee5a059a422cff85e171e95a67504"
server_key_version: "encryptionkey@0"
I20260812 01:05:35.098784 13869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "4e04c98f3ecc491daf9fd10bfa7345f9"
format_stamp: "Formatted at 2026-08-12 01:05:35 on dist-test-slave-bndk"
server_key: "ab1dc1c36912ea5ad1b35f9b0730ee87"
server_key_iv: "403ee5a059a422cff85e171e95a67504"
server_key_version: "encryptionkey@0"
I20260812 01:05:35.103600 13869 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 01:05:35.106879 13889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:35.108105 13869 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 01:05:35.108263 13869 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "4e04c98f3ecc491daf9fd10bfa7345f9"
format_stamp: "Formatted at 2026-08-12 01:05:35 on dist-test-slave-bndk"
server_key: "ab1dc1c36912ea5ad1b35f9b0730ee87"
server_key_iv: "403ee5a059a422cff85e171e95a67504"
server_key_version: "encryptionkey@0"
I20260812 01:05:35.108481 13869 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:35.122354 13869 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:35.123104 13869 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:35.123399 13869 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:35.140007 13869 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:44261
I20260812 01:05:35.140036 13972 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:44261 every 8 connection(s)
I20260812 01:05:35.141320 13869 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:05:35.144855 13973 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:35.145987 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 13869
I20260812 01:05:35.146214 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:05:35.147030 4901 external_mini_cluster.cc:1428] Setting key 8137ebe94338c070fb9975b12d1ac4ad
I20260812 01:05:35.157516 13973 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e04c98f3ecc491daf9fd10bfa7345f9: Bootstrap starting.
I20260812 01:05:35.159451 13979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:35.148994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59208 (local address 127.4.201.126:44261)
0812 01:05:35.149966 (+ 972us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:35.149976 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:35.150022 (+ 46us) server_negotiation.cc:407] Connection header received
0812 01:05:35.151560 (+ 1538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:35.151581 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:35.152010 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:35.152352 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:35.152864 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:35.154128 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:35.155385 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:35.156038 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:35.156202 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:35.157346 (+ 1144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:35.157355 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:35.157367 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:05:35.157895 (+ 528us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:35.157968 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:05:35.157989 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:35.158088 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:35.158304 (+ 216us) server_negotiation.cc:299] Negotiation successful
0812 01:05:35.158584 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":575,"thread_start_us":360,"threads_started":1}
I20260812 01:05:35.160566 13973 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4e04c98f3ecc491daf9fd10bfa7345f9: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:35.161643 13973 log.cc:824] T 00000000000000000000000000000000 P 4e04c98f3ecc491daf9fd10bfa7345f9: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:35.162993 4901 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:05:35.164227 13973 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e04c98f3ecc491daf9fd10bfa7345f9: No bootstrap required, opened a new log
I20260812 01:05:35.171562 13973 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4e04c98f3ecc491daf9fd10bfa7345f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e04c98f3ecc491daf9fd10bfa7345f9" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44261 } }
I20260812 01:05:35.171871 13973 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4e04c98f3ecc491daf9fd10bfa7345f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:35.171967 13973 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4e04c98f3ecc491daf9fd10bfa7345f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e04c98f3ecc491daf9fd10bfa7345f9, State: Initialized, Role: FOLLOWER
I20260812 01:05:35.172494 13973 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e04c98f3ecc491daf9fd10bfa7345f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e04c98f3ecc491daf9fd10bfa7345f9" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44261 } }
I20260812 01:05:35.172711 13973 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4e04c98f3ecc491daf9fd10bfa7345f9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:05:35.172837 13973 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4e04c98f3ecc491daf9fd10bfa7345f9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:05:35.172996 13973 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4e04c98f3ecc491daf9fd10bfa7345f9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:35.175294 13973 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4e04c98f3ecc491daf9fd10bfa7345f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e04c98f3ecc491daf9fd10bfa7345f9" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44261 } }
I20260812 01:05:35.175755 13973 leader_election.cc:302] T 00000000000000000000000000000000 P 4e04c98f3ecc491daf9fd10bfa7345f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e04c98f3ecc491daf9fd10bfa7345f9; no voters:
I20260812 01:05:35.176290 13973 leader_election.cc:288] T 00000000000000000000000000000000 P 4e04c98f3ecc491daf9fd10bfa7345f9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:05:35.176409 13981 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4e04c98f3ecc491daf9fd10bfa7345f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:05:35.177035 13981 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4e04c98f3ecc491daf9fd10bfa7345f9 [term 1 LEADER]: Becoming Leader. State: Replica: 4e04c98f3ecc491daf9fd10bfa7345f9, State: Running, Role: LEADER
I20260812 01:05:35.177572 13981 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4e04c98f3ecc491daf9fd10bfa7345f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e04c98f3ecc491daf9fd10bfa7345f9" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44261 } }
I20260812 01:05:35.178221 13973 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4e04c98f3ecc491daf9fd10bfa7345f9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:05:35.180106 13983 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e04c98f3ecc491daf9fd10bfa7345f9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4e04c98f3ecc491daf9fd10bfa7345f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e04c98f3ecc491daf9fd10bfa7345f9" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44261 } } }
I20260812 01:05:35.180469 13983 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e04c98f3ecc491daf9fd10bfa7345f9 [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:35.180660 13984 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e04c98f3ecc491daf9fd10bfa7345f9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4e04c98f3ecc491daf9fd10bfa7345f9. Latest consensus state: current_term: 1 leader_uuid: "4e04c98f3ecc491daf9fd10bfa7345f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e04c98f3ecc491daf9fd10bfa7345f9" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44261 } } }
I20260812 01:05:35.180992 13984 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e04c98f3ecc491daf9fd10bfa7345f9 [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:35.182363 13991 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:05:35.187281 13991 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:05:35.195948 13991 catalog_manager.cc:1347] Generated new cluster ID: 12352451fd834267864d533a47ad630c
I20260812 01:05:35.196051 13991 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:05:35.210278 13991 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:05:35.211485 13991 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:05:35.218888 13991 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4e04c98f3ecc491daf9fd10bfa7345f9: Generated new TSK 0
I20260812 01:05:35.219585 13991 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:05:35.242204 13979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:35.234415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59214 (local address 127.4.201.126:44261)
0812 01:05:35.234604 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:35.234611 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:35.235119 (+ 508us) server_negotiation.cc:407] Connection header received
0812 01:05:35.235332 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:35.235336 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:35.235406 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:35.235538 (+ 132us) server_negotiation.cc:226] Negotiated authn=JWT
0812 01:05:35.236067 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:35.236776 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:35.238761 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:35.239201 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:35.239293 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:35.239847 (+ 554us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 01:05:35.241614 (+ 1767us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33205/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 01:05:35.241908 (+ 294us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59214: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33205/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":64}
W20260812 01:05:35.242422 14020 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:05:35.234410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:44261 (local address 127.0.0.1:59214)
0812 01:05:35.235021 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:35.235040 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:35.235183 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:35.235576 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:35.235582 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:35.235595 (+ 13us) client_negotiation.cc:189] Negotiated authn=JWT
0812 01:05:35.235917 (+ 322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:35.235930 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:35.236913 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:35.236918 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:35.238629 (+ 1711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:35.238644 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:35.239387 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:35.239394 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:35.239573 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:35.239617 (+ 44us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 01:05:35.241796 (+ 2179us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33205/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 01:05:35.242035 (+ 239us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.4.201.126:44261: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33205/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":316,"threads_started":1}
W20260812 01:05:35.242412 13979 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59214: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33205/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
I20260812 01:05:35.244148 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 13869
I20260812 01:05:35.245038 13968 generic_service.cc:196] Checking for leaks (request via RPC)
E20260812 01:05:35.254328 14021 webserver.cc:533] Webserver: sslize failed:
E20260812 01:05:35.254415 14021 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 01:05:35.334244 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 13869
2026-08-12T01:05:35Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (686 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-12T01:05:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:05:35Z Disabled control of system clock
I20260812 01:05:35.423024 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:33293
--webserver_interface=127.4.201.126
--webserver_port=0
--builtin_ntp_servers=127.4.201.84:45407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:33293
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786496689953932-4901-0/testchainca.cert with env {}
W20260812 01:05:35.742146 14028 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:35.742416 14028 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:35.742511 14028 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:35.749454 14028 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:05:35.749552 14028 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:35.749600 14028 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:35.749655 14028 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:05:35.749698 14028 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 01:05:35.749759 14028 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 01:05:35.749800 14028 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260812 01:05:35.759171 14028 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:45407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:33293
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:33293
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786496689953932-4901-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:35.760320 14028 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:35.761566 14028 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:35.773211 14034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:35.773273 14036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:35.773312 14040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:35.773972 14028 server_base.cc:1034] running on GCE node
I20260812 01:05:35.774657 14028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:35.775916 14028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:35.777122 14028 hybrid_clock.cc:648] HybridClock initialized: now 1786496735777080 us; error 27 us; skew 500 ppm
I20260812 01:05:35.777513 14028 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:05:35.779723 14028 webserver.cc:460] Webserver started at http://127.4.201.126:37719/ using document root <none> and password file <none>
I20260812 01:05:35.780406 14028 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:35.780504 14028 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:35.780823 14028 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:35.783707 14028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "f1cc32fe67284f6783cc531387c72ede"
format_stamp: "Formatted at 2026-08-12 01:05:35 on dist-test-slave-bndk"
server_key: "02b43ec73eff3addec3b7d4440389dcc"
server_key_iv: "2446154029ecef0755ff88258fbcdb1c"
server_key_version: "encryptionkey@0"
I20260812 01:05:35.784508 14028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "f1cc32fe67284f6783cc531387c72ede"
format_stamp: "Formatted at 2026-08-12 01:05:35 on dist-test-slave-bndk"
server_key: "02b43ec73eff3addec3b7d4440389dcc"
server_key_iv: "2446154029ecef0755ff88258fbcdb1c"
server_key_version: "encryptionkey@0"
I20260812 01:05:35.789563 14028 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260812 01:05:35.792865 14047 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:35.794119 14028 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:05:35.794286 14028 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "f1cc32fe67284f6783cc531387c72ede"
format_stamp: "Formatted at 2026-08-12 01:05:35 on dist-test-slave-bndk"
server_key: "02b43ec73eff3addec3b7d4440389dcc"
server_key_iv: "2446154029ecef0755ff88258fbcdb1c"
server_key_version: "encryptionkey@0"
I20260812 01:05:35.794488 14028 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:35.809441 14028 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:35.810214 14028 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:35.810460 14028 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:35.827442 14028 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:33293
I20260812 01:05:35.827467 14125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:33293 every 8 connection(s)
I20260812 01:05:35.828684 14028 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:05:35.829356 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 14028
I20260812 01:05:35.829557 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:05:35.830273 4901 external_mini_cluster.cc:1428] Setting key 289e14ed14d510f7c611576e6a12b7e6
I20260812 01:05:35.832942 14126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:35.845201 14133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:35.832139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45940 (local address 127.4.201.126:33293)
0812 01:05:35.833192 (+ 1053us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:35.833208 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:35.833282 (+ 74us) server_negotiation.cc:407] Connection header received
0812 01:05:35.835451 (+ 2169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:35.835488 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:35.836050 (+ 562us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:35.836484 (+ 434us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:35.837005 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:35.839021 (+ 2016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:35.840299 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:35.841300 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:35.841486 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:35.842540 (+ 1054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:35.842551 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:35.842572 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:05:35.843275 (+ 703us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:35.843365 (+ 90us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:05:35.843395 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:35.843508 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:35.843666 (+ 158us) server_negotiation.cc:299] Negotiation successful
0812 01:05:35.843993 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":329,"threads_started":1}
I20260812 01:05:35.846462 14126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1cc32fe67284f6783cc531387c72ede: Bootstrap starting.
I20260812 01:05:35.848774 4901 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:05:35.849732 14126 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f1cc32fe67284f6783cc531387c72ede: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:35.850881 14126 log.cc:824] T 00000000000000000000000000000000 P f1cc32fe67284f6783cc531387c72ede: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:35.853770 14126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1cc32fe67284f6783cc531387c72ede: No bootstrap required, opened a new log
I20260812 01:05:35.861294 14126 raft_consensus.cc:348] T 00000000000000000000000000000000 P f1cc32fe67284f6783cc531387c72ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1cc32fe67284f6783cc531387c72ede" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33293 } }
I20260812 01:05:35.861614 14126 raft_consensus.cc:374] T 00000000000000000000000000000000 P f1cc32fe67284f6783cc531387c72ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:35.861687 14126 raft_consensus.cc:729] T 00000000000000000000000000000000 P f1cc32fe67284f6783cc531387c72ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1cc32fe67284f6783cc531387c72ede, State: Initialized, Role: FOLLOWER
I20260812 01:05:35.862216 14126 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1cc32fe67284f6783cc531387c72ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1cc32fe67284f6783cc531387c72ede" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33293 } }
I20260812 01:05:35.862427 14126 raft_consensus.cc:388] T 00000000000000000000000000000000 P f1cc32fe67284f6783cc531387c72ede [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:05:35.862524 14126 raft_consensus.cc:482] T 00000000000000000000000000000000 P f1cc32fe67284f6783cc531387c72ede [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:05:35.862654 14126 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f1cc32fe67284f6783cc531387c72ede [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:35.864943 14126 raft_consensus.cc:504] T 00000000000000000000000000000000 P f1cc32fe67284f6783cc531387c72ede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1cc32fe67284f6783cc531387c72ede" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33293 } }
I20260812 01:05:35.865435 14126 leader_election.cc:302] T 00000000000000000000000000000000 P f1cc32fe67284f6783cc531387c72ede [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f1cc32fe67284f6783cc531387c72ede; no voters:
I20260812 01:05:35.865947 14126 leader_election.cc:288] T 00000000000000000000000000000000 P f1cc32fe67284f6783cc531387c72ede [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:05:35.866098 14135 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f1cc32fe67284f6783cc531387c72ede [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:05:35.866765 14135 raft_consensus.cc:686] T 00000000000000000000000000000000 P f1cc32fe67284f6783cc531387c72ede [term 1 LEADER]: Becoming Leader. State: Replica: f1cc32fe67284f6783cc531387c72ede, State: Running, Role: LEADER
I20260812 01:05:35.867259 14135 consensus_queue.cc:237] T 00000000000000000000000000000000 P f1cc32fe67284f6783cc531387c72ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1cc32fe67284f6783cc531387c72ede" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33293 } }
I20260812 01:05:35.867815 14126 sys_catalog.cc:564] T 00000000000000000000000000000000 P f1cc32fe67284f6783cc531387c72ede [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:05:35.869979 14142 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1cc32fe67284f6783cc531387c72ede [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1cc32fe67284f6783cc531387c72ede. Latest consensus state: current_term: 1 leader_uuid: "f1cc32fe67284f6783cc531387c72ede" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1cc32fe67284f6783cc531387c72ede" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33293 } } }
I20260812 01:05:35.870036 14138 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1cc32fe67284f6783cc531387c72ede [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f1cc32fe67284f6783cc531387c72ede" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1cc32fe67284f6783cc531387c72ede" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33293 } } }
I20260812 01:05:35.870653 14142 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1cc32fe67284f6783cc531387c72ede [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:35.870677 14138 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1cc32fe67284f6783cc531387c72ede [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:35.873054 14150 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:05:35.877362 14150 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:05:35.885326 14150 catalog_manager.cc:1347] Generated new cluster ID: 289f96cb59f842e6887d46f60bbe1315
I20260812 01:05:35.885432 14150 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:05:35.922649 14150 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:05:35.924521 14150 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:05:35.931819 14150 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f1cc32fe67284f6783cc531387c72ede: Generated new TSK 0
I20260812 01:05:35.932847 14150 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:05:36.375506 14133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:35.957423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45946 (local address 127.4.201.126:33293)
0812 01:05:35.957621 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:35.957629 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:35.958119 (+ 490us) server_negotiation.cc:407] Connection header received
0812 01:05:35.958339 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:35.958342 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:35.958410 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:35.958532 (+ 122us) server_negotiation.cc:226] Negotiated authn=JWT
0812 01:05:35.959108 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:35.959803 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:35.961848 (+ 2045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:35.962297 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:35.962384 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:35.963023 (+ 639us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 01:05:36.374943 (+411920us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 01:05:36.375282 (+ 339us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45946: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":57}
W20260812 01:05:36.375614 14133 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45946: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260812 01:05:36.375872 14177 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:05:35.957367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33293 (local address 127.0.0.1:45946)
0812 01:05:35.958010 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:35.958031 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:35.958187 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:35.958579 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:35.958585 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:35.958598 (+ 13us) client_negotiation.cc:189] Negotiated authn=JWT
0812 01:05:35.958951 (+ 353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:35.958963 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:35.959950 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:35.959956 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:35.961715 (+ 1759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:35.961731 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:35.962467 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:35.962474 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:35.962670 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:35.962716 (+ 46us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 01:05:36.375236 (+412520us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 01:05:36.375515 (+ 279us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.4.201.126:33293: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":313,"threads_started":1}
I20260812 01:05:36.377074 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 14028
I20260812 01:05:36.378235 14120 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:36.478994 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 14028
2026-08-12T01:05:36Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1129 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (411 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (408 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:05:37 dist-test-slave-bndk krb5kdc[14196](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:05:37 dist-test-slave-bndk krb5kdc[14196](info): set up 2 sockets
Aug 12 01:05:37 dist-test-slave-bndk krb5kdc[14196](info): commencing operation
krb5kdc: starting...
W20260812 01:05:38.511268 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.000s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:05:38 dist-test-slave-bndk krb5kdc[14196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496738, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:05:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:05:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.201.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
I20260812 01:05:38.734156 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:33869
--webserver_interface=127.4.201.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:33147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:33869
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:39.053004 14216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:39.053318 14216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:39.053426 14216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:39.060436 14216 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:05:39.060534 14216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:39.060592 14216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:39.060649 14216 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:05:39.060693 14216 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:05:39.070199 14216 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:33147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:33869
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:33869
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:39.071437 14216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:39.072681 14216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:39.083757 14226 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:39.083832 14230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:39.083801 14225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:39.084587 14216 server_base.cc:1034] running on GCE node
I20260812 01:05:39.085371 14216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:39.086639 14216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:39.087839 14216 hybrid_clock.cc:648] HybridClock initialized: now 1786496739087785 us; error 39 us; skew 500 ppm
I20260812 01:05:39.088158 14216 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:39 dist-test-slave-bndk krb5kdc[14196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496739, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:39.094738 14216 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:05:39.096138 14216 webserver.cc:460] Webserver started at http://127.4.201.126:41387/ using document root <none> and password file <none>
I20260812 01:05:39.096786 14216 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:39.096905 14216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:39.097201 14216 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:39.100097 14216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "62deeb59964c46c385987469be5892cd"
format_stamp: "Formatted at 2026-08-12 01:05:39 on dist-test-slave-bndk"
server_key: "d98efe08f8f7b4b99f0868df9c42dfd8"
server_key_iv: "291a577d07bc507f7e55838024fcde95"
server_key_version: "encryptionkey@0"
I20260812 01:05:39.100853 14216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "62deeb59964c46c385987469be5892cd"
format_stamp: "Formatted at 2026-08-12 01:05:39 on dist-test-slave-bndk"
server_key: "d98efe08f8f7b4b99f0868df9c42dfd8"
server_key_iv: "291a577d07bc507f7e55838024fcde95"
server_key_version: "encryptionkey@0"
I20260812 01:05:39.105693 14216 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.002s
I20260812 01:05:39.108891 14240 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:39.110143 14216 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:05:39.110306 14216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "62deeb59964c46c385987469be5892cd"
format_stamp: "Formatted at 2026-08-12 01:05:39 on dist-test-slave-bndk"
server_key: "d98efe08f8f7b4b99f0868df9c42dfd8"
server_key_iv: "291a577d07bc507f7e55838024fcde95"
server_key_version: "encryptionkey@0"
I20260812 01:05:39.110496 14216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:39.121773 14216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:39.125514 14216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:39.125761 14216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:39.142970 14216 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:33869
I20260812 01:05:39.143013 14323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:33869 every 8 connection(s)
I20260812 01:05:39.144272 14216 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:05:39.147867 14324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:39.153477 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 14216
I20260812 01:05:39.153661 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:05:39.154279 4901 external_mini_cluster.cc:1428] Setting key f3a4d422d2dd9e93b52242f5b668f5f2
I20260812 01:05:39.158196 14324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62deeb59964c46c385987469be5892cd: Bootstrap starting.
I20260812 01:05:39.161748 14324 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 62deeb59964c46c385987469be5892cd: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:39.162732 14324 log.cc:824] T 00000000000000000000000000000000 P 62deeb59964c46c385987469be5892cd: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:39.165612 14324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62deeb59964c46c385987469be5892cd: No bootstrap required, opened a new log
Aug 12 01:05:39 dist-test-slave-bndk krb5kdc[14196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496738, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:39.173535 14324 raft_consensus.cc:348] T 00000000000000000000000000000000 P 62deeb59964c46c385987469be5892cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62deeb59964c46c385987469be5892cd" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33869 } }
I20260812 01:05:39.173872 14324 raft_consensus.cc:374] T 00000000000000000000000000000000 P 62deeb59964c46c385987469be5892cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:39.173983 14324 raft_consensus.cc:729] T 00000000000000000000000000000000 P 62deeb59964c46c385987469be5892cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62deeb59964c46c385987469be5892cd, State: Initialized, Role: FOLLOWER
I20260812 01:05:39.174530 14324 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62deeb59964c46c385987469be5892cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62deeb59964c46c385987469be5892cd" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33869 } }
I20260812 01:05:39.174772 14324 raft_consensus.cc:388] T 00000000000000000000000000000000 P 62deeb59964c46c385987469be5892cd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:05:39.174904 14324 raft_consensus.cc:482] T 00000000000000000000000000000000 P 62deeb59964c46c385987469be5892cd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:05:39.175099 14324 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 62deeb59964c46c385987469be5892cd [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:39.177030 14327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:39.156261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43904 (local address 127.4.201.126:33869)
0812 01:05:39.157038 (+ 777us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:39.157049 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:39.157091 (+ 42us) server_negotiation.cc:407] Connection header received
0812 01:05:39.158795 (+ 1704us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:39.158818 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:39.159157 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:39.159479 (+ 322us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:39.161336 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:39.162639 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:39.164056 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:39.164691 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:39.164820 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:39.169364 (+ 4544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:39.169374 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:39.169389 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:39.169427 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:39.172647 (+ 3220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:39.173332 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:39.173339 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:39.173346 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:39.173509 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:39.173869 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:39.173873 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:39.173875 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:39.174475 (+ 600us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:39.174777 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:39.175233 (+ 456us) server_negotiation.cc:299] Negotiation successful
0812 01:05:39.175655 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":332,"threads_started":1}
I20260812 01:05:39.178306 14324 raft_consensus.cc:504] T 00000000000000000000000000000000 P 62deeb59964c46c385987469be5892cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62deeb59964c46c385987469be5892cd" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33869 } }
I20260812 01:05:39.178830 14324 leader_election.cc:302] T 00000000000000000000000000000000 P 62deeb59964c46c385987469be5892cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62deeb59964c46c385987469be5892cd; no voters:
I20260812 01:05:39.179417 14324 leader_election.cc:288] T 00000000000000000000000000000000 P 62deeb59964c46c385987469be5892cd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:05:39.179551 14330 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 62deeb59964c46c385987469be5892cd [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:05:39.180725 14330 raft_consensus.cc:686] T 00000000000000000000000000000000 P 62deeb59964c46c385987469be5892cd [term 1 LEADER]: Becoming Leader. State: Replica: 62deeb59964c46c385987469be5892cd, State: Running, Role: LEADER
I20260812 01:05:39.181187 14330 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62deeb59964c46c385987469be5892cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62deeb59964c46c385987469be5892cd" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33869 } }
I20260812 01:05:39.181593 14324 sys_catalog.cc:564] T 00000000000000000000000000000000 P 62deeb59964c46c385987469be5892cd [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:05:39.183615 14333 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62deeb59964c46c385987469be5892cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62deeb59964c46c385987469be5892cd. Latest consensus state: current_term: 1 leader_uuid: "62deeb59964c46c385987469be5892cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62deeb59964c46c385987469be5892cd" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33869 } } }
I20260812 01:05:39.184010 14333 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62deeb59964c46c385987469be5892cd [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:39.183902 14332 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62deeb59964c46c385987469be5892cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "62deeb59964c46c385987469be5892cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62deeb59964c46c385987469be5892cd" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33869 } } }
I20260812 01:05:39.184216 14332 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62deeb59964c46c385987469be5892cd [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:39.186409 14338 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:05:39.191109 14338 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:05:39.199077 14338 catalog_manager.cc:1347] Generated new cluster ID: 7cde6d2f0bad43a4b3c9e21d03a8feb1
I20260812 01:05:39.199170 14338 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:05:39.224094 14338 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:05:39.225374 14338 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:05:39.230652 14338 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 62deeb59964c46c385987469be5892cd: Generated new TSK 0
I20260812 01:05:39.231608 14338 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.201.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
I20260812 01:05:39.289877 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:0
--local_ip_for_outbound_sockets=127.4.201.65
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:33869
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:33147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:39.616923 14365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:39.617200 14365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:39.617373 14365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:39.624442 14365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:39.624558 14365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:39.624714 14365 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:05:39.634233 14365 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:33147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:33869
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:39.635445 14365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:39.636752 14365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:39.649112 14374 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:39.649391 14381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:39.649466 14376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:39.650432 14365 server_base.cc:1034] running on GCE node
I20260812 01:05:39.651021 14365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:39.651947 14365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:39.653151 14365 hybrid_clock.cc:648] HybridClock initialized: now 1786496739653103 us; error 42 us; skew 500 ppm
I20260812 01:05:39.653456 14365 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:39 dist-test-slave-bndk krb5kdc[14196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496739, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:39.656407 14365 init.cc:377] Logged in from keytab as kudu/127.4.201.65@KRBTEST.COM (short username kudu)
I20260812 01:05:39.659821 14365 webserver.cc:460] Webserver started at http://127.4.201.65:37161/ using document root <none> and password file <none>
I20260812 01:05:39.660473 14365 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:39.660598 14365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:39.660913 14365 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:39.663784 14365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-0/data/instance:
uuid: "066c4fb08942423bbc2e4754a932fff9"
format_stamp: "Formatted at 2026-08-12 01:05:39 on dist-test-slave-bndk"
server_key: "8e4c29d50ea11f6552d82f77a983a966"
server_key_iv: "9a4665dc79d9d80c6f20d71976b9625c"
server_key_version: "encryptionkey@0"
I20260812 01:05:39.664561 14365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance:
uuid: "066c4fb08942423bbc2e4754a932fff9"
format_stamp: "Formatted at 2026-08-12 01:05:39 on dist-test-slave-bndk"
server_key: "8e4c29d50ea11f6552d82f77a983a966"
server_key_iv: "9a4665dc79d9d80c6f20d71976b9625c"
server_key_version: "encryptionkey@0"
I20260812 01:05:39.669584 14365 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260812 01:05:39.672971 14393 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:39.674247 14365 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:05:39.674396 14365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "066c4fb08942423bbc2e4754a932fff9"
format_stamp: "Formatted at 2026-08-12 01:05:39 on dist-test-slave-bndk"
server_key: "8e4c29d50ea11f6552d82f77a983a966"
server_key_iv: "9a4665dc79d9d80c6f20d71976b9625c"
server_key_version: "encryptionkey@0"
I20260812 01:05:39.674577 14365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:39.695824 14365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:39.699927 14365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:39.700176 14365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:39.701069 14365 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:05:39.702404 14365 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:39.702474 14365 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:39.702567 14365 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:39.702610 14365 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:39.734032 14365 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:46153
I20260812 01:05:39.734068 14568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:46153 every 8 connection(s)
I20260812 01:05:39.735277 14365 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:05:39.741334 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 14365
I20260812 01:05:39.741516 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance
I20260812 01:05:39.742141 4901 external_mini_cluster.cc:1428] Setting key a46603ff248b354f78f2055d83a9834c
Aug 12 01:05:39 dist-test-slave-bndk krb5kdc[14196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496739, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:39.754957 14572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:39.737680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:35003 (local address 127.4.201.126:33869)
0812 01:05:39.738080 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:39.738085 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:39.738950 (+ 865us) server_negotiation.cc:407] Connection header received
0812 01:05:39.740742 (+ 1792us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:39.740748 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:39.740827 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:39.740949 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:39.742531 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:39.743408 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:39.745151 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:39.745762 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:39.745894 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:39.749256 (+ 3362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:39.749263 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:39.749268 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:39.749307 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:39.752122 (+ 2815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:39.752782 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:39.752787 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:39.752790 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:39.752925 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:39.753319 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:39.753325 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:39.753327 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:39.753592 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:39.753731 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:39.754382 (+ 651us) server_negotiation.cc:299] Negotiation successful
0812 01:05:39.754607 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":207,"threads_started":1}
I20260812 01:05:39.755869 14573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:39.738112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33869 (local address 127.4.201.65:35003)
0812 01:05:39.738803 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:39.738840 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:39.740474 (+ 1634us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:39.741161 (+ 687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:39.741169 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:39.741761 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:39.742351 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:39.742372 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:39.743599 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:39.743604 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:39.745006 (+ 1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:39.745020 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:39.745954 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:39.745959 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:39.746162 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:39.746778 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:39.746806 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:39.749017 (+ 2211us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:39.752248 (+ 3231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:39.752254 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:39.752265 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:39.752674 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:39.753014 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:39.753017 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:39.753019 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:39.753191 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:39.753720 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:39.753728 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:39.754029 (+ 301us) client_negotiation.cc:769] Sending connection context
0812 01:05:39.754269 (+ 240us) client_negotiation.cc:240] Negotiation successful
0812 01:05:39.754773 (+ 504us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":270,"threads_started":1}
I20260812 01:05:39.757280 14569 heartbeater.cc:347] Connected to a master server at 127.4.201.126:33869
I20260812 01:05:39.757558 14569 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:39.758265 14569 heartbeater.cc:511] Master 127.4.201.126:33869 requested a full tablet report, sending...
I20260812 01:05:39.760264 14264 ts_manager.cc:194] Registered new tserver with Master: 066c4fb08942423bbc2e4754a932fff9 (127.4.201.65:46153)
I20260812 01:05:39.761732 14264 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.65@KRBTEST.COM'} at 127.4.201.65:35003
WARNING: no policy specified for kudu/127.4.201.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
I20260812 01:05:39.792085 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:0
--local_ip_for_outbound_sockets=127.4.201.66
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:33869
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:33147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:40.111626 14578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:40.111892 14578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:40.111991 14578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:40.119277 14578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:40.119401 14578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:40.119549 14578 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:05:40.129033 14578 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:33147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:33869
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:40.130330 14578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:40.131678 14578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:40.144177 14583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:40.144201 14584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:40.144810 14586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:40.145349 14578 server_base.cc:1034] running on GCE node
I20260812 01:05:40.145908 14578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:40.146790 14578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:40.148006 14578 hybrid_clock.cc:648] HybridClock initialized: now 1786496740147958 us; error 33 us; skew 500 ppm
I20260812 01:05:40.148317 14578 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:40 dist-test-slave-bndk krb5kdc[14196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496740, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:40.151528 14578 init.cc:377] Logged in from keytab as kudu/127.4.201.66@KRBTEST.COM (short username kudu)
I20260812 01:05:40.154312 14578 webserver.cc:460] Webserver started at http://127.4.201.66:37691/ using document root <none> and password file <none>
I20260812 01:05:40.154966 14578 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:40.155073 14578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:40.155359 14578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:40.158169 14578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-1/data/instance:
uuid: "07fafd837e32420fb503c1d0e54bbdb0"
format_stamp: "Formatted at 2026-08-12 01:05:40 on dist-test-slave-bndk"
server_key: "afecc6b979bfc8695a239d7034dd7931"
server_key_iv: "5b89f5d94f3065e3f7adb95a72bcb173"
server_key_version: "encryptionkey@0"
I20260812 01:05:40.158895 14578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance:
uuid: "07fafd837e32420fb503c1d0e54bbdb0"
format_stamp: "Formatted at 2026-08-12 01:05:40 on dist-test-slave-bndk"
server_key: "afecc6b979bfc8695a239d7034dd7931"
server_key_iv: "5b89f5d94f3065e3f7adb95a72bcb173"
server_key_version: "encryptionkey@0"
I20260812 01:05:40.163687 14578 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 01:05:40.166862 14598 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:40.168078 14578 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 01:05:40.168226 14578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "07fafd837e32420fb503c1d0e54bbdb0"
format_stamp: "Formatted at 2026-08-12 01:05:40 on dist-test-slave-bndk"
server_key: "afecc6b979bfc8695a239d7034dd7931"
server_key_iv: "5b89f5d94f3065e3f7adb95a72bcb173"
server_key_version: "encryptionkey@0"
I20260812 01:05:40.168398 14578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:40.199506 14578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:40.203372 14578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:40.203647 14578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:40.204594 14578 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:05:40.205883 14578 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:40.205962 14578 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:40.206071 14578 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:40.206141 14578 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:40.235129 14578 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:38985
I20260812 01:05:40.235173 14806 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:38985 every 8 connection(s)
I20260812 01:05:40.236346 14578 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:05:40.241303 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 14578
I20260812 01:05:40.241463 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance
I20260812 01:05:40.241873 4901 external_mini_cluster.cc:1428] Setting key 85c6ec935395e2437009b75a1ef7531b
Aug 12 01:05:40 dist-test-slave-bndk krb5kdc[14196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496740, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:40.255481 14572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:40.238784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:48601 (local address 127.4.201.126:33869)
0812 01:05:40.238996 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:40.239003 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:40.240135 (+ 1132us) server_negotiation.cc:407] Connection header received
0812 01:05:40.242006 (+ 1871us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:40.242011 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:40.242095 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:40.242186 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:40.243822 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:40.244517 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:40.246219 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:40.246647 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:40.246759 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:40.250059 (+ 3300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:40.250064 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:40.250068 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:40.250100 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:40.252474 (+ 2374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:40.253162 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:40.253166 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:40.253169 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:40.253332 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:40.253758 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:40.253764 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:40.253768 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:40.254076 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:40.254216 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:40.254908 (+ 692us) server_negotiation.cc:299] Negotiation successful
0812 01:05:40.255156 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 01:05:40.256443 14809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:40.239292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33869 (local address 127.4.201.66:48601)
0812 01:05:40.239982 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:40.240019 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:40.241728 (+ 1709us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:40.242430 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:40.242438 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:40.243041 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:40.243666 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:40.243688 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:40.244668 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:40.244673 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:40.246079 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:40.246093 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:40.246862 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:40.246870 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:40.247096 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:40.247708 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:40.247730 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:40.249838 (+ 2108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:40.252606 (+ 2768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:40.252616 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:40.252632 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:40.253038 (+ 406us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:40.253437 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:40.253442 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:40.253446 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:40.253641 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:40.254201 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:40.254209 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:40.254534 (+ 325us) client_negotiation.cc:769] Sending connection context
0812 01:05:40.254782 (+ 248us) client_negotiation.cc:240] Negotiation successful
0812 01:05:40.255282 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":283,"threads_started":1}
I20260812 01:05:40.257872 14807 heartbeater.cc:347] Connected to a master server at 127.4.201.126:33869
I20260812 01:05:40.258186 14807 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:40.258895 14807 heartbeater.cc:511] Master 127.4.201.126:33869 requested a full tablet report, sending...
I20260812 01:05:40.260298 14264 ts_manager.cc:194] Registered new tserver with Master: 07fafd837e32420fb503c1d0e54bbdb0 (127.4.201.66:38985)
I20260812 01:05:40.261094 14264 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.66@KRBTEST.COM'} at 127.4.201.66:48601
WARNING: no policy specified for kudu/127.4.201.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
I20260812 01:05:40.292054 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:0
--local_ip_for_outbound_sockets=127.4.201.67
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:33869
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:33147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:40.615008 14812 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:40.615264 14812 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:40.615371 14812 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:40.622611 14812 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:40.622713 14812 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:40.622830 14812 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:05:40.632273 14812 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:33147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:33869
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:40.633425 14812 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:40.634655 14812 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:40.647014 14819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:40.646958 14820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:40.646948 14822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:40.647835 14812 server_base.cc:1034] running on GCE node
I20260812 01:05:40.648406 14812 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:40.649274 14812 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:40.650467 14812 hybrid_clock.cc:648] HybridClock initialized: now 1786496740650420 us; error 41 us; skew 500 ppm
I20260812 01:05:40.650755 14812 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:40 dist-test-slave-bndk krb5kdc[14196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496740, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:40.653800 14812 init.cc:377] Logged in from keytab as kudu/127.4.201.67@KRBTEST.COM (short username kudu)
I20260812 01:05:40.655174 14812 webserver.cc:460] Webserver started at http://127.4.201.67:46789/ using document root <none> and password file <none>
I20260812 01:05:40.655817 14812 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:40.655934 14812 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:40.656232 14812 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:40.659108 14812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-2/data/instance:
uuid: "1c75200af45d4d489c86fbfbedc3222c"
format_stamp: "Formatted at 2026-08-12 01:05:40 on dist-test-slave-bndk"
server_key: "cdacdfbde8c432e141a8843423ffed58"
server_key_iv: "a649ef921fe3895098ed42914a5638e8"
server_key_version: "encryptionkey@0"
I20260812 01:05:40.659930 14812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance:
uuid: "1c75200af45d4d489c86fbfbedc3222c"
format_stamp: "Formatted at 2026-08-12 01:05:40 on dist-test-slave-bndk"
server_key: "cdacdfbde8c432e141a8843423ffed58"
server_key_iv: "a649ef921fe3895098ed42914a5638e8"
server_key_version: "encryptionkey@0"
I20260812 01:05:40.665021 14812 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260812 01:05:40.668424 14830 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:40.669726 14812 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:05:40.669875 14812 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "1c75200af45d4d489c86fbfbedc3222c"
format_stamp: "Formatted at 2026-08-12 01:05:40 on dist-test-slave-bndk"
server_key: "cdacdfbde8c432e141a8843423ffed58"
server_key_iv: "a649ef921fe3895098ed42914a5638e8"
server_key_version: "encryptionkey@0"
I20260812 01:05:40.670073 14812 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:40.689778 14812 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:40.693848 14812 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:40.694137 14812 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:40.695264 14812 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:05:40.696542 14812 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:40.696619 14812 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:40.696740 14812 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:40.696794 14812 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:40.727702 14812 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:41541
I20260812 01:05:40.727753 15011 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:41541 every 8 connection(s)
I20260812 01:05:40.728950 14812 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:05:40.731953 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 14812
I20260812 01:05:40.732152 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance
I20260812 01:05:40.732721 4901 external_mini_cluster.cc:1428] Setting key e786f597c2ee18cb6b82ae1e09d5c772
Aug 12 01:05:40 dist-test-slave-bndk krb5kdc[14196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496740, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:05:40.748711 14572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:40.731497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:48217 (local address 127.4.201.126:33869)
0812 01:05:40.731673 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:40.731678 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:40.732981 (+ 1303us) server_negotiation.cc:407] Connection header received
0812 01:05:40.735247 (+ 2266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:40.735253 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:40.735359 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:40.735453 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:40.737051 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:40.738234 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:40.739713 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:40.740111 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:40.740205 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:40.743304 (+ 3099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:40.743309 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:40.743312 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:40.743343 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:40.745810 (+ 2467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:40.746428 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:40.746432 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:40.746434 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:40.746573 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:40.747007 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:40.747013 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:40.747016 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:40.747284 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:40.747417 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:40.748156 (+ 739us) server_negotiation.cc:299] Negotiation successful
0812 01:05:40.748371 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 01:05:40.749606 15017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:40.732020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33869 (local address 127.4.201.67:48217)
0812 01:05:40.732819 (+ 799us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:40.732875 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:40.734931 (+ 2056us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:40.735715 (+ 784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:40.735726 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:40.736319 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:40.736853 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:40.736870 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:40.738376 (+ 1506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:40.738380 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:40.739567 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:40.739580 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:40.740288 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:40.740293 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:40.740480 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:40.741039 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:40.741060 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:40.743130 (+ 2070us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:40.745910 (+ 2780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:40.745916 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:40.745926 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:40.746312 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:40.746677 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:40.746681 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:40.746683 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:40.746901 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:40.747409 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:40.747416 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:40.747769 (+ 353us) client_negotiation.cc:769] Sending connection context
0812 01:05:40.748041 (+ 272us) client_negotiation.cc:240] Negotiation successful
0812 01:05:40.748505 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":329,"threads_started":1}
I20260812 01:05:40.750749 15012 heartbeater.cc:347] Connected to a master server at 127.4.201.126:33869
I20260812 01:05:40.751019 15012 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:40.751721 15012 heartbeater.cc:511] Master 127.4.201.126:33869 requested a full tablet report, sending...
I20260812 01:05:40.753079 14264 ts_manager.cc:194] Registered new tserver with Master: 1c75200af45d4d489c86fbfbedc3222c (127.4.201.67:41541)
I20260812 01:05:40.753880 14264 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.67@KRBTEST.COM'} at 127.4.201.67:48217
I20260812 01:05:40.759955 4901 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:05:40.764413 14569 heartbeater.cc:503] Master 127.4.201.126:33869 was elected leader, sending a full tablet report...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/test-admin.keytab.
Aug 12 01:05:40 dist-test-slave-bndk krb5kdc[14196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496740, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:40.790066 4901 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260812 01:05:40.794937 15026 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:05:40.792576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57708 (local address 127.4.201.65:46153)
0812 01:05:40.793248 (+ 672us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:40.793259 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:40.793289 (+ 30us) server_negotiation.cc:407] Connection header received
0812 01:05:40.793354 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:40.793360 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:40.793590 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:40.793713 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:40.794559 (+ 846us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57708: BlockingRecv error: recv got EOF from 127.0.0.1:57708 (error 108)
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":348,"threads_started":1}
W20260812 01:05:40.794992 4901 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/krb5cc' of type FILE
Aug 12 01:05:40 dist-test-slave-bndk krb5kdc[14196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496740, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:40.796697 4901 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 01:05:40 dist-test-slave-bndk krb5kdc[14196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496740, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:40.797976 4901 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 01:05:40 dist-test-slave-bndk krb5kdc[14196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496740, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.65@KRBTEST.COM
I20260812 01:05:40.812426 15026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:40.799456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57724 (local address 127.4.201.65:46153)
0812 01:05:40.799632 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:40.799639 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:40.799874 (+ 235us) server_negotiation.cc:407] Connection header received
0812 01:05:40.800046 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:40.800051 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:40.800110 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:40.800190 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:40.801184 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:40.802181 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:40.803356 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:40.803909 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:40.804024 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:40.807358 (+ 3334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:40.807370 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:40.807385 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:40.807417 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:40.810104 (+ 2687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:40.810725 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:40.810731 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:40.810733 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:40.810846 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:40.811142 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:40.811144 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:40.811146 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:40.811484 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:40.811695 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:40.811924 (+ 229us) server_negotiation.cc:299] Negotiation successful
0812 01:05:40.812150 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
W20260812 01:05:40.817741 15026 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:05:40.816139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57728 (local address 127.4.201.65:46153)
0812 01:05:40.816334 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:40.816340 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:40.816539 (+ 199us) server_negotiation.cc:407] Connection header received
0812 01:05:40.816648 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:40.816651 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:40.816704 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:40.816778 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:40.817529 (+ 751us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57728: BlockingRecv error: recv got EOF from 127.0.0.1:57728 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260812 01:05:40.817888 4901 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/krb5cc' of type FILE
Aug 12 01:05:40 dist-test-slave-bndk krb5kdc[14196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496740, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:40.819402 4901 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 01:05:40 dist-test-slave-bndk krb5kdc[14196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496740, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:40.820611 4901 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 01:05:40 dist-test-slave-bndk krb5kdc[14196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496740, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.65@KRBTEST.COM
I20260812 01:05:40.832728 15026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:40.821706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57740 (local address 127.4.201.65:46153)
0812 01:05:40.821880 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:40.821885 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:40.822122 (+ 237us) server_negotiation.cc:407] Connection header received
0812 01:05:40.822226 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:40.822229 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:40.822278 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:40.822350 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:40.823183 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:40.823814 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:40.824896 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:40.825329 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:40.825418 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:40.828428 (+ 3010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:40.828433 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:40.828437 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:40.828474 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:40.830796 (+ 2322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:40.831318 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:40.831321 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:40.831323 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:40.831432 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:40.831681 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:40.831684 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:40.831686 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:40.831912 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:40.832111 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:40.832319 (+ 208us) server_negotiation.cc:299] Negotiation successful
0812 01:05:40.832465 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
W20260812 01:05:40.836542 15026 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:05:40.834991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57750 (local address 127.4.201.65:46153)
0812 01:05:40.835155 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:40.835161 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:40.835313 (+ 152us) server_negotiation.cc:407] Connection header received
0812 01:05:40.835451 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:40.835455 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:40.835519 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:40.835596 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:40.836353 (+ 757us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57750: BlockingRecv error: recv got EOF from 127.0.0.1:57750 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260812 01:05:40.836645 4901 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786496689953932-4901-0/krb5kdc/krb5cc' of type FILE
Aug 12 01:05:40 dist-test-slave-bndk krb5kdc[14196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496740, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:40.838016 4901 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 01:05:40 dist-test-slave-bndk krb5kdc[14196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496740, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:40.839166 4901 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 01:05:40 dist-test-slave-bndk krb5kdc[14196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496740, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.65@KRBTEST.COM
I20260812 01:05:40.851583 15026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:40.840237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57764 (local address 127.4.201.65:46153)
0812 01:05:40.840421 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:40.840426 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:40.840626 (+ 200us) server_negotiation.cc:407] Connection header received
0812 01:05:40.840725 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:40.840728 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:40.840777 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:40.840849 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:40.841974 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:40.842634 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:40.843738 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:40.844135 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:40.844221 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:40.847271 (+ 3050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:40.847276 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:40.847279 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:40.847306 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:40.849645 (+ 2339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:40.850145 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:40.850148 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:40.850151 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:40.850283 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:40.850537 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:40.850540 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:40.850542 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:40.850765 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:40.850990 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:40.851129 (+ 139us) server_negotiation.cc:299] Negotiation successful
0812 01:05:40.851275 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 01:05:40.852953 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 14365
I20260812 01:05:40.863083 15026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:40.853607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57776 (local address 127.4.201.65:46153)
0812 01:05:40.853733 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:40.853737 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:40.854086 (+ 349us) server_negotiation.cc:407] Connection header received
0812 01:05:40.854187 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:40.854190 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:40.854236 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:40.854306 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:40.855134 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:40.855795 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:40.856885 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:40.857287 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:40.857384 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:40.859104 (+ 1720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:40.859109 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:40.859112 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:40.859135 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:40.861143 (+ 2008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:40.861714 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:40.861718 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:40.861720 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:40.861834 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:40.862121 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:40.862124 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:40.862126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:40.862336 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:40.862527 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:40.862717 (+ 190us) server_negotiation.cc:299] Negotiation successful
0812 01:05:40.862851 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 01:05:40.863616 14558 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:40.945399 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 14365
I20260812 01:05:40.970810 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 14578
Aug 12 01:05:40 dist-test-slave-bndk krb5kdc[14196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496740, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.66@KRBTEST.COM
I20260812 01:05:40.985747 15045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:40.971815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34930 (local address 127.4.201.66:38985)
0812 01:05:40.972303 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:40.972313 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:40.972342 (+ 29us) server_negotiation.cc:407] Connection header received
0812 01:05:40.972412 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:40.972419 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:40.972629 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:40.972759 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:40.973788 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:40.974924 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:40.976072 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:40.976594 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:40.976688 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:40.980392 (+ 3704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:40.980404 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:40.980419 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:40.980452 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:40.983249 (+ 2797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:40.983879 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:40.983887 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:40.983890 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:40.984020 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:40.984296 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:40.984299 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:40.984301 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:40.984648 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:40.984878 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:40.985137 (+ 259us) server_negotiation.cc:299] Negotiation successful
0812 01:05:40.985375 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":228,"threads_started":1}
I20260812 01:05:40.987090 14796 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:41.068966 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 14578
I20260812 01:05:41.093071 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 14812
Aug 12 01:05:41 dist-test-slave-bndk krb5kdc[14196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496740, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.67@KRBTEST.COM
I20260812 01:05:41.108363 15048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:41.094125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37932 (local address 127.4.201.67:41541)
0812 01:05:41.094733 (+ 608us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:41.094740 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:41.094769 (+ 29us) server_negotiation.cc:407] Connection header received
0812 01:05:41.094830 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:41.094836 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:41.095058 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:41.095203 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:41.096249 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:41.097324 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:41.098553 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:41.099118 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:41.099233 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:41.103071 (+ 3838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:41.103082 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:41.103097 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:41.103132 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:41.105674 (+ 2542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:41.106318 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:41.106325 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:41.106328 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:41.106453 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:41.106813 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:41.106817 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:41.106819 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:41.107168 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:41.107471 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:41.107772 (+ 301us) server_negotiation.cc:299] Negotiation successful
0812 01:05:41.108049 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":452,"thread_start_us":301,"threads_started":1}
I20260812 01:05:41.109825 15007 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:41.191375 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 14812
I20260812 01:05:41.215197 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 14216
I20260812 01:05:41.216390 14317 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:41.318887 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 14216
2026-08-12T01:05:41Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4021 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:05:41 dist-test-slave-bndk krb5kdc[15057](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:05:41 dist-test-slave-bndk krb5kdc[15057](info): set up 2 sockets
Aug 12 01:05:41 dist-test-slave-bndk krb5kdc[15057](info): commencing operation
krb5kdc: starting...
W20260812 01:05:42.554450 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.190s user 0.003s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:05:42 dist-test-slave-bndk krb5kdc[15057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496742, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:05:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:05:42Z Disabled control of system clock
WARNING: no policy specified for oryx/127.4.201.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.201.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.201.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.126.keytab.
Entry for principal oryx/127.4.201.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.126.keytab.
I20260812 01:05:42.778543 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:33537
--webserver_interface=127.4.201.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.126.keytab
--principal=oryx/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:36783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:33537
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:43.107249 15083 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:43.107537 15083 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:43.107668 15083 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:43.115072 15083 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:05:43.115193 15083 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:43.115267 15083 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:43.115351 15083 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:05:43.115409 15083 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:05:43.125203 15083 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:36783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:33537
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.126.keytab
--principal=oryx/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:33537
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:43.126606 15083 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:43.127897 15083 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:43.139068 15090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:43.139029 15091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:43.139098 15096 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:43.140291 15083 server_base.cc:1034] running on GCE node
I20260812 01:05:43.141048 15083 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:43.142447 15083 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:43.143659 15083 hybrid_clock.cc:648] HybridClock initialized: now 1786496743143606 us; error 41 us; skew 500 ppm
I20260812 01:05:43.143987 15083 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:43 dist-test-slave-bndk krb5kdc[15057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496743, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:43.147058 15083 init.cc:377] Logged in from keytab as oryx/127.4.201.126@KRBTEST.COM (short username oryx)
I20260812 01:05:43.148500 15083 webserver.cc:460] Webserver started at http://127.4.201.126:42823/ using document root <none> and password file <none>
I20260812 01:05:43.149154 15083 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:43.149299 15083 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:43.149602 15083 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:43.152539 15083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "081f650c09e54aa883c6738258615c15"
format_stamp: "Formatted at 2026-08-12 01:05:43 on dist-test-slave-bndk"
server_key: "a1a64b40a0614f47c5ba9a0a05f76c0e"
server_key_iv: "7613016be065faec2aa1cf912afac886"
server_key_version: "encryptionkey@0"
I20260812 01:05:43.153304 15083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "081f650c09e54aa883c6738258615c15"
format_stamp: "Formatted at 2026-08-12 01:05:43 on dist-test-slave-bndk"
server_key: "a1a64b40a0614f47c5ba9a0a05f76c0e"
server_key_iv: "7613016be065faec2aa1cf912afac886"
server_key_version: "encryptionkey@0"
I20260812 01:05:43.158231 15083 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260812 01:05:43.161402 15107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:43.162588 15083 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 01:05:43.162748 15083 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "081f650c09e54aa883c6738258615c15"
format_stamp: "Formatted at 2026-08-12 01:05:43 on dist-test-slave-bndk"
server_key: "a1a64b40a0614f47c5ba9a0a05f76c0e"
server_key_iv: "7613016be065faec2aa1cf912afac886"
server_key_version: "encryptionkey@0"
I20260812 01:05:43.162916 15083 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:43.181131 15083 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:43.185065 15083 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:43.185355 15083 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:43.202565 15083 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:33537
I20260812 01:05:43.202585 15191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:33537 every 8 connection(s)
I20260812 01:05:43.203864 15083 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:05:43.207391 15192 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:43.207557 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 15083
I20260812 01:05:43.207737 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:05:43.208370 4901 external_mini_cluster.cc:1428] Setting key 8b8c616a8a4b656def90b0202fdd4624
I20260812 01:05:43.220963 15192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15: Bootstrap starting.
Aug 12 01:05:43 dist-test-slave-bndk krb5kdc[15057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496742, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM
I20260812 01:05:43.224290 15192 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:43.225428 15192 log.cc:824] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:43.228346 15192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15: No bootstrap required, opened a new log
I20260812 01:05:43.231426 15199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:43.210214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36924 (local address 127.4.201.126:33537)
0812 01:05:43.211079 (+ 865us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:43.211093 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:43.211144 (+ 51us) server_negotiation.cc:407] Connection header received
0812 01:05:43.213649 (+ 2505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:43.213679 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:43.214150 (+ 471us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:43.214598 (+ 448us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:43.215836 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:43.217794 (+ 1958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:43.219050 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:43.220051 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:43.220237 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:43.224326 (+ 4089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:43.224336 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:43.224354 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:43.224404 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:43.227333 (+ 2929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:43.228158 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:43.228164 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:43.228170 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:43.228339 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:43.228757 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:43.228760 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:43.228762 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:43.229315 (+ 553us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:43.229550 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:43.230069 (+ 519us) server_negotiation.cc:299] Negotiation successful
0812 01:05:43.230435 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":614,"thread_start_us":356,"threads_started":1}
I20260812 01:05:43.236183 15192 raft_consensus.cc:348] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } }
I20260812 01:05:43.236537 15192 raft_consensus.cc:374] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:43.236632 15192 raft_consensus.cc:729] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 081f650c09e54aa883c6738258615c15, State: Initialized, Role: FOLLOWER
I20260812 01:05:43.237143 15192 consensus_queue.cc:260] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } }
I20260812 01:05:43.237385 15192 raft_consensus.cc:388] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:05:43.237521 15192 raft_consensus.cc:482] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:05:43.237665 15192 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:43.239821 15192 raft_consensus.cc:504] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } }
I20260812 01:05:43.240242 15192 leader_election.cc:302] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 081f650c09e54aa883c6738258615c15; no voters:
I20260812 01:05:43.240761 15192 leader_election.cc:288] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:05:43.240880 15202 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:05:43.241518 15202 raft_consensus.cc:686] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [term 1 LEADER]: Becoming Leader. State: Replica: 081f650c09e54aa883c6738258615c15, State: Running, Role: LEADER
I20260812 01:05:43.242367 15202 consensus_queue.cc:237] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } }
I20260812 01:05:43.242821 15192 sys_catalog.cc:564] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:05:43.244992 15203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "081f650c09e54aa883c6738258615c15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } }
I20260812 01:05:43.245164 15204 sys_catalog.cc:455] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 081f650c09e54aa883c6738258615c15. Latest consensus state: current_term: 1 leader_uuid: "081f650c09e54aa883c6738258615c15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } }
I20260812 01:05:43.245385 15203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:43.245450 15204 sys_catalog.cc:458] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:43.247071 15212 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:05:43.251583 15212 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:05:43.258966 15212 catalog_manager.cc:1347] Generated new cluster ID: 72fc76d9a85b4758a0868c4aac8aad14
I20260812 01:05:43.259075 15212 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:05:43.289244 15212 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:05:43.291127 15212 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:05:43.298311 15212 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15: Generated new TSK 0
I20260812 01:05:43.299355 15212 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.4.201.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.201.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.201.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.65.keytab.
Entry for principal oryx/127.4.201.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.65.keytab.
I20260812 01:05:43.359061 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:0
--local_ip_for_outbound_sockets=127.4.201.65
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:33537
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.65.keytab
--principal=oryx/127.4.201.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:36783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:43.686942 15237 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:43.687225 15237 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:43.687362 15237 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:43.696615 15237 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:43.696715 15237 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:43.696874 15237 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:05:43.706405 15237 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:36783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.65.keytab
--principal=oryx/127.4.201.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:33537
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:43.707669 15237 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:43.708972 15237 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:43.722615 15249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:43.722573 15252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:43.722592 15247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:43.723443 15237 server_base.cc:1034] running on GCE node
I20260812 01:05:43.724086 15237 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:43.724967 15237 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:43.726157 15237 hybrid_clock.cc:648] HybridClock initialized: now 1786496743726105 us; error 41 us; skew 500 ppm
I20260812 01:05:43.726433 15237 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:43 dist-test-slave-bndk krb5kdc[15057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496743, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:43.729393 15237 init.cc:377] Logged in from keytab as oryx/127.4.201.65@KRBTEST.COM (short username oryx)
I20260812 01:05:43.730837 15237 webserver.cc:460] Webserver started at http://127.4.201.65:38571/ using document root <none> and password file <none>
I20260812 01:05:43.731520 15237 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:43.731635 15237 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:43.731920 15237 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:43.734812 15237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/data/instance:
uuid: "0d9da262268f431ab7801aeae643ef8e"
format_stamp: "Formatted at 2026-08-12 01:05:43 on dist-test-slave-bndk"
server_key: "62bf5cec2088c09b952e880bdb0d1296"
server_key_iv: "5209c3ae350f1f21147f50a6c2bf4e5a"
server_key_version: "encryptionkey@0"
I20260812 01:05:43.735576 15237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance:
uuid: "0d9da262268f431ab7801aeae643ef8e"
format_stamp: "Formatted at 2026-08-12 01:05:43 on dist-test-slave-bndk"
server_key: "62bf5cec2088c09b952e880bdb0d1296"
server_key_iv: "5209c3ae350f1f21147f50a6c2bf4e5a"
server_key_version: "encryptionkey@0"
I20260812 01:05:43.740615 15237 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 01:05:43.744055 15269 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:43.745376 15237 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:05:43.745550 15237 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "0d9da262268f431ab7801aeae643ef8e"
format_stamp: "Formatted at 2026-08-12 01:05:43 on dist-test-slave-bndk"
server_key: "62bf5cec2088c09b952e880bdb0d1296"
server_key_iv: "5209c3ae350f1f21147f50a6c2bf4e5a"
server_key_version: "encryptionkey@0"
I20260812 01:05:43.745744 15237 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:43.764634 15237 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:43.768431 15237 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:43.768702 15237 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:43.769663 15237 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:05:43.770982 15237 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:43.771055 15237 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:43.771180 15237 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:43.771232 15237 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:43.801414 15237 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:36613
I20260812 01:05:43.801479 15458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:36613 every 8 connection(s)
I20260812 01:05:43.802660 15237 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:05:43.812888 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 15237
I20260812 01:05:43.813112 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance
I20260812 01:05:43.813977 4901 external_mini_cluster.cc:1428] Setting key 489576c60aa2eab1bf04a221f12738bc
Aug 12 01:05:43 dist-test-slave-bndk krb5kdc[15057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496743, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM
I20260812 01:05:43.821833 15462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:43.805031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:53625 (local address 127.4.201.126:33537)
0812 01:05:43.805540 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:43.805547 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:43.806499 (+ 952us) server_negotiation.cc:407] Connection header received
0812 01:05:43.808234 (+ 1735us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:43.808239 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:43.808308 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:43.808403 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:43.809857 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:43.810581 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:43.812009 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:43.812379 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:43.812470 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:43.816444 (+ 3974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:43.816449 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:43.816453 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:43.816491 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:43.818868 (+ 2377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:43.819569 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:43.819573 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:43.819576 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:43.819697 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:43.820111 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:43.820114 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:43.820117 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:43.820416 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:43.820561 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:43.821269 (+ 708us) server_negotiation.cc:299] Negotiation successful
0812 01:05:43.821498 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":246,"threads_started":1}
I20260812 01:05:43.822685 15463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:43.805623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.4.201.65:53625)
0812 01:05:43.806334 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:43.806371 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:43.807992 (+ 1621us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:43.808594 (+ 602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:43.808601 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:43.809107 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:43.809703 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:43.809721 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:43.810694 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:43.810697 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:43.811891 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:43.811903 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:43.812589 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:43.812598 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:43.812878 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:43.813582 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:43.813618 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:43.816237 (+ 2619us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:43.819007 (+ 2770us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:43.819016 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:43.819032 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:43.819422 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:43.819799 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:43.819804 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:43.819808 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:43.819997 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:43.820541 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:43.820548 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:43.820861 (+ 313us) client_negotiation.cc:769] Sending connection context
0812 01:05:43.821097 (+ 236us) client_negotiation.cc:240] Negotiation successful
0812 01:05:43.821618 (+ 521us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":275,"threads_started":1}
I20260812 01:05:43.824084 15459 heartbeater.cc:347] Connected to a master server at 127.4.201.126:33537
I20260812 01:05:43.824397 15459 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:43.825258 15459 heartbeater.cc:511] Master 127.4.201.126:33537 requested a full tablet report, sending...
I20260812 01:05:43.827504 15132 ts_manager.cc:194] Registered new tserver with Master: 0d9da262268f431ab7801aeae643ef8e (127.4.201.65:36613)
I20260812 01:05:43.829460 15132 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.201.65@KRBTEST.COM'} at 127.4.201.65:53625
WARNING: no policy specified for oryx/127.4.201.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.201.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.201.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.66.keytab.
Entry for principal oryx/127.4.201.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.66.keytab.
I20260812 01:05:43.865896 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:0
--local_ip_for_outbound_sockets=127.4.201.66
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:33537
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.66.keytab
--principal=oryx/127.4.201.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:36783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:44.191187 15467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:44.191476 15467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:44.191579 15467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:44.198561 15467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:44.198658 15467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:44.198773 15467 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:05:44.208122 15467 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:36783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.66.keytab
--principal=oryx/127.4.201.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:33537
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:44.209332 15467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:44.210578 15467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:44.222903 15475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:44.222868 15474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:44.222937 15477 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:44.223803 15467 server_base.cc:1034] running on GCE node
I20260812 01:05:44.224395 15467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:44.225265 15467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:44.226490 15467 hybrid_clock.cc:648] HybridClock initialized: now 1786496744226438 us; error 44 us; skew 500 ppm
I20260812 01:05:44.226828 15467 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:44 dist-test-slave-bndk krb5kdc[15057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496744, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:44.232632 15467 init.cc:377] Logged in from keytab as oryx/127.4.201.66@KRBTEST.COM (short username oryx)
I20260812 01:05:44.234088 15467 webserver.cc:460] Webserver started at http://127.4.201.66:34151/ using document root <none> and password file <none>
I20260812 01:05:44.234757 15467 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:44.234876 15467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:44.235157 15467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:44.237986 15467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/data/instance:
uuid: "b442ca0236f04fb7aea55f3b9a8de884"
format_stamp: "Formatted at 2026-08-12 01:05:44 on dist-test-slave-bndk"
server_key: "bbcdd711ea069141d23b268c592484e5"
server_key_iv: "60d10164dd25d7026d3f895d53c80ef2"
server_key_version: "encryptionkey@0"
I20260812 01:05:44.238704 15467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance:
uuid: "b442ca0236f04fb7aea55f3b9a8de884"
format_stamp: "Formatted at 2026-08-12 01:05:44 on dist-test-slave-bndk"
server_key: "bbcdd711ea069141d23b268c592484e5"
server_key_iv: "60d10164dd25d7026d3f895d53c80ef2"
server_key_version: "encryptionkey@0"
I20260812 01:05:44.243692 15467 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 01:05:44.247156 15496 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:44.248458 15467 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 01:05:44.248616 15467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "b442ca0236f04fb7aea55f3b9a8de884"
format_stamp: "Formatted at 2026-08-12 01:05:44 on dist-test-slave-bndk"
server_key: "bbcdd711ea069141d23b268c592484e5"
server_key_iv: "60d10164dd25d7026d3f895d53c80ef2"
server_key_version: "encryptionkey@0"
I20260812 01:05:44.248786 15467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:44.266340 15467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:44.270102 15467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:44.270344 15467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:44.271206 15467 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:05:44.272476 15467 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:44.272548 15467 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:44.272643 15467 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:44.272687 15467 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:44.302544 15467 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:40883
I20260812 01:05:44.302584 15674 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:40883 every 8 connection(s)
I20260812 01:05:44.303747 15467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:05:44.306373 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 15467
I20260812 01:05:44.306612 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance
I20260812 01:05:44.307170 4901 external_mini_cluster.cc:1428] Setting key 91e7fd3bc02cbb6bf8110ca6730eaecf
Aug 12 01:05:44 dist-test-slave-bndk krb5kdc[15057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496744, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM
I20260812 01:05:44.323802 15462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:44.306286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:60431 (local address 127.4.201.126:33537)
0812 01:05:44.306511 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:44.306518 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:44.307810 (+ 1292us) server_negotiation.cc:407] Connection header received
0812 01:05:44.309753 (+ 1943us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:44.309759 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:44.309862 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:44.309976 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:44.311413 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:44.312348 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:44.313856 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:44.314408 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:44.314526 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:44.318137 (+ 3611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:44.318143 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:44.318147 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:44.318183 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:44.320704 (+ 2521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:44.321553 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:44.321557 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:44.321560 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:44.321694 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:44.322141 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:44.322144 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:44.322146 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:44.322388 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:44.322498 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:44.323258 (+ 760us) server_negotiation.cc:299] Negotiation successful
0812 01:05:44.323479 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 01:05:44.325037 15682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:44.306787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.4.201.66:60431)
0812 01:05:44.307611 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:44.307666 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:44.309498 (+ 1832us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:44.310192 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:44.310200 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:44.310673 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:44.311230 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:44.311247 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:44.312473 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:44.312477 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:44.313715 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:44.313728 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:44.314588 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:44.314593 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:44.314773 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:44.315463 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:44.315504 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:44.317911 (+ 2407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:44.320843 (+ 2932us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:44.320851 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:44.320865 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:44.321430 (+ 565us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:44.321811 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:44.321816 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:44.321819 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:44.322049 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:44.322513 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:44.322520 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:44.322896 (+ 376us) client_negotiation.cc:769] Sending connection context
0812 01:05:44.323202 (+ 306us) client_negotiation.cc:240] Negotiation successful
0812 01:05:44.323729 (+ 527us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":290,"threads_started":1}
I20260812 01:05:44.326475 15675 heartbeater.cc:347] Connected to a master server at 127.4.201.126:33537
I20260812 01:05:44.326761 15675 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:44.327535 15675 heartbeater.cc:511] Master 127.4.201.126:33537 requested a full tablet report, sending...
I20260812 01:05:44.328943 15132 ts_manager.cc:194] Registered new tserver with Master: b442ca0236f04fb7aea55f3b9a8de884 (127.4.201.66:40883)
I20260812 01:05:44.329749 15132 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.201.66@KRBTEST.COM'} at 127.4.201.66:60431
WARNING: no policy specified for oryx/127.4.201.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.201.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.201.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.67.keytab.
Entry for principal oryx/127.4.201.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.67.keytab.
I20260812 01:05:44.360724 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:0
--local_ip_for_outbound_sockets=127.4.201.67
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:33537
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.67.keytab
--principal=oryx/127.4.201.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:36783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:44.694919 15686 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:44.695179 15686 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:44.695269 15686 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:44.702176 15686 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:44.702271 15686 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:44.702392 15686 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:05:44.711540 15686 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:36783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.67.keytab
--principal=oryx/127.4.201.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:33537
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:44.712710 15686 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:44.714073 15686 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:44.727758 15693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:44.727728 15697 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:44.727762 15699 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:44.728757 15686 server_base.cc:1034] running on GCE node
I20260812 01:05:44.729521 15686 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:44.730500 15686 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:44.731740 15686 hybrid_clock.cc:648] HybridClock initialized: now 1786496744731678 us; error 50 us; skew 500 ppm
I20260812 01:05:44.732107 15686 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:44 dist-test-slave-bndk krb5kdc[15057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496744, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:44.735303 15686 init.cc:377] Logged in from keytab as oryx/127.4.201.67@KRBTEST.COM (short username oryx)
I20260812 01:05:44.736863 15686 webserver.cc:460] Webserver started at http://127.4.201.67:34173/ using document root <none> and password file <none>
I20260812 01:05:44.737640 15686 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:44.737766 15686 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:44.738068 15686 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:44.740989 15686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/data/instance:
uuid: "216b202088db425cbeb2f5f7da3ed2c3"
format_stamp: "Formatted at 2026-08-12 01:05:44 on dist-test-slave-bndk"
server_key: "58dc9f3d5029de55780bd5f8df0782d6"
server_key_iv: "bdc1ddf926744dc3d89d3ee52d09a323"
server_key_version: "encryptionkey@0"
I20260812 01:05:44.741787 15686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance:
uuid: "216b202088db425cbeb2f5f7da3ed2c3"
format_stamp: "Formatted at 2026-08-12 01:05:44 on dist-test-slave-bndk"
server_key: "58dc9f3d5029de55780bd5f8df0782d6"
server_key_iv: "bdc1ddf926744dc3d89d3ee52d09a323"
server_key_version: "encryptionkey@0"
I20260812 01:05:44.747138 15686 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 01:05:44.750660 15715 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:44.752132 15686 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 01:05:44.752305 15686 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "216b202088db425cbeb2f5f7da3ed2c3"
format_stamp: "Formatted at 2026-08-12 01:05:44 on dist-test-slave-bndk"
server_key: "58dc9f3d5029de55780bd5f8df0782d6"
server_key_iv: "bdc1ddf926744dc3d89d3ee52d09a323"
server_key_version: "encryptionkey@0"
I20260812 01:05:44.752481 15686 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:44.787022 15686 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:44.790858 15686 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:44.791127 15686 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:44.792120 15686 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:05:44.793481 15686 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:44.793562 15686 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:44.793684 15686 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:44.793735 15686 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:44.823833 15686 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:40181
I20260812 01:05:44.823876 15900 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:40181 every 8 connection(s)
I20260812 01:05:44.825098 15686 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:05:44.825621 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 15686
I20260812 01:05:44.825802 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance
I20260812 01:05:44.826413 4901 external_mini_cluster.cc:1428] Setting key 72f6b5177a03f47f5221ffd2f52da8fc
I20260812 01:05:44.832273 15459 heartbeater.cc:503] Master 127.4.201.126:33537 was elected leader, sending a full tablet report...
Aug 12 01:05:44 dist-test-slave-bndk krb5kdc[15057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496744, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM
I20260812 01:05:44.845310 15903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:44.827879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:45801 (local address 127.4.201.126:33537)
0812 01:05:44.828374 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:44.828378 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:44.829775 (+ 1397us) server_negotiation.cc:407] Connection header received
0812 01:05:44.831597 (+ 1822us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:44.831601 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:44.831668 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:44.831758 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:44.833284 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:44.834208 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:44.835689 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:44.836093 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:44.836199 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:44.839409 (+ 3210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:44.839414 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:44.839418 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:44.839449 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:44.842255 (+ 2806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:44.842985 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:44.842991 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:44.842995 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:44.843126 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:44.843558 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:44.843563 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:44.843566 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:44.843845 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:44.844013 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:44.844696 (+ 683us) server_negotiation.cc:299] Negotiation successful
0812 01:05:44.844913 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":282,"threads_started":1}
I20260812 01:05:44.846292 15906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:44.828566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.4.201.67:45801)
0812 01:05:44.829616 (+ 1050us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:44.829676 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:44.831357 (+ 1681us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:44.831943 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:44.831951 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:44.832460 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:44.833105 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:44.833123 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:44.834353 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:44.834357 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:44.835556 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:44.835570 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:44.836306 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:44.836315 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:44.836541 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:44.837094 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:44.837121 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:44.839217 (+ 2096us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:44.842375 (+ 3158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:44.842385 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:44.842401 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:44.842883 (+ 482us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:44.843230 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:44.843235 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:44.843239 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:44.843437 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:44.843965 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:44.843974 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:44.844319 (+ 345us) client_negotiation.cc:769] Sending connection context
0812 01:05:44.844591 (+ 272us) client_negotiation.cc:240] Negotiation successful
0812 01:05:44.845111 (+ 520us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":766,"thread_start_us":563,"threads_started":1}
I20260812 01:05:44.847517 15901 heartbeater.cc:347] Connected to a master server at 127.4.201.126:33537
I20260812 01:05:44.847784 15901 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:44.848469 15901 heartbeater.cc:511] Master 127.4.201.126:33537 requested a full tablet report, sending...
I20260812 01:05:44.849898 15132 ts_manager.cc:194] Registered new tserver with Master: 216b202088db425cbeb2f5f7da3ed2c3 (127.4.201.67:40181)
I20260812 01:05:44.850687 15132 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.201.67@KRBTEST.COM'} at 127.4.201.67:45801
I20260812 01:05:44.854441 4901 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.4.201.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.201.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.201.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.125.keytab.
Entry for principal oryx/127.4.201.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.125.keytab.
I20260812 01:05:44.908143 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.125:46425
--webserver_interface=127.4.201.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.125.keytab
--principal=oryx/127.4.201.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:36783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:33537,127.4.201.125:46425
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:45.237751 15910 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:45.238010 15910 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:45.238131 15910 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:45.245116 15910 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:05:45.245230 15910 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:45.245306 15910 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:45.245378 15910 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:05:45.245436 15910 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:05:45.255070 15910 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:36783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:33537,127.4.201.125:46425
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.125.keytab
--principal=oryx/127.4.201.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.125:46425
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.4.201.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
W20260812 01:05:45.255405 15910 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.4.201.126:33537,127.4.201.125:46425'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260812 01:05:45.256394 15910 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:45.257668 15910 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:45.269234 15916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:45.269171 15919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:45.269264 15917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:45.270566 15910 server_base.cc:1034] running on GCE node
I20260812 01:05:45.271332 15910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:45.272671 15910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:45.273893 15910 hybrid_clock.cc:648] HybridClock initialized: now 1786496745273808 us; error 44 us; skew 500 ppm
I20260812 01:05:45.274194 15910 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:45 dist-test-slave-bndk krb5kdc[15057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496745, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:45.277266 15910 init.cc:377] Logged in from keytab as oryx/127.4.201.125@KRBTEST.COM (short username oryx)
I20260812 01:05:45.278677 15910 webserver.cc:460] Webserver started at http://127.4.201.125:38865/ using document root <none> and password file <none>
I20260812 01:05:45.279342 15910 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:45.279445 15910 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:45.279752 15910 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:45.282672 15910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-1/data/instance:
uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a"
format_stamp: "Formatted at 2026-08-12 01:05:45 on dist-test-slave-bndk"
server_key: "94bb269e1a9be655d179d6876bb77e7d"
server_key_iv: "15d1d7591456355d6d2662143859118c"
server_key_version: "encryptionkey@0"
I20260812 01:05:45.283414 15910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-1/wal/instance:
uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a"
format_stamp: "Formatted at 2026-08-12 01:05:45 on dist-test-slave-bndk"
server_key: "94bb269e1a9be655d179d6876bb77e7d"
server_key_iv: "15d1d7591456355d6d2662143859118c"
server_key_version: "encryptionkey@0"
I20260812 01:05:45.288533 15910 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260812 01:05:45.291831 15929 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:45.293087 15910 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 01:05:45.293273 15910 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-1/wal
uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a"
format_stamp: "Formatted at 2026-08-12 01:05:45 on dist-test-slave-bndk"
server_key: "94bb269e1a9be655d179d6876bb77e7d"
server_key_iv: "15d1d7591456355d6d2662143859118c"
server_key_version: "encryptionkey@0"
I20260812 01:05:45.293479 15910 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:45.309113 15910 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:45.312902 15910 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:45.313144 15910 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:45.330338 15910 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.125:46425
I20260812 01:05:45.330345 16018 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.125:46425 every 8 connection(s)
I20260812 01:05:45.331660 15910 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-1/data/info.pb
I20260812 01:05:45.332321 15675 heartbeater.cc:503] Master 127.4.201.126:33537 was elected leader, sending a full tablet report...
I20260812 01:05:45.335769 16019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:45.340371 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 15910
I20260812 01:05:45.342571 16019 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 01:05:45 dist-test-slave-bndk krb5kdc[15057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496745, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.125@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM
Aug 12 01:05:45 dist-test-slave-bndk krb5kdc[15057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496742, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.4.201.125@KRBTEST.COM
I20260812 01:05:45.360451 15903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:45.345140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36936 (local address 127.4.201.126:33537)
0812 01:05:45.345354 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:45.345361 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:45.346129 (+ 768us) server_negotiation.cc:407] Connection header received
0812 01:05:45.346375 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:45.346380 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:45.346474 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:45.346557 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:45.347797 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:45.348558 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:45.350120 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:45.350592 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:45.350705 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:45.354221 (+ 3516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:45.354226 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:45.354230 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:45.354262 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:45.356948 (+ 2686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:45.357931 (+ 983us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:45.357934 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:45.357937 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:45.358057 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:45.358503 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:45.358508 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:45.358511 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:45.358930 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:45.359081 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:45.359891 (+ 810us) server_negotiation.cc:299] Negotiation successful
0812 01:05:45.360141 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260812 01:05:45.361681 16026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:45.345161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.0.0.1:36936)
0812 01:05:45.345990 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:45.346031 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:45.346246 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:45.346639 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:45.346645 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:45.347267 (+ 622us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:45.347635 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:45.347653 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:45.348682 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:45.348686 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:45.349980 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:45.349997 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:45.350816 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:45.350823 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:45.350956 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:45.351590 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:45.351622 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:45.353994 (+ 2372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:45.357093 (+ 3099us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:45.357103 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:45.357114 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:45.357818 (+ 704us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:45.358156 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:45.358161 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:45.358164 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:45.358359 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:45.359067 (+ 708us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:45.359076 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:45.359440 (+ 364us) client_negotiation.cc:769] Sending connection context
0812 01:05:45.359778 (+ 338us) client_negotiation.cc:240] Negotiation successful
0812 01:05:45.360274 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"thread_start_us":424,"threads_started":1}
I20260812 01:05:45.361701 16025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:45.342389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45472 (local address 127.4.201.125:46425)
0812 01:05:45.343161 (+ 772us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:45.343172 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:45.343219 (+ 47us) server_negotiation.cc:407] Connection header received
0812 01:05:45.345005 (+ 1786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:45.345036 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:45.345538 (+ 502us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:45.345925 (+ 387us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:45.347658 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:45.348792 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:45.350137 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:45.350693 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:45.350859 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:45.354983 (+ 4124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:45.354992 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:45.355004 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:45.355033 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:45.358125 (+ 3092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:45.358831 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:45.358837 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:45.358839 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:45.358956 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:45.359328 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:45.359332 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:45.359335 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:45.359751 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:45.360040 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:45.360341 (+ 301us) server_negotiation.cc:299] Negotiation successful
0812 01:05:45.360573 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":559,"spinlock_wait_cycles":36864,"thread_start_us":331,"threads_started":1}
I20260812 01:05:45.364650 16019 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 01:05:45 dist-test-slave-bndk krb5kdc[15057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496745, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.125@KRBTEST.COM for oryx/127.4.201.125@KRBTEST.COM
I20260812 01:05:45.376077 16026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:45.365295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:46425 (local address 127.0.0.1:45488)
0812 01:05:45.365482 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:45.365500 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:45.365598 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:45.365808 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:45.365811 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:45.366163 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:45.366296 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:45.366304 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:45.367267 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:45.367271 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:45.368140 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:45.368151 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:45.368771 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:45.368775 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:45.368924 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:45.369451 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:45.369468 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:45.371350 (+ 1882us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:45.374105 (+ 2755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:45.374109 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:45.374112 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:45.374460 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:45.374781 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:45.374785 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:45.374787 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:45.374910 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:45.375362 (+ 452us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:45.375365 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:45.375481 (+ 116us) client_negotiation.cc:769] Sending connection context
0812 01:05:45.375600 (+ 119us) client_negotiation.cc:240] Negotiation successful
0812 01:05:45.375816 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260812 01:05:45.376232 16025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:45.365461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45488 (local address 127.4.201.125:46425)
0812 01:05:45.365600 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:45.365604 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:45.365619 (+ 15us) server_negotiation.cc:407] Connection header received
0812 01:05:45.365662 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:45.365665 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:45.365714 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:45.365786 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:45.366412 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:45.367135 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:45.368256 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:45.368654 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:45.368748 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:45.371537 (+ 2789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:45.371542 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:45.371545 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:45.371573 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:45.373962 (+ 2389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:45.374564 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:45.374568 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:45.374570 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:45.374693 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:45.374994 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:45.374998 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:45.375000 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:45.375271 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:45.375377 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:45.375679 (+ 302us) server_negotiation.cc:299] Negotiation successful
0812 01:05:45.375939 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":76,"server-negotiator.queue_time_us":50}
I20260812 01:05:45.380892 16019 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a: Bootstrap starting.
I20260812 01:05:45.384035 16019 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:45.385022 16019 log.cc:824] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:45.387696 16019 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a: No bootstrap required, opened a new log
I20260812 01:05:45.394755 16019 raft_consensus.cc:348] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } }
I20260812 01:05:45.395098 16019 raft_consensus.cc:374] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:45.395179 16019 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c5c0b2488d4caa9a7c97fa81dbb68a, State: Initialized, Role: FOLLOWER
I20260812 01:05:45.395709 16019 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } }
I20260812 01:05:45.396569 16028 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } } }
I20260812 01:05:45.396890 16028 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:05:45.397637 16019 sys_catalog.cc:564] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [sys.catalog]: configured and running, proceeding with master startup.
W20260812 01:05:45.406260 16048 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 01:05:45.406401 16048 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 01:05:45.409384 15910 master_runner.cc:428] Detected that this master e1c5c0b2488d4caa9a7c97fa81dbb68a is joining an existing cluster
I20260812 01:05:45.409489 15910 master_runner.cc:432] Initiating AddMaster RPC to add 127.4.201.125:46425
I20260812 01:05:45.444927 16025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:45.413775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45496 (local address 127.4.201.125:46425)
0812 01:05:45.413940 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:45.413946 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:45.429714 (+ 15768us) server_negotiation.cc:407] Connection header received
0812 01:05:45.429969 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:45.429973 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:45.430040 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:45.430109 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:45.431850 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:45.432956 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:45.435066 (+ 2110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:45.435775 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:45.435873 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:45.438235 (+ 2362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:45.438242 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:45.438246 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:45.438283 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:45.441731 (+ 3448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:45.442659 (+ 928us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:45.442665 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:45.442668 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:45.442823 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:45.443272 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:45.443277 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:45.443280 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:45.443672 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:45.443801 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:45.444325 (+ 524us) server_negotiation.cc:299] Negotiation successful
0812 01:05:45.444560 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 01:05:45.445351 15903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:45.413440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36948 (local address 127.4.201.126:33537)
0812 01:05:45.413633 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:45.413640 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:45.429074 (+ 15434us) server_negotiation.cc:407] Connection header received
0812 01:05:45.430012 (+ 938us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:45.430018 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:45.430106 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:45.430171 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:45.431776 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:45.432810 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:45.434756 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:45.435365 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:45.435484 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:45.438147 (+ 2663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:45.438153 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:45.438157 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:45.438193 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:45.441403 (+ 3210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:45.442611 (+ 1208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:45.442616 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:45.442620 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:45.442790 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:45.443382 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:45.443387 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:45.443391 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:45.443775 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:45.443915 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:45.444617 (+ 702us) server_negotiation.cc:299] Negotiation successful
0812 01:05:45.444844 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 01:05:45.446082 16060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:45.413697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:46425 (local address 127.0.0.1:45496)
0812 01:05:45.429609 (+ 15912us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:45.429639 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:45.429839 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:45.430307 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:45.430311 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:45.431257 (+ 946us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:45.431687 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:45.431701 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:45.433276 (+ 1575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:45.433281 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:45.434913 (+ 1632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:45.434930 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:45.436181 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:45.436189 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:45.436337 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:45.436849 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:45.436875 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:45.438053 (+ 1178us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:45.441868 (+ 3815us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:45.441873 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:45.441877 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:45.442531 (+ 654us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:45.442958 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:45.442962 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:45.442966 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:45.443163 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:45.443862 (+ 699us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:45.443867 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:45.444035 (+ 168us) client_negotiation.cc:769] Sending connection context
0812 01:05:45.445182 (+ 1147us) client_negotiation.cc:240] Negotiation successful
0812 01:05:45.445483 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15760,"spinlock_wait_cycles":9216,"thread_start_us":15574,"threads_started":1}
I20260812 01:05:45.446705 16058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:45.413543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.0.0.1:36948)
0812 01:05:45.428939 (+ 15396us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:45.428963 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:45.429839 (+ 876us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:45.430346 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:45.430350 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:45.431192 (+ 842us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:45.431599 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:45.431614 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:45.432997 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:45.433002 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:45.434587 (+ 1585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:45.434601 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:45.435807 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:45.435812 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:45.435976 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:45.436653 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:45.436675 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:45.437943 (+ 1268us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:45.441837 (+ 3894us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:45.441842 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:45.441847 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:45.442469 (+ 622us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:45.442950 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:45.442954 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:45.442957 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:45.443238 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:45.444038 (+ 800us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:45.444042 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:45.444319 (+ 277us) client_negotiation.cc:769] Sending connection context
0812 01:05:45.445669 (+ 1350us) client_negotiation.cc:240] Negotiation successful
0812 01:05:45.446025 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15223,"mutex_wait_us":1,"spinlock_wait_cycles":12032,"thread_start_us":16022,"threads_started":1}
WARNING: no policy specified for oryx/127.4.201.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.201.124@KRBTEST.COM" created.
Aug 12 01:05:45 dist-test-slave-bndk krb5kdc[15057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496743, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.126@KRBTEST.COM for oryx/127.4.201.125@KRBTEST.COM
I20260812 01:05:45.469550 16025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:45.454123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45508 (local address 127.4.201.125:46425)
0812 01:05:45.454289 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:45.454294 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:45.454873 (+ 579us) server_negotiation.cc:407] Connection header received
0812 01:05:45.455278 (+ 405us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:45.455283 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:45.455385 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:45.455483 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:45.456975 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:45.457917 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:45.459784 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:45.460409 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:45.460533 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:45.463977 (+ 3444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:45.463989 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:45.463993 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:45.464022 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:45.466763 (+ 2741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:45.467557 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:45.467563 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:45.467566 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:45.467702 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:45.468066 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:45.468070 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:45.468072 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:45.468332 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:45.468471 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:45.468933 (+ 462us) server_negotiation.cc:299] Negotiation successful
0812 01:05:45.469143 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 01:05:45.469810 16062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:45.453798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:46425 (local address 127.0.0.1:45508)
0812 01:05:45.454744 (+ 946us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:45.454791 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:45.455029 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:45.455574 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:45.455581 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:45.456482 (+ 901us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:45.456762 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:45.456775 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:45.458072 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:45.458078 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:45.459630 (+ 1552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:45.459647 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:45.460726 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:45.460730 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:45.460871 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:45.461454 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:45.461471 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:45.463805 (+ 2334us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:45.466880 (+ 3075us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:45.466894 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:45.466902 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:45.467444 (+ 542us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:45.467806 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:45.467811 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:45.467815 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:45.467961 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:45.468477 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:45.468495 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:45.468652 (+ 157us) client_negotiation.cc:769] Sending connection context
0812 01:05:45.468817 (+ 165us) client_negotiation.cc:240] Negotiation successful
0812 01:05:45.469138 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":718,"thread_start_us":534,"threads_started":1}
I20260812 01:05:45.471742 15132 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.4.201.125:46425: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a"
member_type: NON_VOTER
last_known_addr {
host: "127.4.201.125"
port: 46425
}
attrs {
promote: true
}
}
dest_uuid: "081f650c09e54aa883c6738258615c15"
cas_config_opid_index: -1
I20260812 01:05:45.473125 15132 consensus_queue.cc:237] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: NON_VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: true } }
I20260812 01:05:45.478602 16067 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER e1c5c0b2488d4caa9a7c97fa81dbb68a (127.4.201.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: NON_VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: true } } }
I20260812 01:05:45.479650 15980 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:45.482647 16067 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.4.201.125:46425
I20260812 01:05:45.483202 16067 sys_catalog.cc:455] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "081f650c09e54aa883c6738258615c15" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: NON_VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: true } } }
I20260812 01:05:45.483381 15980 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [term 1 FOLLOWER]: Refusing update from remote peer 081f650c09e54aa883c6738258615c15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260812 01:05:45.483417 16067 sys_catalog.cc:458] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:45.483856 15910 master.cc:537] Master@127.4.201.125:46425 shutting down...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.201.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.124.keytab.
Entry for principal oryx/127.4.201.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.124.keytab.
I20260812 01:05:45.486974 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.124:41233
--webserver_interface=127.4.201.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.124.keytab
--principal=oryx/127.4.201.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:36783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:33537,127.4.201.125:46425,127.4.201.124:41233
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:05:45.497571 16066 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: NON_VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:45.499238 15910 raft_consensus.cc:2229] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:05:45.499662 15910 raft_consensus.cc:2258] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:45.499859 15910 tablet_replica.cc:330] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a: stopping tablet replica
W20260812 01:05:45.503306 15108 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260812 01:05:45.505620 15108 consensus_peers.cc:487] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 -> Peer e1c5c0b2488d4caa9a7c97fa81dbb68a (127.4.201.125:46425): Couldn't send request to peer e1c5c0b2488d4caa9a7c97fa81dbb68a. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260812 01:05:45.519304 15910 master.cc:552] Master@127.4.201.125:46425 shutdown complete.
I20260812 01:05:45.519534 15910 master_runner.cc:305] Clearing existing system tablet
I20260812 01:05:45.520032 15910 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:45.520125 15910 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:45.522431 15910 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 01:05:45.523852 16076 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:45.524143 15910 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:45.524389 15910 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:05:45.524482 15910 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-1/wal
uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a"
format_stamp: "Formatted at 2026-08-12 01:05:45 on dist-test-slave-bndk"
server_key: "94bb269e1a9be655d179d6876bb77e7d"
server_key_iv: "15d1d7591456355d6d2662143859118c"
server_key_version: "encryptionkey@0"
I20260812 01:05:45.527890 15910 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:45.532570 15910 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 01:05:45.532725 15910 log.cc:1196] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260812 01:05:45.533123 15910 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a: Deleting consensus metadata
I20260812 01:05:45.533382 15910 master_runner.cc:315] Copying system tablet from 127.4.201.126:33537
I20260812 01:05:45.535804 15910 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a: tablet copy: Beginning tablet copy session from remote peer at address 127.4.201.126:33537
I20260812 01:05:45.548396 15903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:45.536671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36958 (local address 127.4.201.126:33537)
0812 01:05:45.536868 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:45.536875 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:45.537371 (+ 496us) server_negotiation.cc:407] Connection header received
0812 01:05:45.537556 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:45.537561 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:45.537635 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:45.537738 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:45.538757 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:45.539540 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:45.540753 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:45.541185 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:45.541332 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:45.543029 (+ 1697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:45.543034 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:45.543038 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:45.543074 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:45.545756 (+ 2682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:45.546456 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:45.546462 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:45.546465 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:45.546617 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:45.547031 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:45.547036 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:45.547040 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:45.547337 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:45.547471 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:45.547863 (+ 392us) server_negotiation.cc:299] Negotiation successful
0812 01:05:45.548062 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 01:05:45.548497 16083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:45.536633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.0.0.1:36958)
0812 01:05:45.537255 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:45.537274 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:45.537427 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:45.537765 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:45.537771 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:45.538370 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:45.538591 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:45.538601 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:45.539683 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:45.539689 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:45.540613 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:45.540625 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:45.541375 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:45.541381 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:45.541535 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:45.542107 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:45.542125 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:45.542824 (+ 699us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:45.545905 (+ 3081us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:45.545911 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:45.545916 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:45.546343 (+ 427us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:45.546726 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:45.546731 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:45.546735 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:45.546925 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:45.547461 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:45.547466 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:45.547628 (+ 162us) client_negotiation.cc:769] Sending connection context
0812 01:05:45.547750 (+ 122us) client_negotiation.cc:240] Negotiation successful
0812 01:05:45.548069 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":387,"threads_started":1}
I20260812 01:05:45.549700 15162 tablet_copy_service.cc:140] P 081f650c09e54aa883c6738258615c15: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer e1c5c0b2488d4caa9a7c97fa81dbb68a ({username='oryx', principal='oryx/127.4.201.125@KRBTEST.COM'} at 127.0.0.1:36958)
I20260812 01:05:45.550110 15162 tablet_copy_service.cc:161] P 081f650c09e54aa883c6738258615c15: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer e1c5c0b2488d4caa9a7c97fa81dbb68a at {username='oryx', principal='oryx/127.4.201.125@KRBTEST.COM'} at 127.0.0.1:36958: session id = e1c5c0b2488d4caa9a7c97fa81dbb68a-00000000000000000000000000000000
I20260812 01:05:45.553663 15162 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 01:05:45.556118 15910 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 01:05:45.560853 15910 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a: tablet copy: Starting download of 0 data blocks...
I20260812 01:05:45.561177 15910 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a: tablet copy: Starting download of 1 WAL segments...
I20260812 01:05:45.564142 15910 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 01:05:45.567418 15162 tablet_copy_service.cc:342] P 081f650c09e54aa883c6738258615c15: Request end of tablet copy session e1c5c0b2488d4caa9a7c97fa81dbb68a-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.4.201.125@KRBTEST.COM'} at 127.0.0.1:36958
I20260812 01:05:45.567665 15162 tablet_copy_service.cc:433] P 081f650c09e54aa883c6738258615c15: ending tablet copy session e1c5c0b2488d4caa9a7c97fa81dbb68a-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer e1c5c0b2488d4caa9a7c97fa81dbb68a
I20260812 01:05:45.577646 15910 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:45.580019 16085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:45.589483 16086 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:45.590214 16088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:45.592902 15910 server_base.cc:1034] running on GCE node
I20260812 01:05:45.593245 15910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:45.593816 15910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:45.595016 15910 hybrid_clock.cc:648] HybridClock initialized: now 1786496745594952 us; error 35 us; skew 500 ppm
I20260812 01:05:45.595217 15910 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:45 dist-test-slave-bndk krb5kdc[15057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496745, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:45.596972 15910 init.cc:377] Logged in from keytab as oryx/127.4.201.125@KRBTEST.COM (short username oryx)
I20260812 01:05:45.598122 15910 webserver.cc:460] Webserver started at http://127.4.201.125:37179/ using document root <none> and password file <none>
I20260812 01:05:45.598403 15910 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:45.598474 15910 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:45.600695 15910 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 01:05:45.602233 16100 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:45.602618 15910 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 01:05:45.602748 15910 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-1/wal
uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a"
format_stamp: "Formatted at 2026-08-12 01:05:45 on dist-test-slave-bndk"
server_key: "94bb269e1a9be655d179d6876bb77e7d"
server_key_iv: "15d1d7591456355d6d2662143859118c"
server_key_version: "encryptionkey@0"
I20260812 01:05:45.602895 15910 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:45.611930 15910 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:45.614998 15910 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:45.640646 15910 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.125:46425
I20260812 01:05:45.640669 16183 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.125:46425 every 8 connection(s)
I20260812 01:05:45.641554 15910 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-1/data/info.pb
I20260812 01:05:45.647522 16184 sys_catalog.cc:263] Verifying existing consensus state
I20260812 01:05:45.651147 16184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a: Bootstrap starting.
I20260812 01:05:45.664964 16184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 01:05:45.665439 16184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a: Bootstrap complete.
I20260812 01:05:45.666474 16184 raft_consensus.cc:348] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: NON_VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: true } }
I20260812 01:05:45.666720 16184 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e1c5c0b2488d4caa9a7c97fa81dbb68a, State: Initialized, Role: LEARNER
I20260812 01:05:45.666989 16184 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: NON_VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: true } }
I20260812 01:05:45.667877 16191 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: NON_VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: true } } }
I20260812 01:05:45.668134 16184 sys_catalog.cc:564] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:05:45.668309 16191 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [sys.catalog]: This master's current role is: LEARNER
I20260812 01:05:45.680598 16211 catalog_manager.cc:1259] Loaded cluster ID: 72fc76d9a85b4758a0868c4aac8aad14
I20260812 01:05:45.680758 16211 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a: loading cluster ID for follower catalog manager: success
I20260812 01:05:45.683138 16211 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a: acquiring CA information for follower catalog manager: success
I20260812 01:05:45.684995 16211 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 01:05:45.853343 15901 heartbeater.cc:503] Master 127.4.201.126:33537 was elected leader, sending a full tablet report...
W20260812 01:05:45.928355 16072 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:45.928611 16072 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:45.928707 16072 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:45.935815 16072 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:05:45.935913 16072 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:45.935966 16072 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:45.936020 16072 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:05:45.936062 16072 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:05:45.946236 16072 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:36783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:33537,127.4.201.125:46425,127.4.201.124:41233
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.124.keytab
--principal=oryx/127.4.201.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.124:41233
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.4.201.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:45.947844 16072 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:45.949529 16072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 01:05:45.955274 16062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:45.948419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:46425 (local address 127.0.0.1:45514)
0812 01:05:45.948601 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:45.948623 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:45.948764 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:45.949616 (+ 852us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:45.949621 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:45.949653 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:45.949889 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:45.949904 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:45.951315 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:45.951321 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:45.953268 (+ 1947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:45.953286 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:45.954463 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:45.954470 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:45.954664 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:45.954722 (+ 58us) client_negotiation.cc:769] Sending connection context
0812 01:05:45.954868 (+ 146us) client_negotiation.cc:240] Negotiation successful
0812 01:05:45.955002 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260812 01:05:45.955361 16218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:45.948683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45514 (local address 127.4.201.125:46425)
0812 01:05:45.949263 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:45.949267 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:45.949287 (+ 20us) server_negotiation.cc:407] Connection header received
0812 01:05:45.949350 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:45.949354 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:45.949427 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:45.949537 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:45.950044 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:45.951153 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:45.953419 (+ 2266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:45.954287 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:45.954387 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:45.954573 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:45.954890 (+ 317us) server_negotiation.cc:299] Negotiation successful
0812 01:05:45.954987 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":448,"thread_start_us":306,"threads_started":1}
I20260812 01:05:45.956482 16146 raft_consensus.cc:1203] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260812 01:05:45.957345 16191 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 081f650c09e54aa883c6738258615c15. Latest consensus state: current_term: 1 leader_uuid: "081f650c09e54aa883c6738258615c15" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: NON_VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: true } } }
I20260812 01:05:45.957595 16191 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [sys.catalog]: This master's current role is: LEARNER
W20260812 01:05:45.962414 16220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:45.962455 16227 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:45.962481 16221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:45.963267 16072 server_base.cc:1034] running on GCE node
I20260812 01:05:45.963977 16072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:45.965323 16072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:45.966531 16072 hybrid_clock.cc:648] HybridClock initialized: now 1786496745966472 us; error 49 us; skew 500 ppm
I20260812 01:05:45.966892 16072 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:45 dist-test-slave-bndk krb5kdc[15057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496745, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:45.970036 16072 init.cc:377] Logged in from keytab as oryx/127.4.201.124@KRBTEST.COM (short username oryx)
I20260812 01:05:45.971477 16072 webserver.cc:460] Webserver started at http://127.4.201.124:44473/ using document root <none> and password file <none>
I20260812 01:05:45.972105 16072 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:45.972208 16072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:45.972470 16072 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:45.975528 16072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-2/data/instance:
uuid: "ace92aa71c3f4ee89cc1be563b67418f"
format_stamp: "Formatted at 2026-08-12 01:05:45 on dist-test-slave-bndk"
server_key: "b6b40a335a5832affaf95a36e258484c"
server_key_iv: "e4889f3f0e40346339158e6c93913c22"
server_key_version: "encryptionkey@0"
I20260812 01:05:45.976316 16072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-2/wal/instance:
uuid: "ace92aa71c3f4ee89cc1be563b67418f"
format_stamp: "Formatted at 2026-08-12 01:05:45 on dist-test-slave-bndk"
server_key: "b6b40a335a5832affaf95a36e258484c"
server_key_iv: "e4889f3f0e40346339158e6c93913c22"
server_key_version: "encryptionkey@0"
I20260812 01:05:45.981544 16072 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260812 01:05:45.984838 16241 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:45.986174 16072 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:05:45.986322 16072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-2/wal
uuid: "ace92aa71c3f4ee89cc1be563b67418f"
format_stamp: "Formatted at 2026-08-12 01:05:45 on dist-test-slave-bndk"
server_key: "b6b40a335a5832affaf95a36e258484c"
server_key_iv: "e4889f3f0e40346339158e6c93913c22"
server_key_version: "encryptionkey@0"
I20260812 01:05:45.986485 16072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:46.006302 16072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:46.010349 16072 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:46.010596 16072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:46.028405 16072 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.124:41233
I20260812 01:05:46.028409 16317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.124:41233 every 8 connection(s)
I20260812 01:05:46.029822 16072 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-2/data/info.pb
I20260812 01:05:46.032068 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 16072
I20260812 01:05:46.033708 16318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:46.041496 16318 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 01:05:46 dist-test-slave-bndk krb5kdc[15057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496742, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.4.201.124@KRBTEST.COM
Aug 12 01:05:46 dist-test-slave-bndk krb5kdc[15057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496745, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.124@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM
I20260812 01:05:46.055717 16323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:46.034206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56754 (local address 127.4.201.124:41233)
0812 01:05:46.035042 (+ 836us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:46.035054 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:46.035096 (+ 42us) server_negotiation.cc:407] Connection header received
0812 01:05:46.036696 (+ 1600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:46.036719 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:46.037103 (+ 384us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:46.037525 (+ 422us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:46.039004 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.040289 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.041571 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.042249 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.042432 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:46.047473 (+ 5041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:46.047481 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:46.047494 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:46.047532 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:46.051051 (+ 3519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:46.051845 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:46.051854 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:46.051862 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:46.052123 (+ 261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:46.052600 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:46.052609 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:46.052613 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:46.053364 (+ 751us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:46.053618 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:46.054036 (+ 418us) server_negotiation.cc:299] Negotiation successful
0812 01:05:46.054395 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":614,"spinlock_wait_cycles":16768,"thread_start_us":394,"threads_started":1}
I20260812 01:05:46.059477 15903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:46.044129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36972 (local address 127.4.201.126:33537)
0812 01:05:46.044330 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:46.044336 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:46.044867 (+ 531us) server_negotiation.cc:407] Connection header received
0812 01:05:46.045035 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:46.045038 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:46.045102 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:46.045181 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:46.046489 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.047532 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.049481 (+ 1949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.049847 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.049998 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:46.053485 (+ 3487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:46.053492 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:46.053497 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:46.053537 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:46.056810 (+ 3273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:46.057572 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:46.057576 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:46.057579 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:46.057702 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:46.058062 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:46.058067 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:46.058070 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:46.058349 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:46.058482 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:46.058936 (+ 454us) server_negotiation.cc:299] Negotiation successful
0812 01:05:46.059150 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 01:05:46.059482 16325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:46.043938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.0.0.1:36972)
0812 01:05:46.044715 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:46.044768 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:46.044923 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:46.045291 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:46.045298 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:46.046097 (+ 799us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:46.046334 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:46.046345 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.047660 (+ 1315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.047665 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:46.049343 (+ 1678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:46.049359 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.050036 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.050043 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:46.050210 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:46.050772 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:46.050797 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:46.053311 (+ 2514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:46.056926 (+ 3615us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:46.056938 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:46.056945 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:46.057447 (+ 502us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:46.057805 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:46.057810 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:46.057812 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:46.057949 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:46.058467 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:46.058483 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:46.058633 (+ 150us) client_negotiation.cc:769] Sending connection context
0812 01:05:46.058784 (+ 151us) client_negotiation.cc:240] Negotiation successful
0812 01:05:46.059076 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":372,"threads_started":1}
I20260812 01:05:46.060806 16318 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 01:05:46 dist-test-slave-bndk krb5kdc[15057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496745, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.124@KRBTEST.COM for oryx/127.4.201.125@KRBTEST.COM
I20260812 01:05:46.072096 16325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:46.061398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:46425 (local address 127.0.0.1:45516)
0812 01:05:46.061582 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:46.061600 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:46.061692 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:46.061981 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:46.061984 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:46.062279 (+ 295us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:46.062402 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:46.062410 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.063304 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.063307 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:46.064179 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:46.064189 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.064898 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.064904 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:46.065057 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:46.065545 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:46.065561 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:46.067368 (+ 1807us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:46.070305 (+ 2937us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:46.070309 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:46.070311 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:46.070669 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:46.070963 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:46.070965 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:46.070968 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:46.071080 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:46.071496 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:46.071498 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:46.071605 (+ 107us) client_negotiation.cc:769] Sending connection context
0812 01:05:46.071700 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 01:05:46.071891 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260812 01:05:46.072167 16218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:46.061571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45516 (local address 127.4.201.125:46425)
0812 01:05:46.061745 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:46.061749 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:46.061765 (+ 16us) server_negotiation.cc:407] Connection header received
0812 01:05:46.061815 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:46.061819 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:46.061876 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:46.061955 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:46.062530 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.063202 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.064288 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.064762 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.064854 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:46.067545 (+ 2691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:46.067551 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:46.067554 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:46.067584 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:46.070203 (+ 2619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:46.070753 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:46.070756 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:46.070758 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:46.070888 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:46.071154 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:46.071156 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:46.071158 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:46.071408 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:46.071522 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:46.071768 (+ 246us) server_negotiation.cc:299] Negotiation successful
0812 01:05:46.071934 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 01:05:46.073045 16318 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.201.124" port: 41233 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 01:05:46 dist-test-slave-bndk krb5kdc[15057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496745, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.124@KRBTEST.COM for oryx/127.4.201.124@KRBTEST.COM
I20260812 01:05:46.084359 16325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:46.073801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:41233 (local address 127.0.0.1:56758)
0812 01:05:46.073970 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:46.073987 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:46.074084 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:46.074337 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:46.074341 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:46.074693 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:46.074818 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:46.074826 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.075819 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.075824 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:46.076719 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:46.076732 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.077397 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.077403 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:46.077609 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:46.078067 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:46.078083 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:46.079888 (+ 1805us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:46.082383 (+ 2495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:46.082387 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:46.082389 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:46.082729 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:46.083076 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:46.083079 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:46.083081 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:46.083222 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:46.083639 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:46.083642 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:46.083764 (+ 122us) client_negotiation.cc:769] Sending connection context
0812 01:05:46.083865 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 01:05:46.084043 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260812 01:05:46.084419 16323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:46.073758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56758 (local address 127.4.201.124:41233)
0812 01:05:46.073923 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:46.073929 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:46.074045 (+ 116us) server_negotiation.cc:407] Connection header received
0812 01:05:46.074179 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:46.074184 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:46.074235 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:46.074308 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:46.074944 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.075700 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.076844 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.077254 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.077364 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:46.080050 (+ 2686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:46.080055 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:46.080058 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:46.080085 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:46.082263 (+ 2178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:46.082826 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:46.082830 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:46.082832 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:46.082975 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:46.083307 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:46.083310 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:46.083312 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:46.083550 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:46.083652 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:46.083945 (+ 293us) server_negotiation.cc:299] Negotiation successful
0812 01:05:46.084168 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":46}
I20260812 01:05:46.089071 16318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f: Bootstrap starting.
I20260812 01:05:46.092279 16318 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:46.093319 16318 log.cc:824] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:46.095849 16318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f: No bootstrap required, opened a new log
I20260812 01:05:46.103008 16318 raft_consensus.cc:348] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 41233 } }
I20260812 01:05:46.103307 16318 raft_consensus.cc:374] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:46.103417 16318 raft_consensus.cc:729] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ace92aa71c3f4ee89cc1be563b67418f, State: Initialized, Role: FOLLOWER
I20260812 01:05:46.103968 16318 consensus_queue.cc:260] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 41233 } }
I20260812 01:05:46.104948 16329 sys_catalog.cc:455] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 41233 } } }
I20260812 01:05:46.105383 16329 sys_catalog.cc:458] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:05:46.106062 16318 sys_catalog.cc:564] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [sys.catalog]: configured and running, proceeding with master startup.
W20260812 01:05:46.114730 16359 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 01:05:46.114863 16359 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 01:05:46.120728 16072 master_runner.cc:428] Detected that this master ace92aa71c3f4ee89cc1be563b67418f is joining an existing cluster
I20260812 01:05:46.120841 16072 master_runner.cc:432] Initiating AddMaster RPC to add 127.4.201.124:41233
I20260812 01:05:46.143116 16323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:46.125616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56766 (local address 127.4.201.124:41233)
0812 01:05:46.125790 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:46.125796 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:46.127710 (+ 1914us) server_negotiation.cc:407] Connection header received
0812 01:05:46.128164 (+ 454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:46.128168 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:46.128237 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:46.128311 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:46.129793 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.130857 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.132790 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.133475 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.133571 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:46.136129 (+ 2558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:46.136135 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:46.136139 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:46.136172 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:46.139680 (+ 3508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:46.140707 (+ 1027us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:46.140713 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:46.140716 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:46.140868 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:46.141318 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:46.141325 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:46.141328 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:46.141798 (+ 470us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:46.141911 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:46.142501 (+ 590us) server_negotiation.cc:299] Negotiation successful
0812 01:05:46.142716 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":59,"spinlock_wait_cycles":40832}
I20260812 01:05:46.143545 16218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:46.125045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45526 (local address 127.4.201.125:46425)
0812 01:05:46.125208 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:46.125234 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:46.126509 (+ 1275us) server_negotiation.cc:407] Connection header received
0812 01:05:46.127063 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:46.127069 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:46.127147 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:46.127214 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:46.129407 (+ 2193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.130494 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.132643 (+ 2149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.133316 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.133419 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:46.136326 (+ 2907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:46.136333 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:46.136337 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:46.136375 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:46.140039 (+ 3664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:46.140902 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:46.140907 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:46.140911 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:46.141077 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:46.141622 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:46.141628 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:46.141631 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:46.141971 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:46.142095 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:46.142918 (+ 823us) server_negotiation.cc:299] Negotiation successful
0812 01:05:46.143157 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 01:05:46.143971 15903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:46.124866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36974 (local address 127.4.201.126:33537)
0812 01:05:46.125271 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:46.125276 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:46.127023 (+ 1747us) server_negotiation.cc:407] Connection header received
0812 01:05:46.127263 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:46.127269 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:46.127351 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:46.127464 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:46.128967 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.130067 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.132179 (+ 2112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.132819 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.132907 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:46.135615 (+ 2708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:46.135622 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:46.135628 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:46.135667 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:46.140261 (+ 4594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:46.141017 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:46.141022 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:46.141025 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:46.141169 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:46.141663 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:46.141668 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:46.141672 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:46.142004 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:46.142145 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:46.142857 (+ 712us) server_negotiation.cc:299] Negotiation successful
0812 01:05:46.143065 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251}
I20260812 01:05:46.144098 16371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:46.125706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:41233 (local address 127.0.0.1:56766)
0812 01:05:46.127615 (+ 1909us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:46.127638 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:46.127785 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:46.128509 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:46.128512 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:46.129297 (+ 785us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:46.129648 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:46.129662 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.131084 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.131089 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:46.132656 (+ 1567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:46.132671 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.133866 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.133876 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:46.134105 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:46.134663 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:46.134704 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:46.135927 (+ 1223us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:46.139819 (+ 3892us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:46.139824 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:46.139832 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:46.140595 (+ 763us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:46.141013 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:46.141017 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:46.141020 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:46.141169 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:46.142004 (+ 835us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:46.142008 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:46.142151 (+ 143us) client_negotiation.cc:769] Sending connection context
0812 01:05:46.143371 (+ 1220us) client_negotiation.cc:240] Negotiation successful
0812 01:05:46.143658 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1775,"mutex_wait_us":40,"thread_start_us":418,"threads_started":1}
I20260812 01:05:46.145311 16368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:46.125668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.0.0.1:36974)
0812 01:05:46.126935 (+ 1267us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:46.126952 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:46.127119 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:46.127518 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:46.127523 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:46.128324 (+ 801us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:46.128766 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:46.128779 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.130254 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.130258 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:46.132009 (+ 1751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:46.132025 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.133171 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.133177 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:46.133393 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:46.134105 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:46.134132 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:46.135381 (+ 1249us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:46.140379 (+ 4998us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:46.140384 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:46.140388 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:46.140889 (+ 501us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:46.141345 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:46.141349 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:46.141351 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:46.141524 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:46.142244 (+ 720us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:46.142248 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:46.142568 (+ 320us) client_negotiation.cc:769] Sending connection context
0812 01:05:46.144742 (+ 2174us) client_negotiation.cc:240] Negotiation successful
0812 01:05:46.144980 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1059,"mutex_wait_us":23,"thread_start_us":1140,"threads_started":1}
I20260812 01:05:46.145943 16370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:46.125359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:46425 (local address 127.0.0.1:45526)
0812 01:05:46.126400 (+ 1041us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:46.126423 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:46.126863 (+ 440us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:46.127950 (+ 1087us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:46.127954 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:46.128824 (+ 870us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:46.129197 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:46.129210 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.130723 (+ 1513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.130729 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:46.132460 (+ 1731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:46.132476 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.133752 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.133758 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:46.133963 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:46.134799 (+ 836us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:46.134821 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:46.136116 (+ 1295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:46.140190 (+ 4074us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:46.140195 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:46.140199 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:46.140754 (+ 555us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:46.141259 (+ 505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:46.141263 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:46.141267 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:46.141469 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:46.142201 (+ 732us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:46.142206 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:46.142566 (+ 360us) client_negotiation.cc:769] Sending connection context
0812 01:05:46.143844 (+ 1278us) client_negotiation.cc:240] Negotiation successful
0812 01:05:46.144182 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":902,"mutex_wait_us":69,"spinlock_wait_cycles":3328,"thread_start_us":1175,"threads_started":1}
Aug 12 01:05:46 dist-test-slave-bndk krb5kdc[15057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496743, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.126@KRBTEST.COM for oryx/127.4.201.124@KRBTEST.COM
I20260812 01:05:46.161476 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 15237
I20260812 01:05:46.162729 16062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:46.150447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:41233 (local address 127.0.0.1:56782)
0812 01:05:46.150633 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:46.150648 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:46.150732 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:46.151202 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:46.151207 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:46.151603 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:46.151757 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:46.151766 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.152827 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.152833 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:46.153827 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:46.153840 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.154546 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.154552 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:46.154724 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:46.155208 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:46.155223 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:46.157395 (+ 2172us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:46.160469 (+ 3074us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:46.160474 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:46.160478 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:46.160817 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:46.161187 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:46.161192 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:46.161196 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:46.161362 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:46.161891 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:46.161896 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:46.162066 (+ 170us) client_negotiation.cc:769] Sending connection context
0812 01:05:46.162211 (+ 145us) client_negotiation.cc:240] Negotiation successful
0812 01:05:46.162476 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260812 01:05:46.163523 16323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:46.150449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56782 (local address 127.4.201.124:41233)
0812 01:05:46.150886 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:46.150890 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:46.150903 (+ 13us) server_negotiation.cc:407] Connection header received
0812 01:05:46.151005 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:46.151008 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:46.151067 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:46.151145 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:46.151895 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.152700 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.153984 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.154408 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.154512 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:46.157573 (+ 3061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:46.157578 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:46.157581 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:46.157609 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:46.160303 (+ 2694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:46.160927 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:46.160933 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:46.160936 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:46.161080 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:46.161466 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:46.161479 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:46.161483 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:46.161777 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:46.161909 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:46.163064 (+ 1155us) server_negotiation.cc:299] Negotiation successful
0812 01:05:46.163227 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348}
I20260812 01:05:46.164904 15132 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.4.201.124:41233: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f"
member_type: NON_VOTER
last_known_addr {
host: "127.4.201.124"
port: 41233
}
attrs {
promote: true
}
}
dest_uuid: "081f650c09e54aa883c6738258615c15"
cas_config_opid_index: 5
I20260812 01:05:46.166085 15132 consensus_queue.cc:237] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: NON_VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: true } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: NON_VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: true } }
I20260812 01:05:46.167817 16067 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER ace92aa71c3f4ee89cc1be563b67418f (127.4.201.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: NON_VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: true } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: NON_VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: true } } }
I20260812 01:05:46.172679 16279 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [term 0 FOLLOWER]: Advancing to term 1
Aug 12 01:05:46 dist-test-slave-bndk krb5kdc[15057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496742, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.4.201.65@KRBTEST.COM
I20260812 01:05:46.176772 16279 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [term 1 FOLLOWER]: Refusing update from remote peer 081f650c09e54aa883c6738258615c15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 01:05:46.183243 16372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:46.163043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55856 (local address 127.4.201.65:36613)
0812 01:05:46.163960 (+ 917us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:46.163968 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:46.163998 (+ 30us) server_negotiation.cc:407] Connection header received
0812 01:05:46.164064 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:46.164071 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:46.164288 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:46.164455 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:46.165915 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.167157 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.168807 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.169492 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.169609 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:46.174627 (+ 5018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:46.174646 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:46.174666 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:46.174707 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:46.178702 (+ 3995us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:46.179653 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:46.179664 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:46.179668 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:46.179839 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:46.180353 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:46.180358 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:46.180362 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:46.180829 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:46.182320 (+ 1491us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:46.182517 (+ 197us) server_negotiation.cc:299] Negotiation successful
0812 01:05:46.182798 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":726,"thread_start_us":333,"threads_started":1}
I20260812 01:05:46.184985 15452 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:46.189872 16373 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: NON_VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:46.190732 16146 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [term 1 LEARNER]: Refusing update from remote peer 081f650c09e54aa883c6738258615c15: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 01:05:46.191527 16067 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.4.201.124:41233
I20260812 01:05:46.196938 16072 master.cc:537] Master@127.4.201.124:41233 shutting down...
I20260812 01:05:46.200400 16373 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: NON_VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 01:05:46.201606 16378 sys_catalog.cc:455] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "081f650c09e54aa883c6738258615c15" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: NON_VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: true } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: NON_VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: true } } }
I20260812 01:05:46.202000 16378 sys_catalog.cc:458] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:46.215554 16146 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER ace92aa71c3f4ee89cc1be563b67418f (127.4.201.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: NON_VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: true } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: NON_VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: true } } }
I20260812 01:05:46.220217 16191 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "081f650c09e54aa883c6738258615c15" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: NON_VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: true } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: NON_VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: true } } }
I20260812 01:05:46.220504 16191 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [sys.catalog]: This master's current role is: LEARNER
I20260812 01:05:46.220769 16279 raft_consensus.cc:858] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 41233 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: NON_VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: NON_VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: true } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: NON_VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: true } }
W20260812 01:05:46.221462 16279 raft_consensus.cc:1565] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 41233 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: NON_VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: NON_VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: true } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: NON_VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: true } }
I20260812 01:05:46.221678 16378 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15: attempting to promote NON_VOTER e1c5c0b2488d4caa9a7c97fa81dbb68a to VOTER
I20260812 01:05:46.222470 16378 consensus_queue.cc:237] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: NON_VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: true } }
I20260812 01:05:46.225584 16146 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [term 1 LEARNER]: Refusing update from remote peer 081f650c09e54aa883c6738258615c15: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260812 01:05:46.226158 16067 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 01:05:46.228663 16373 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, e1c5c0b2488d4caa9a7c97fa81dbb68a (127.4.201.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: NON_VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: true } } }
I20260812 01:05:46.229203 16143 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, e1c5c0b2488d4caa9a7c97fa81dbb68a (127.4.201.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: NON_VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: true } } }
I20260812 01:05:46.232790 16373 sys_catalog.cc:455] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "081f650c09e54aa883c6738258615c15" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: NON_VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: true } } }
I20260812 01:05:46.233049 16373 sys_catalog.cc:458] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:46.233309 16378 sys_catalog.cc:455] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "081f650c09e54aa883c6738258615c15" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: NON_VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: true } } }
I20260812 01:05:46.233599 16378 sys_catalog.cc:458] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:46.234054 16191 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "081f650c09e54aa883c6738258615c15" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: NON_VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: true } } }
I20260812 01:05:46.234297 16191 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [sys.catalog]: This master's current role is: FOLLOWER
W20260812 01:05:46.243211 15111 consensus_peers.cc:487] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 -> Peer ace92aa71c3f4ee89cc1be563b67418f (127.4.201.124:41233): Couldn't send request to peer ace92aa71c3f4ee89cc1be563b67418f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 01:05:46.246240 16279 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER e1c5c0b2488d4caa9a7c97fa81dbb68a (127.4.201.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: NON_VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: true } } }
I20260812 01:05:46.266042 16393 sys_catalog.cc:455] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "081f650c09e54aa883c6738258615c15" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: NON_VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: true } } }
I20260812 01:05:46.266649 16393 sys_catalog.cc:458] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260812 01:05:46.267005 16329 sys_catalog.cc:455] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 081f650c09e54aa883c6738258615c15. Latest consensus state: current_term: 1 leader_uuid: "081f650c09e54aa883c6738258615c15" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: NON_VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: true } } }
I20260812 01:05:46.267266 16329 sys_catalog.cc:458] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260812 01:05:46.267076 16385 sys_catalog.cc:455] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "081f650c09e54aa883c6738258615c15" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: NON_VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: true } } }
I20260812 01:05:46.267458 16385 sys_catalog.cc:458] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260812 01:05:46.270341 16072 raft_consensus.cc:2229] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260812 01:05:46.270816 16072 raft_consensus.cc:2258] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260812 01:05:46.271003 16072 tablet_replica.cc:330] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f: stopping tablet replica
I20260812 01:05:46.279083 16072 master.cc:552] Master@127.4.201.124:41233 shutdown complete.
I20260812 01:05:46.279170 16072 master_runner.cc:305] Clearing existing system tablet
I20260812 01:05:46.279592 16072 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:46.279707 16072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:46.282697 16072 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 01:05:46.284416 16396 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:46.284781 16072 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:46.285198 16072 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260812 01:05:46.285386 16072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-2/wal
uuid: "ace92aa71c3f4ee89cc1be563b67418f"
format_stamp: "Formatted at 2026-08-12 01:05:45 on dist-test-slave-bndk"
server_key: "b6b40a335a5832affaf95a36e258484c"
server_key_iv: "e4889f3f0e40346339158e6c93913c22"
server_key_version: "encryptionkey@0"
I20260812 01:05:46.290557 16072 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:46.297643 16072 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 01:05:46.297887 16072 log.cc:1196] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260812 01:05:46.298492 16072 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f: Deleting consensus metadata
I20260812 01:05:46.298803 16072 master_runner.cc:315] Copying system tablet from 127.4.201.126:33537
I20260812 01:05:46.301609 16072 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.201.126:33537
I20260812 01:05:46.316388 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 15237
I20260812 01:05:46.321816 15903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:46.305807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36988 (local address 127.4.201.126:33537)
0812 01:05:46.306057 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:46.306063 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:46.306604 (+ 541us) server_negotiation.cc:407] Connection header received
0812 01:05:46.306885 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:46.306891 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:46.306974 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:46.307046 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:46.308292 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.309538 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.311453 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.312137 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.312243 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:46.314829 (+ 2586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:46.314835 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:46.314840 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:46.314879 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:46.318374 (+ 3495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:46.319176 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:46.319183 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:46.319187 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:46.319346 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:46.319820 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:46.319825 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:46.319829 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:46.320185 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:46.320308 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:46.320999 (+ 691us) server_negotiation.cc:299] Negotiation successful
0812 01:05:46.321375 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260812 01:05:46.322986 16410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:46.303344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.0.0.1:36988)
0812 01:05:46.306482 (+ 3138us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:46.306508 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:46.306725 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:46.307291 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:46.307296 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:46.307862 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:46.308111 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:46.308125 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.309739 (+ 1614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.309745 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:46.311269 (+ 1524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:46.311286 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.312517 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.312523 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:46.312713 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:46.313459 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:46.313490 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:46.314601 (+ 1111us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:46.318548 (+ 3947us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:46.318554 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:46.318558 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:46.319039 (+ 481us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:46.319503 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:46.319508 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:46.319512 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:46.319683 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:46.320448 (+ 765us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:46.320453 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:46.320682 (+ 229us) client_negotiation.cc:769] Sending connection context
0812 01:05:46.322127 (+ 1445us) client_negotiation.cc:240] Negotiation successful
0812 01:05:46.322529 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2990,"thread_start_us":2852,"threads_started":1}
I20260812 01:05:46.323597 15162 tablet_copy_service.cc:140] P 081f650c09e54aa883c6738258615c15: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer ace92aa71c3f4ee89cc1be563b67418f ({username='oryx', principal='oryx/127.4.201.124@KRBTEST.COM'} at 127.0.0.1:36988)
I20260812 01:05:46.323814 15162 tablet_copy_service.cc:161] P 081f650c09e54aa883c6738258615c15: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer ace92aa71c3f4ee89cc1be563b67418f at {username='oryx', principal='oryx/127.4.201.124@KRBTEST.COM'} at 127.0.0.1:36988: session id = ace92aa71c3f4ee89cc1be563b67418f-00000000000000000000000000000000
I20260812 01:05:46.327491 15162 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 01:05:46.329541 16072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 01:05:46.336026 16072 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f: tablet copy: Starting download of 0 data blocks...
I20260812 01:05:46.336311 16072 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f: tablet copy: Starting download of 1 WAL segments...
I20260812 01:05:46.338654 16072 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 01:05:46.342947 15162 tablet_copy_service.cc:342] P 081f650c09e54aa883c6738258615c15: Request end of tablet copy session ace92aa71c3f4ee89cc1be563b67418f-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.4.201.124@KRBTEST.COM'} at 127.0.0.1:36988
I20260812 01:05:46.343093 15162 tablet_copy_service.cc:433] P 081f650c09e54aa883c6738258615c15: ending tablet copy session ace92aa71c3f4ee89cc1be563b67418f-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer ace92aa71c3f4ee89cc1be563b67418f
I20260812 01:05:46.349932 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:36613
--local_ip_for_outbound_sockets=127.4.201.65
--tserver_master_addrs=127.4.201.126:33537
--webserver_port=38571
--webserver_interface=127.4.201.65
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.65.keytab
--principal=oryx/127.4.201.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:36783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.4.201.126:33537,127.4.201.125:46425
--tserver_master_addrs=127.4.201.126:33537,127.4.201.125:46425,127.4.201.124:41233 with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:05:46.353587 16072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:46.356208 16411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:46.361191 16413 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:46.374907 16418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:46.375716 16072 server_base.cc:1034] running on GCE node
I20260812 01:05:46.376093 16072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:46.376840 16072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:46.378038 16072 hybrid_clock.cc:648] HybridClock initialized: now 1786496746377988 us; error 40 us; skew 500 ppm
I20260812 01:05:46.378284 16072 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:46 dist-test-slave-bndk krb5kdc[15057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496746, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:46.380533 16072 init.cc:377] Logged in from keytab as oryx/127.4.201.124@KRBTEST.COM (short username oryx)
I20260812 01:05:46.386273 16072 webserver.cc:460] Webserver started at http://127.4.201.124:39175/ using document root <none> and password file <none>
I20260812 01:05:46.386628 16072 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:46.386744 16072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:46.389922 16072 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260812 01:05:46.391963 16430 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:46.392382 16072 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260812 01:05:46.392537 16072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-2/wal
uuid: "ace92aa71c3f4ee89cc1be563b67418f"
format_stamp: "Formatted at 2026-08-12 01:05:45 on dist-test-slave-bndk"
server_key: "b6b40a335a5832affaf95a36e258484c"
server_key_iv: "e4889f3f0e40346339158e6c93913c22"
server_key_version: "encryptionkey@0"
I20260812 01:05:46.392765 16072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:46.408924 16072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:46.413057 16072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:46.437747 16072 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.124:41233
I20260812 01:05:46.437793 16535 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.124:41233 every 8 connection(s)
I20260812 01:05:46.438833 16072 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/master-2/data/info.pb
I20260812 01:05:46.444212 16536 sys_catalog.cc:263] Verifying existing consensus state
I20260812 01:05:46.448014 16536 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f: Bootstrap starting.
I20260812 01:05:46.464468 16536 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 01:05:46.465072 16536 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f: Bootstrap complete.
I20260812 01:05:46.466390 16536 raft_consensus.cc:348] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: NON_VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: true } }
I20260812 01:05:46.466738 16536 raft_consensus.cc:729] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ace92aa71c3f4ee89cc1be563b67418f, State: Initialized, Role: LEARNER
I20260812 01:05:46.467015 16536 consensus_queue.cc:260] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: NON_VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: true } }
I20260812 01:05:46.467959 16540 sys_catalog.cc:455] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: NON_VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: true } } }
I20260812 01:05:46.468410 16536 sys_catalog.cc:564] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:05:46.468475 16540 sys_catalog.cc:458] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [sys.catalog]: This master's current role is: LEARNER
I20260812 01:05:46.479717 16561 catalog_manager.cc:1259] Loaded cluster ID: 72fc76d9a85b4758a0868c4aac8aad14
I20260812 01:05:46.479799 16561 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f: loading cluster ID for follower catalog manager: success
I20260812 01:05:46.482260 16561 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f: acquiring CA information for follower catalog manager: success
I20260812 01:05:46.484112 16561 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 01:05:46.737397 16414 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:46.737691 16414 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:46.737831 16414 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:46.745281 16414 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:46.745404 16414 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:46.745607 16414 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:05:46.755793 16414 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:36783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.65.keytab
--principal=oryx/127.4.201.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:36613
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=38571
--tserver_master_addrs=127.4.201.126:33537,127.4.201.125:46425,127.4.201.124:41233
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:46.757194 16414 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:46.758566 16414 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:46.771731 16572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:46.771762 16583 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:46.771944 16570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:46.772876 16414 server_base.cc:1034] running on GCE node
I20260812 01:05:46.773540 16414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:46.774508 16414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:46.775718 16414 hybrid_clock.cc:648] HybridClock initialized: now 1786496746775648 us; error 46 us; skew 500 ppm
I20260812 01:05:46.776031 16414 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:46 dist-test-slave-bndk krb5kdc[15057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496746, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:46.779228 16414 init.cc:377] Logged in from keytab as oryx/127.4.201.65@KRBTEST.COM (short username oryx)
I20260812 01:05:46.780563 16414 webserver.cc:460] Webserver started at http://127.4.201.65:38571/ using document root <none> and password file <none>
I20260812 01:05:46.781293 16414 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:46.781431 16414 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:46.786573 16414 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260812 01:05:46.789238 16597 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:46.790481 16414 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 01:05:46.790632 16414 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "0d9da262268f431ab7801aeae643ef8e"
format_stamp: "Formatted at 2026-08-12 01:05:43 on dist-test-slave-bndk"
server_key: "62bf5cec2088c09b952e880bdb0d1296"
server_key_iv: "5209c3ae350f1f21147f50a6c2bf4e5a"
server_key_version: "encryptionkey@0"
I20260812 01:05:46.791613 16414 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:46.805780 16612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:46.799444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:41233 (local address 127.0.0.1:41098)
0812 01:05:46.799877 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:46.799898 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:46.800040 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:46.800445 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:46.800447 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:46.800467 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:46.800631 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:46.800638 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.802304 (+ 1666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.802308 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:46.803535 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:46.803549 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.805093 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.805097 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:46.805279 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:46.805314 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 01:05:46.805406 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 01:05:46.805544 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":192,"threads_started":1}
I20260812 01:05:46.805935 16614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:46.799536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41098 (local address 127.4.201.124:41233)
0812 01:05:46.800125 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:46.800131 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:46.800152 (+ 21us) server_negotiation.cc:407] Connection header received
0812 01:05:46.800227 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:46.800232 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:46.800315 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:46.800423 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:46.800747 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.802185 (+ 1438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.803667 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.804934 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.805060 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:46.805301 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:46.805505 (+ 204us) server_negotiation.cc:299] Negotiation successful
0812 01:05:46.805641 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":327,"threads_started":1}
I20260812 01:05:46.806716 16478 raft_consensus.cc:1203] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260812 01:05:46.807097 16540 sys_catalog.cc:455] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 081f650c09e54aa883c6738258615c15. Latest consensus state: current_term: 1 leader_uuid: "081f650c09e54aa883c6738258615c15" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: NON_VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: true } } }
I20260812 01:05:46.807379 16540 sys_catalog.cc:458] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [sys.catalog]: This master's current role is: LEARNER
I20260812 01:05:46.810987 16414 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:46.814662 16414 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:46.814900 16414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:46.815821 16414 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:05:46.817236 16414 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:46.817329 16414 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:46.817437 16414 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:46.817515 16414 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:46.850158 16414 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:36613
I20260812 01:05:46.850219 16822 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:36613 every 8 connection(s)
I20260812 01:05:46.851662 16414 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:05:46.859776 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 16414
I20260812 01:05:46.860210 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 15467
Aug 12 01:05:46 dist-test-slave-bndk krb5kdc[15057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496746, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.125@KRBTEST.COM
Aug 12 01:05:46 dist-test-slave-bndk krb5kdc[15057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496746, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM
Aug 12 01:05:46 dist-test-slave-bndk krb5kdc[15057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496742, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.4.201.66@KRBTEST.COM
Aug 12 01:05:46 dist-test-slave-bndk krb5kdc[15057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496746, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.124@KRBTEST.COM
I20260812 01:05:46.884269 16830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:46.854893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:42581 (local address 127.4.201.126:33537)
0812 01:05:46.855319 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:46.855325 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:46.865341 (+ 10016us) server_negotiation.cc:407] Connection header received
0812 01:05:46.865622 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:46.865628 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:46.865709 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:46.865791 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:46.867316 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.868457 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.870535 (+ 2078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.871148 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.871237 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:46.876403 (+ 5166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:46.876410 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:46.876439 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:46.876481 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:46.880207 (+ 3726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:46.881188 (+ 981us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:46.881194 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:46.881197 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:46.881384 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:46.882263 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:46.882268 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:46.882272 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:46.882617 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:46.882764 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:46.883642 (+ 878us) server_negotiation.cc:299] Negotiation successful
0812 01:05:46.883869 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":206,"threads_started":1}
I20260812 01:05:46.884814 16614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:46.855018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:58979 (local address 127.4.201.124:41233)
0812 01:05:46.855205 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:46.855211 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:46.860611 (+ 5400us) server_negotiation.cc:407] Connection header received
0812 01:05:46.863529 (+ 2918us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:46.863535 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:46.863619 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:46.863714 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:46.866413 (+ 2699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.867535 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.870320 (+ 2785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.870941 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.871039 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:46.878423 (+ 7384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:46.878430 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:46.878434 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:46.878477 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:46.881774 (+ 3297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:46.882575 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:46.882580 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:46.882584 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:46.882768 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:46.883212 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:46.883217 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:46.883220 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:46.883562 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:46.883681 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:46.884196 (+ 515us) server_negotiation.cc:299] Negotiation successful
0812 01:05:46.884429 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260812 01:05:46.885076 16835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:46.861203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57690 (local address 127.4.201.66:40883)
0812 01:05:46.862341 (+ 1138us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:46.862347 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:46.862370 (+ 23us) server_negotiation.cc:407] Connection header received
0812 01:05:46.862425 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:46.862430 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:46.862614 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:46.862751 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:46.864855 (+ 2104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.866426 (+ 1571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.868375 (+ 1949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.869656 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.874543 (+ 4887us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:46.876896 (+ 2353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:46.876912 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:46.876929 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:46.876980 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:46.881250 (+ 4270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:46.882075 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:46.882084 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:46.882087 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:46.882221 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:46.882593 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:46.882599 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:46.882602 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:46.883009 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:46.883309 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:46.884429 (+ 1120us) server_negotiation.cc:299] Negotiation successful
0812 01:05:46.884685 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":991,"thread_start_us":821,"threads_started":1}
I20260812 01:05:46.885671 16832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:46.855910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.4.201.65:42581)
0812 01:05:46.865240 (+ 9330us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:46.865257 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:46.865453 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:46.866145 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:46.866149 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:46.866760 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:46.867109 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:46.867123 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.868685 (+ 1562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.868690 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:46.870386 (+ 1696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:46.870399 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.871548 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.871556 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:46.871884 (+ 328us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:46.872686 (+ 802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:46.872709 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:46.876180 (+ 3471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:46.880544 (+ 4364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:46.880548 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:46.880552 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:46.881055 (+ 503us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:46.881518 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:46.881523 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:46.881526 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:46.881702 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:46.882753 (+ 1051us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:46.882761 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:46.883203 (+ 442us) client_negotiation.cc:769] Sending connection context
0812 01:05:46.883525 (+ 322us) client_negotiation.cc:240] Negotiation successful
0812 01:05:46.884035 (+ 510us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9180,"mutex_wait_us":215,"spinlock_wait_cycles":8448,"thread_start_us":8880,"threads_started":1}
I20260812 01:05:46.885812 16833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:46.855901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:41233 (local address 127.4.201.65:58979)
0812 01:05:46.860500 (+ 4599us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:46.860518 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:46.863090 (+ 2572us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:46.864147 (+ 1057us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:46.864160 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:46.865150 (+ 990us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:46.866205 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:46.866224 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.867768 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.867774 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:46.870150 (+ 2376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:46.870164 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.871427 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.871437 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:46.871900 (+ 463us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:46.872674 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:46.872715 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:46.878206 (+ 5491us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:46.881919 (+ 3713us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:46.881924 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:46.881927 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:46.882424 (+ 497us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:46.882895 (+ 471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:46.882899 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:46.882902 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:46.883069 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:46.883760 (+ 691us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:46.883764 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:46.883904 (+ 140us) client_negotiation.cc:769] Sending connection context
0812 01:05:46.885059 (+ 1155us) client_negotiation.cc:240] Negotiation successful
0812 01:05:46.885355 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4425,"mutex_wait_us":212,"spinlock_wait_cycles":89472,"thread_start_us":3075,"threads_started":1}
I20260812 01:05:46.886282 16829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:46.854496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:50121 (local address 127.4.201.125:46425)
0812 01:05:46.855236 (+ 740us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:46.857946 (+ 2710us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:46.858746 (+ 800us) server_negotiation.cc:407] Connection header received
0812 01:05:46.863439 (+ 4693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:46.863446 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:46.863566 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:46.863671 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:46.866715 (+ 3044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.867959 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.870329 (+ 2370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.870932 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.871040 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:46.875946 (+ 4906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:46.875953 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:46.875958 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:46.876010 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:46.879615 (+ 3605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:46.880550 (+ 935us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:46.880555 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:46.880559 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:46.880706 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:46.881657 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:46.881662 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:46.881665 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:46.882055 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:46.882189 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:46.885090 (+ 2901us) server_negotiation.cc:299] Negotiation successful
0812 01:05:46.885503 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":266,"threads_started":1}
I20260812 01:05:46.886659 15670 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:46.887246 16831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:46.855901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:46425 (local address 127.4.201.65:50121)
0812 01:05:46.858602 (+ 2701us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:46.858648 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:46.863083 (+ 4435us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:46.864148 (+ 1065us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:46.864160 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:46.865406 (+ 1246us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:46.866179 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:46.866208 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.868182 (+ 1974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.868187 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:46.870158 (+ 1971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:46.870173 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:46.871429 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:46.871437 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:46.871891 (+ 454us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:46.872818 (+ 927us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:46.872836 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:46.875677 (+ 2841us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:46.879784 (+ 4107us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:46.879793 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:46.879811 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:46.880399 (+ 588us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:46.880856 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:46.880861 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:46.880865 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:46.881509 (+ 644us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:46.882847 (+ 1338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:46.882852 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:46.883206 (+ 354us) client_negotiation.cc:769] Sending connection context
0812 01:05:46.886545 (+ 3339us) client_negotiation.cc:240] Negotiation successful
0812 01:05:46.886817 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2405,"mutex_wait_us":217,"spinlock_wait_cycles":50048,"thread_start_us":2177,"threads_started":1}
I20260812 01:05:46.887514 16824 heartbeater.cc:347] Connected to a master server at 127.4.201.126:33537
I20260812 01:05:46.887480 16823 heartbeater.cc:347] Connected to a master server at 127.4.201.124:41233
I20260812 01:05:46.887825 16824 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:46.887832 16823 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:46.888267 16825 heartbeater.cc:347] Connected to a master server at 127.4.201.125:46425
I20260812 01:05:46.888403 16825 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:46.888859 16823 heartbeater.cc:511] Master 127.4.201.124:41233 requested a full tablet report, sending...
I20260812 01:05:46.888882 16825 heartbeater.cc:511] Master 127.4.201.125:46425 requested a full tablet report, sending...
I20260812 01:05:46.889533 16824 heartbeater.cc:511] Master 127.4.201.126:33537 requested a full tablet report, sending...
I20260812 01:05:46.890825 15132 ts_manager.cc:194] Re-registered known tserver with Master: 0d9da262268f431ab7801aeae643ef8e (127.4.201.65:36613)
I20260812 01:05:46.891538 16457 ts_manager.cc:194] Registered new tserver with Master: 0d9da262268f431ab7801aeae643ef8e (127.4.201.65:36613)
I20260812 01:05:46.891918 15132 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.201.65@KRBTEST.COM'} at 127.4.201.65:42581
I20260812 01:05:46.893460 16125 ts_manager.cc:194] Registered new tserver with Master: 0d9da262268f431ab7801aeae643ef8e (127.4.201.65:36613)
I20260812 01:05:46.980027 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 15467
I20260812 01:05:47.005959 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:40883
--local_ip_for_outbound_sockets=127.4.201.66
--tserver_master_addrs=127.4.201.126:33537
--webserver_port=34151
--webserver_interface=127.4.201.66
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.66.keytab
--principal=oryx/127.4.201.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:36783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.4.201.126:33537,127.4.201.125:46425
--tserver_master_addrs=127.4.201.126:33537,127.4.201.125:46425,127.4.201.124:41233 with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:05:47.258018 16609 sys_catalog.cc:455] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "081f650c09e54aa883c6738258615c15" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: NON_VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: true } } }
I20260812 01:05:47.258450 16609 sys_catalog.cc:458] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:47.259955 16839 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15: attempting to promote NON_VOTER ace92aa71c3f4ee89cc1be563b67418f to VOTER
I20260812 01:05:47.260702 16839 consensus_queue.cc:237] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: false } }
I20260812 01:05:47.263062 16478 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [term 1 LEARNER]: Refusing update from remote peer 081f650c09e54aa883c6738258615c15: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260812 01:05:47.263195 16146 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [term 1 FOLLOWER]: Refusing update from remote peer 081f650c09e54aa883c6738258615c15: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260812 01:05:47.263679 16609 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 01:05:47.264111 16838 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 01:05:47.267100 16609 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, ace92aa71c3f4ee89cc1be563b67418f (127.4.201.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: false } } }
I20260812 01:05:47.267984 16478 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, ace92aa71c3f4ee89cc1be563b67418f (127.4.201.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: false } } }
I20260812 01:05:47.270164 16609 sys_catalog.cc:455] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "081f650c09e54aa883c6738258615c15" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: false } } }
I20260812 01:05:47.270354 16609 sys_catalog.cc:458] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:47.270623 16609 sys_catalog.cc:455] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "081f650c09e54aa883c6738258615c15" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: false } } }
I20260812 01:05:47.270787 16609 sys_catalog.cc:458] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:47.271646 16609 sys_catalog.cc:455] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "081f650c09e54aa883c6738258615c15" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: false } } }
I20260812 01:05:47.271854 16609 sys_catalog.cc:458] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15 [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:47.272033 16540 sys_catalog.cc:455] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "081f650c09e54aa883c6738258615c15" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: false } } }
I20260812 01:05:47.272279 16540 sys_catalog.cc:458] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:05:47.272648 16146 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, ace92aa71c3f4ee89cc1be563b67418f (127.4.201.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: false } } }
I20260812 01:05:47.281625 16845 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "081f650c09e54aa883c6738258615c15" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: false } } }
I20260812 01:05:47.282044 16845 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [sys.catalog]: This master's current role is: FOLLOWER
W20260812 01:05:47.343132 16837 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:47.343432 16837 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:47.343570 16837 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:47.350718 16837 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:47.350831 16837 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:47.350975 16837 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:05:47.360718 16837 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:36783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.66.keytab
--principal=oryx/127.4.201.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:40883
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=34151
--tserver_master_addrs=127.4.201.126:33537,127.4.201.125:46425,127.4.201.124:41233
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:47.362113 16837 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:47.363478 16837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:47.376819 16851 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:47.377381 16856 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:47.377461 16853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:47.377746 16837 server_base.cc:1034] running on GCE node
I20260812 01:05:47.378361 16837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:47.379254 16837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:47.380453 16837 hybrid_clock.cc:648] HybridClock initialized: now 1786496747380399 us; error 41 us; skew 500 ppm
I20260812 01:05:47.380765 16837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:47 dist-test-slave-bndk krb5kdc[15057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496747, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:47.383883 16837 init.cc:377] Logged in from keytab as oryx/127.4.201.66@KRBTEST.COM (short username oryx)
I20260812 01:05:47.385509 16837 webserver.cc:460] Webserver started at http://127.4.201.66:34151/ using document root <none> and password file <none>
I20260812 01:05:47.386175 16837 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:47.386289 16837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:47.391820 16837 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.005s
I20260812 01:05:47.394639 16875 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:47.395994 16837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 01:05:47.396140 16837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "b442ca0236f04fb7aea55f3b9a8de884"
format_stamp: "Formatted at 2026-08-12 01:05:44 on dist-test-slave-bndk"
server_key: "bbcdd711ea069141d23b268c592484e5"
server_key_iv: "60d10164dd25d7026d3f895d53c80ef2"
server_key_version: "encryptionkey@0"
I20260812 01:05:47.397127 16837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:47.421284 16837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:47.424892 16837 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:47.425149 16837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:47.426096 16837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:05:47.427448 16837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:47.427551 16837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:47.427662 16837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:47.427733 16837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:47.459064 16837 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:40883
I20260812 01:05:47.459134 17061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:40883 every 8 connection(s)
I20260812 01:05:47.460476 16837 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:05:47.468984 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 16837
I20260812 01:05:47.469329 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 15686
Aug 12 01:05:47 dist-test-slave-bndk krb5kdc[15057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496747, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM
Aug 12 01:05:47 dist-test-slave-bndk krb5kdc[15057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496747, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.125@KRBTEST.COM
Aug 12 01:05:47 dist-test-slave-bndk krb5kdc[15057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496747, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.124@KRBTEST.COM
Aug 12 01:05:47 dist-test-slave-bndk krb5kdc[15057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496742, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.4.201.67@KRBTEST.COM
I20260812 01:05:47.514770 17071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:47.463436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:36893 (local address 127.4.201.125:46425)
0812 01:05:47.492523 (+ 29087us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:47.492530 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:47.494010 (+ 1480us) server_negotiation.cc:407] Connection header received
0812 01:05:47.494144 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:47.494150 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:47.494220 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:47.494317 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:47.496921 (+ 2604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:47.498145 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:47.500824 (+ 2679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:47.501523 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:47.501632 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:47.507864 (+ 6232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:47.507873 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:47.507878 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:47.507929 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:47.511285 (+ 3356us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:47.512197 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:47.512202 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:47.512205 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:47.512357 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:47.512806 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:47.512810 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:47.512812 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:47.513104 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:47.513273 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:47.514288 (+ 1015us) server_negotiation.cc:299] Negotiation successful
0812 01:05:47.514474 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28929,"thread_start_us":30964,"threads_started":1}
I20260812 01:05:47.515803 17075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:47.464366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:41233 (local address 127.4.201.66:42669)
0812 01:05:47.496897 (+ 32531us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:47.496916 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:47.497084 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:47.497696 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:47.497701 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:47.498203 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:47.498588 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:47.498600 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:47.500195 (+ 1595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:47.500199 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:47.501769 (+ 1570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:47.501782 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:47.502957 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:47.502963 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:47.503156 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:47.503766 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:47.503791 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:47.507207 (+ 3416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:47.511091 (+ 3884us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:47.511101 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:47.511120 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:47.511969 (+ 849us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:47.512388 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:47.512393 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:47.512397 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:47.512669 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:47.513751 (+ 1082us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:47.513756 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:47.513906 (+ 150us) client_negotiation.cc:769] Sending connection context
0812 01:05:47.514070 (+ 164us) client_negotiation.cc:240] Negotiation successful
0812 01:05:47.514539 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31562,"mutex_wait_us":4,"thread_start_us":24886,"threads_started":1}
I20260812 01:05:47.515854 17077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:47.463954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:46425 (local address 127.4.201.66:36893)
0812 01:05:47.493743 (+ 29789us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:47.493764 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:47.493913 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:47.494639 (+ 726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:47.494652 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:47.495744 (+ 1092us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:47.496717 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:47.496733 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:47.498324 (+ 1591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:47.498330 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:47.500646 (+ 2316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:47.500663 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:47.501925 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:47.501933 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:47.502304 (+ 371us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:47.503178 (+ 874us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:47.503206 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:47.507613 (+ 4407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:47.511422 (+ 3809us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:47.511427 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:47.511430 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:47.512072 (+ 642us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:47.512465 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:47.512470 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:47.512473 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:47.512685 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:47.513275 (+ 590us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:47.513283 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:47.513627 (+ 344us) client_negotiation.cc:769] Sending connection context
0812 01:05:47.513973 (+ 346us) client_negotiation.cc:240] Negotiation successful
0812 01:05:47.515238 (+ 1265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29613,"mutex_wait_us":1031,"spinlock_wait_cycles":45184,"thread_start_us":29284,"threads_started":1}
I20260812 01:05:47.516929 17073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:47.464124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:42669 (local address 127.4.201.124:41233)
0812 01:05:47.490598 (+ 26474us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:47.490605 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:47.496990 (+ 6385us) server_negotiation.cc:407] Connection header received
0812 01:05:47.497251 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:47.497257 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:47.497343 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:47.497423 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:47.498778 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:47.500017 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:47.501931 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:47.502567 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:47.502674 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:47.507444 (+ 4770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:47.507452 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:47.507457 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:47.507517 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:47.510905 (+ 3388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:47.512128 (+ 1223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:47.512133 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:47.512137 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:47.512291 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:47.512815 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:47.512821 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:47.512825 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:47.513198 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:47.513370 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:47.516335 (+ 2965us) server_negotiation.cc:299] Negotiation successful
0812 01:05:47.516568 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26299,"thread_start_us":28747,"threads_started":1}
I20260812 01:05:47.517648 17067 heartbeater.cc:347] Connected to a master server at 127.4.201.125:46425
I20260812 01:05:47.517865 17063 heartbeater.cc:347] Connected to a master server at 127.4.201.124:41233
I20260812 01:05:47.517998 17085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:47.470753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34492 (local address 127.4.201.67:40181)
0812 01:05:47.493514 (+ 22761us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:47.493524 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:47.494323 (+ 799us) server_negotiation.cc:407] Connection header received
0812 01:05:47.494416 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:47.494426 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:47.494788 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:47.495037 (+ 249us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:47.497161 (+ 2124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:47.498702 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:47.500531 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:47.501350 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:47.501471 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:47.509862 (+ 8391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:47.509880 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:47.509900 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:47.509946 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:47.513824 (+ 3878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:47.514687 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:47.514696 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:47.514699 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:47.514885 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:47.515364 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:47.515369 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:47.515373 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:47.515801 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:47.516114 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:47.517308 (+ 1194us) server_negotiation.cc:299] Negotiation successful
0812 01:05:47.517587 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22576,"thread_start_us":22384,"threads_started":1}
I20260812 01:05:47.518011 17067 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:47.518015 17063 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:47.518559 17078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:47.463954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.4.201.66:46867)
0812 01:05:47.488161 (+ 24207us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:47.488270 (+ 109us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:47.492436 (+ 4166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:47.495404 (+ 2968us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:47.495410 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:47.496296 (+ 886us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:47.496672 (+ 376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:47.496697 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:47.498262 (+ 1565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:47.498267 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:47.500655 (+ 2388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:47.500674 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:47.501925 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:47.501931 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:47.502302 (+ 371us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:47.503129 (+ 827us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:47.503173 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:47.506441 (+ 3268us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:47.511607 (+ 5166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:47.511612 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:47.511615 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:47.512204 (+ 589us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:47.513445 (+ 1241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:47.513449 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:47.513453 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:47.513625 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:47.517315 (+ 3690us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:47.517320 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:47.517483 (+ 163us) client_negotiation.cc:769] Sending connection context
0812 01:05:47.517621 (+ 138us) client_negotiation.cc:240] Negotiation successful
0812 01:05:47.517923 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23804,"mutex_wait_us":193,"spinlock_wait_cycles":7936,"thread_start_us":31688,"threads_started":1}
I20260812 01:05:47.519081 17063 heartbeater.cc:511] Master 127.4.201.124:41233 requested a full tablet report, sending...
I20260812 01:05:47.519380 15891 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:47.519791 17072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:47.463832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:46867 (local address 127.4.201.126:33537)
0812 01:05:47.491999 (+ 28167us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:47.492006 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:47.492034 (+ 28us) server_negotiation.cc:407] Connection header received
0812 01:05:47.492852 (+ 818us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:47.492859 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:47.492966 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:47.493162 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:47.496876 (+ 3714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:47.498043 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:47.500826 (+ 2783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:47.501480 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:47.501597 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:47.506699 (+ 5102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:47.506706 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:47.506711 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:47.506754 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:47.510932 (+ 4178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:47.512498 (+ 1566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:47.512503 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:47.512506 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:47.512656 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:47.513769 (+ 1113us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:47.513775 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:47.513778 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:47.514117 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:47.514249 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:47.519157 (+ 4908us) server_negotiation.cc:299] Negotiation successful
0812 01:05:47.519420 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28013,"thread_start_us":28214,"threads_started":1}
I20260812 01:05:47.520789 17064 heartbeater.cc:347] Connected to a master server at 127.4.201.126:33537
I20260812 01:05:47.520932 17064 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:47.520991 16457 ts_manager.cc:194] Registered new tserver with Master: b442ca0236f04fb7aea55f3b9a8de884 (127.4.201.66:40883)
I20260812 01:05:47.521468 17064 heartbeater.cc:511] Master 127.4.201.126:33537 requested a full tablet report, sending...
I20260812 01:05:47.521819 17067 heartbeater.cc:511] Master 127.4.201.125:46425 requested a full tablet report, sending...
I20260812 01:05:47.522547 15132 ts_manager.cc:194] Re-registered known tserver with Master: b442ca0236f04fb7aea55f3b9a8de884 (127.4.201.66:40883)
I20260812 01:05:47.523078 16125 ts_manager.cc:194] Registered new tserver with Master: b442ca0236f04fb7aea55f3b9a8de884 (127.4.201.66:40883)
I20260812 01:05:47.523450 15132 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.201.66@KRBTEST.COM'} at 127.4.201.66:46867
I20260812 01:05:47.606021 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 15686
I20260812 01:05:47.629541 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:40181
--local_ip_for_outbound_sockets=127.4.201.67
--tserver_master_addrs=127.4.201.126:33537
--webserver_port=34173
--webserver_interface=127.4.201.67
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.67.keytab
--principal=oryx/127.4.201.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:36783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.4.201.126:33537,127.4.201.125:46425
--tserver_master_addrs=127.4.201.126:33537,127.4.201.125:46425,127.4.201.124:41233 with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:05:47.894603 16824 heartbeater.cc:503] Master 127.4.201.126:33537 was elected leader, sending a full tablet report...
W20260812 01:05:47.970394 17088 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:47.970670 17088 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:47.970805 17088 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:47.977969 17088 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:47.978081 17088 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:47.978229 17088 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:05:47.987702 17088 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:36783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.67.keytab
--principal=oryx/127.4.201.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:40181
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=34173
--tserver_master_addrs=127.4.201.126:33537,127.4.201.125:46425,127.4.201.124:41233
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:47.989022 17088 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:47.990371 17088 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:48.003264 17093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:48.003201 17094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:48.003242 17098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:48.004333 17088 server_base.cc:1034] running on GCE node
I20260812 01:05:48.004966 17088 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:48.005910 17088 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:48.007112 17088 hybrid_clock.cc:648] HybridClock initialized: now 1786496748007055 us; error 43 us; skew 500 ppm
I20260812 01:05:48.007411 17088 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:48 dist-test-slave-bndk krb5kdc[15057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496748, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:48.010468 17088 init.cc:377] Logged in from keytab as oryx/127.4.201.67@KRBTEST.COM (short username oryx)
I20260812 01:05:48.011863 17088 webserver.cc:460] Webserver started at http://127.4.201.67:34173/ using document root <none> and password file <none>
I20260812 01:05:48.012569 17088 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:48.012688 17088 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:48.018191 17088 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.002s
I20260812 01:05:48.020889 17108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:48.022193 17088 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 01:05:48.022351 17088 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "216b202088db425cbeb2f5f7da3ed2c3"
format_stamp: "Formatted at 2026-08-12 01:05:44 on dist-test-slave-bndk"
server_key: "58dc9f3d5029de55780bd5f8df0782d6"
server_key_iv: "bdc1ddf926744dc3d89d3ee52d09a323"
server_key_version: "encryptionkey@0"
I20260812 01:05:48.023321 17088 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:48.045001 17088 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:48.048885 17088 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:48.049139 17088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:48.050137 17088 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:05:48.051512 17088 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:48.051610 17088 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:48.051715 17088 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:48.051786 17088 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:48.080938 17088 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:40181
I20260812 01:05:48.081007 17300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:40181 every 8 connection(s)
I20260812 01:05:48.082428 17088 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:05:48.086679 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 17088
Aug 12 01:05:48 dist-test-slave-bndk krb5kdc[15057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496748, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.124@KRBTEST.COM
I20260812 01:05:48.144390 17316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:48.091984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:54789 (local address 127.4.201.124:41233)
0812 01:05:48.114443 (+ 22459us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:48.114451 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:48.115150 (+ 699us) server_negotiation.cc:407] Connection header received
0812 01:05:48.116377 (+ 1227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:48.116383 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:48.116485 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:48.116588 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:48.119588 (+ 3000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.121103 (+ 1515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.123831 (+ 2728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.124549 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.124672 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:48.135825 (+ 11153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:48.135831 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:48.135834 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:48.135870 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:48.140029 (+ 4159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:48.140992 (+ 963us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:48.140998 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:48.141001 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:48.141158 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:48.141762 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:48.142000 (+ 238us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:48.142005 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:48.142367 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:48.142500 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:48.143607 (+ 1107us) server_negotiation.cc:299] Negotiation successful
0812 01:05:48.143858 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22251,"thread_start_us":22128,"threads_started":1}
Aug 12 01:05:48 dist-test-slave-bndk krb5kdc[15057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496748, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM
Aug 12 01:05:48 dist-test-slave-bndk krb5kdc[15057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496748, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.125@KRBTEST.COM
I20260812 01:05:48.154206 17317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:48.092007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:41233 (local address 127.4.201.67:54789)
0812 01:05:48.114965 (+ 22958us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:48.114985 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:48.115970 (+ 985us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:48.116900 (+ 930us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:48.116913 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:48.118434 (+ 1521us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:48.119401 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:48.119428 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.121307 (+ 1879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.121314 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:48.123668 (+ 2354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:48.123687 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.126282 (+ 2595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.126290 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:48.126617 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:48.128179 (+ 1562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:48.128212 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:48.135583 (+ 7371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:48.140211 (+ 4628us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:48.140221 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:48.140241 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:48.140856 (+ 615us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:48.141349 (+ 493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:48.141354 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:48.141357 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:48.141607 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:48.142598 (+ 991us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:48.142606 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:48.143092 (+ 486us) client_negotiation.cc:769] Sending connection context
0812 01:05:48.151678 (+ 8586us) client_negotiation.cc:240] Negotiation successful
0812 01:05:48.152513 (+ 835us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22806,"thread_start_us":22622,"threads_started":1}
I20260812 01:05:48.156653 17301 heartbeater.cc:347] Connected to a master server at 127.4.201.124:41233
I20260812 01:05:48.157094 17301 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:48.158083 17301 heartbeater.cc:511] Master 127.4.201.124:41233 requested a full tablet report, sending...
I20260812 01:05:48.160179 16457 ts_manager.cc:194] Registered new tserver with Master: 216b202088db425cbeb2f5f7da3ed2c3 (127.4.201.67:40181)
I20260812 01:05:48.161737 17312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:48.086142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.4.201.67:54253)
0812 01:05:48.113653 (+ 27511us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:48.113673 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:48.116754 (+ 3081us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:48.117432 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:48.117437 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:48.133739 (+ 16302us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:48.134041 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:48.134054 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.135552 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.135557 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:48.138147 (+ 2590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:48.138166 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.141369 (+ 3203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.141374 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:48.141553 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:48.143192 (+ 1639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:48.143212 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:48.149740 (+ 6528us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:48.158200 (+ 8460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:48.158205 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:48.158209 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:48.158774 (+ 565us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:48.159501 (+ 727us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:48.159506 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:48.159510 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:48.159687 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:48.160658 (+ 971us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:48.160663 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:48.160861 (+ 198us) client_negotiation.cc:769] Sending connection context
0812 01:05:48.161002 (+ 141us) client_negotiation.cc:240] Negotiation successful
0812 01:05:48.161323 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27359,"mutex_wait_us":1128,"thread_start_us":26046,"threads_started":1}
I20260812 01:05:48.162108 17308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:48.085784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:54253 (local address 127.4.201.126:33537)
0812 01:05:48.113960 (+ 28176us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:48.113967 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:48.113991 (+ 24us) server_negotiation.cc:407] Connection header received
0812 01:05:48.117004 (+ 3013us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:48.117010 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:48.117095 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:48.117176 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:48.134220 (+ 17044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.135326 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.140140 (+ 4814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.140814 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.140933 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:48.150760 (+ 9827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:48.150766 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:48.150770 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:48.150816 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:48.155115 (+ 4299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:48.158912 (+ 3797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:48.158917 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:48.158921 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:48.159135 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:48.159830 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:48.159835 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:48.159838 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:48.160201 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:48.160366 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:48.161367 (+ 1001us) server_negotiation.cc:299] Negotiation successful
0812 01:05:48.161597 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28034,"thread_start_us":29387,"threads_started":1}
I20260812 01:05:48.163100 17302 heartbeater.cc:347] Connected to a master server at 127.4.201.126:33537
I20260812 01:05:48.163240 17302 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:48.163762 17302 heartbeater.cc:511] Master 127.4.201.126:33537 requested a full tablet report, sending...
I20260812 01:05:48.164877 15132 ts_manager.cc:194] Re-registered known tserver with Master: 216b202088db425cbeb2f5f7da3ed2c3 (127.4.201.67:40181)
I20260812 01:05:48.165972 15132 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.201.67@KRBTEST.COM'} at 127.4.201.67:54253
I20260812 01:05:48.169322 17316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:48.118374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41100 (local address 127.4.201.124:41233)
0812 01:05:48.145367 (+ 26993us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:48.145372 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:48.145390 (+ 18us) server_negotiation.cc:407] Connection header received
0812 01:05:48.145447 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:48.145452 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:48.145522 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:48.149635 (+ 4113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:48.149804 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.150783 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.155213 (+ 4430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.155873 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.155998 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:48.161727 (+ 5729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:48.161734 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:48.161739 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:48.161777 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:48.165490 (+ 3713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:48.166314 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:48.166319 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:48.166323 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:48.166487 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:48.166976 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:48.166981 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:48.166984 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:48.167367 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:48.167617 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:48.168735 (+ 1118us) server_negotiation.cc:299] Negotiation successful
0812 01:05:48.168965 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26875,"thread_start_us":29801,"threads_started":1}
I20260812 01:05:48.169373 17306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:48.085606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:36281 (local address 127.4.201.125:46425)
0812 01:05:48.115606 (+ 30000us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:48.115612 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:48.115632 (+ 20us) server_negotiation.cc:407] Connection header received
0812 01:05:48.116575 (+ 943us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:48.116582 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:48.116668 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:48.120204 (+ 3536us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:48.132875 (+ 12671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.134088 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.142717 (+ 8629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.143405 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.143537 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:48.150768 (+ 7231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:48.150777 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:48.150783 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:48.150842 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:48.156844 (+ 6002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:48.163089 (+ 6245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:48.163096 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:48.163100 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:48.163288 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:48.165751 (+ 2463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:48.165807 (+ 56us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:48.165810 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:48.166195 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:48.166374 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:48.168640 (+ 2266us) server_negotiation.cc:299] Negotiation successful
0812 01:05:48.168887 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29879,"thread_start_us":29775,"threads_started":1}
I20260812 01:05:48.169768 17309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:48.086142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:46425 (local address 127.4.201.67:36281)
0812 01:05:48.110793 (+ 24651us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:48.110853 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:48.116394 (+ 5541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:48.131772 (+ 15378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:48.131778 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:48.132341 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:48.132642 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:48.132655 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.138441 (+ 5786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.138447 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:48.142570 (+ 4123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:48.142584 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.144271 (+ 1687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.144277 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:48.144452 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:48.146445 (+ 1993us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:48.146468 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:48.150498 (+ 4030us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:48.162069 (+ 11571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:48.162074 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:48.162078 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:48.162523 (+ 445us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:48.164134 (+ 1611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:48.164140 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:48.164144 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:48.164553 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:48.166938 (+ 2385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:48.166943 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:48.167276 (+ 333us) client_negotiation.cc:769] Sending connection context
0812 01:05:48.167586 (+ 310us) client_negotiation.cc:240] Negotiation successful
0812 01:05:48.169359 (+ 1773us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24281,"mutex_wait_us":162,"thread_start_us":23989,"threads_started":1}
I20260812 01:05:48.170644 17303 heartbeater.cc:347] Connected to a master server at 127.4.201.125:46425
I20260812 01:05:48.170778 17303 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:48.171202 17303 heartbeater.cc:511] Master 127.4.201.125:46425 requested a full tablet report, sending...
I20260812 01:05:48.172429 16125 ts_manager.cc:194] Registered new tserver with Master: 216b202088db425cbeb2f5f7da3ed2c3 (127.4.201.67:40181)
I20260812 01:05:48.175911 17330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:48.117474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50950 (local address 127.4.201.126:33537)
0812 01:05:48.151618 (+ 34144us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:48.151625 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:48.151646 (+ 21us) server_negotiation.cc:407] Connection header received
0812 01:05:48.151704 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:48.151710 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:48.151801 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:48.151925 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:48.154464 (+ 2539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.155662 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.157604 (+ 1942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.158495 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.158617 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:48.163504 (+ 4887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:48.163510 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:48.163515 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:48.163552 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:48.172903 (+ 9351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:48.173777 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:48.173783 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:48.173786 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:48.173942 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:48.174400 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:48.174403 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:48.174405 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:48.174743 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:48.174947 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:48.175292 (+ 345us) server_negotiation.cc:299] Negotiation successful
0812 01:05:48.175515 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34007,"thread_start_us":34596,"threads_started":1}
I20260812 01:05:48.176766 17331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:48.117826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46104 (local address 127.4.201.125:46425)
0812 01:05:48.156394 (+ 38568us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:48.156400 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:48.156420 (+ 20us) server_negotiation.cc:407] Connection header received
0812 01:05:48.156476 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:48.156481 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:48.156570 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:48.162611 (+ 6041us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:48.162854 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.164182 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.165709 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.166374 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.166500 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:48.169737 (+ 3237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:48.169743 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:48.169746 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:48.169773 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:48.173037 (+ 3264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:48.173838 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:48.173843 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:48.173846 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:48.173999 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:48.175010 (+ 1011us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:48.175016 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:48.175019 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:48.175364 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:48.175592 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:48.176165 (+ 573us) server_negotiation.cc:299] Negotiation successful
0812 01:05:48.176369 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38419,"thread_start_us":36567,"threads_started":1}
I20260812 01:05:48.179656 15132 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50950:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:05:48.186584 15132 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:05:48.215407 17355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:48.204442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:40181 (local address 127.0.0.1:34506)
0812 01:05:48.205882 (+ 1440us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:48.205901 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:48.206032 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:48.207319 (+ 1287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:48.207325 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:48.207353 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:48.207819 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:48.207832 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.210292 (+ 2460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.210299 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:48.212507 (+ 2208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:48.212522 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.214603 (+ 2081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.214610 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:48.214803 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:48.214845 (+ 42us) client_negotiation.cc:769] Sending connection context
0812 01:05:48.214915 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 01:05:48.215069 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1294,"threads_started":1}
I20260812 01:05:48.217180 17357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:48.205975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34506 (local address 127.4.201.67:40181)
0812 01:05:48.206671 (+ 696us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:48.206679 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:48.206713 (+ 34us) server_negotiation.cc:407] Connection header received
0812 01:05:48.206812 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:48.206820 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:48.207103 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:48.208043 (+ 940us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:48.208333 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.210106 (+ 1773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.212720 (+ 2614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.214360 (+ 1640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.216184 (+ 1824us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:48.216445 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:48.216521 (+ 76us) server_negotiation.cc:299] Negotiation successful
0812 01:05:48.216705 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":492,"thread_start_us":297,"threads_started":1}
I20260812 01:05:48.235566 17355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:48.205077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:36613 (local address 127.0.0.1:39510)
0812 01:05:48.215890 (+ 10813us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:48.215909 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:48.216021 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:48.227790 (+ 11769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:48.227796 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:48.227827 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:48.228030 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:48.228041 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.230900 (+ 2859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.230906 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:48.232888 (+ 1982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:48.232905 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.234811 (+ 1906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.234818 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:48.234998 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:48.235034 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 01:05:48.235099 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 01:05:48.235236 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10692,"thread_start_us":523,"threads_started":1}
I20260812 01:05:48.236847 17356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:48.205619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39510 (local address 127.4.201.65:36613)
0812 01:05:48.226820 (+ 21201us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:48.226831 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:48.226865 (+ 34us) server_negotiation.cc:407] Connection header received
0812 01:05:48.226987 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:48.226997 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:48.227303 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:48.228223 (+ 920us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:48.228461 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.230044 (+ 1583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.233110 (+ 3066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.234630 (+ 1520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.236096 (+ 1466us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:48.236316 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:48.236395 (+ 79us) server_negotiation.cc:299] Negotiation successful
0812 01:05:48.236568 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20985,"thread_start_us":21846,"threads_started":1}
I20260812 01:05:48.238415 17350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:48.204135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:40883 (local address 127.0.0.1:57692)
0812 01:05:48.204962 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:48.204990 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:48.205107 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:48.231260 (+ 26153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:48.231265 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:48.231291 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:48.231685 (+ 394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:48.231697 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.233745 (+ 2048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.233750 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:48.235799 (+ 2049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:48.235814 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.237671 (+ 1857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.237679 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:48.237856 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:48.237888 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 01:05:48.237953 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 01:05:48.238082 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":694,"thread_start_us":606,"threads_started":1}
I20260812 01:05:48.239576 17354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:48.204580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57692 (local address 127.4.201.66:40883)
0812 01:05:48.230542 (+ 25962us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:48.230551 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:48.230580 (+ 29us) server_negotiation.cc:407] Connection header received
0812 01:05:48.230779 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:48.230787 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:48.231040 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:48.231913 (+ 873us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:48.232144 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.233598 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.236005 (+ 2407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.237423 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.238847 (+ 1424us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:48.239067 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:48.239138 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 01:05:48.239297 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25795,"thread_start_us":26039,"threads_started":1}
I20260812 01:05:48.241510 16714 tablet_service.cc:1467] Processing CreateTablet for tablet 8325822b33cc41819f91cfeef7adba2c (DEFAULT_TABLE table=test-table [id=8f52512798db4475a60d84171d4ccf19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:48.242394 17192 tablet_service.cc:1467] Processing CreateTablet for tablet 8325822b33cc41819f91cfeef7adba2c (DEFAULT_TABLE table=test-table [id=8f52512798db4475a60d84171d4ccf19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:48.243207 16714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8325822b33cc41819f91cfeef7adba2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:48.243157 16953 tablet_service.cc:1467] Processing CreateTablet for tablet 8325822b33cc41819f91cfeef7adba2c (DEFAULT_TABLE table=test-table [id=8f52512798db4475a60d84171d4ccf19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:48.243788 17192 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8325822b33cc41819f91cfeef7adba2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:48.244278 16953 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8325822b33cc41819f91cfeef7adba2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:48.255853 17360 tablet_bootstrap.cc:492] T 8325822b33cc41819f91cfeef7adba2c P b442ca0236f04fb7aea55f3b9a8de884: Bootstrap starting.
I20260812 01:05:48.258802 17361 tablet_bootstrap.cc:492] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3: Bootstrap starting.
I20260812 01:05:48.259855 17360 tablet_bootstrap.cc:654] T 8325822b33cc41819f91cfeef7adba2c P b442ca0236f04fb7aea55f3b9a8de884: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:48.261143 17360 log.cc:824] T 8325822b33cc41819f91cfeef7adba2c P b442ca0236f04fb7aea55f3b9a8de884: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:48.261893 17362 tablet_bootstrap.cc:492] T 8325822b33cc41819f91cfeef7adba2c P 0d9da262268f431ab7801aeae643ef8e: Bootstrap starting.
I20260812 01:05:48.262456 17361 tablet_bootstrap.cc:654] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:48.263823 17361 log.cc:824] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:48.264889 17362 tablet_bootstrap.cc:654] T 8325822b33cc41819f91cfeef7adba2c P 0d9da262268f431ab7801aeae643ef8e: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:48.266175 17362 log.cc:824] T 8325822b33cc41819f91cfeef7adba2c P 0d9da262268f431ab7801aeae643ef8e: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:48.267311 17361 tablet_bootstrap.cc:492] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3: No bootstrap required, opened a new log
I20260812 01:05:48.267424 17360 tablet_bootstrap.cc:492] T 8325822b33cc41819f91cfeef7adba2c P b442ca0236f04fb7aea55f3b9a8de884: No bootstrap required, opened a new log
I20260812 01:05:48.267576 17361 ts_tablet_manager.cc:1397] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260812 01:05:48.267747 17360 ts_tablet_manager.cc:1397] T 8325822b33cc41819f91cfeef7adba2c P b442ca0236f04fb7aea55f3b9a8de884: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260812 01:05:48.275941 17362 tablet_bootstrap.cc:492] T 8325822b33cc41819f91cfeef7adba2c P 0d9da262268f431ab7801aeae643ef8e: No bootstrap required, opened a new log
I20260812 01:05:48.276239 17362 ts_tablet_manager.cc:1397] T 8325822b33cc41819f91cfeef7adba2c P 0d9da262268f431ab7801aeae643ef8e: Time spent bootstrapping tablet: real 0.015s user 0.012s sys 0.000s
I20260812 01:05:48.276678 17361 raft_consensus.cc:348] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "216b202088db425cbeb2f5f7da3ed2c3" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 40181 } } peers { permanent_uuid: "b442ca0236f04fb7aea55f3b9a8de884" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 40883 } } peers { permanent_uuid: "0d9da262268f431ab7801aeae643ef8e" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 36613 } }
I20260812 01:05:48.277040 17361 raft_consensus.cc:374] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:48.277144 17361 raft_consensus.cc:729] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216b202088db425cbeb2f5f7da3ed2c3, State: Initialized, Role: FOLLOWER
I20260812 01:05:48.278017 17361 consensus_queue.cc:260] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "216b202088db425cbeb2f5f7da3ed2c3" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 40181 } } peers { permanent_uuid: "b442ca0236f04fb7aea55f3b9a8de884" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 40883 } } peers { permanent_uuid: "0d9da262268f431ab7801aeae643ef8e" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 36613 } }
I20260812 01:05:48.279492 17360 raft_consensus.cc:348] T 8325822b33cc41819f91cfeef7adba2c P b442ca0236f04fb7aea55f3b9a8de884 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "216b202088db425cbeb2f5f7da3ed2c3" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 40181 } } peers { permanent_uuid: "b442ca0236f04fb7aea55f3b9a8de884" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 40883 } } peers { permanent_uuid: "0d9da262268f431ab7801aeae643ef8e" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 36613 } }
I20260812 01:05:48.279922 17360 raft_consensus.cc:374] T 8325822b33cc41819f91cfeef7adba2c P b442ca0236f04fb7aea55f3b9a8de884 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:48.280026 17360 raft_consensus.cc:729] T 8325822b33cc41819f91cfeef7adba2c P b442ca0236f04fb7aea55f3b9a8de884 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b442ca0236f04fb7aea55f3b9a8de884, State: Initialized, Role: FOLLOWER
I20260812 01:05:48.280115 17361 ts_tablet_manager.cc:1428] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3: Time spent starting tablet: real 0.012s user 0.013s sys 0.000s
I20260812 01:05:48.280614 17360 consensus_queue.cc:260] T 8325822b33cc41819f91cfeef7adba2c P b442ca0236f04fb7aea55f3b9a8de884 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "216b202088db425cbeb2f5f7da3ed2c3" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 40181 } } peers { permanent_uuid: "b442ca0236f04fb7aea55f3b9a8de884" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 40883 } } peers { permanent_uuid: "0d9da262268f431ab7801aeae643ef8e" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 36613 } }
I20260812 01:05:48.281313 17302 heartbeater.cc:503] Master 127.4.201.126:33537 was elected leader, sending a full tablet report...
I20260812 01:05:48.282258 17360 ts_tablet_manager.cc:1428] T 8325822b33cc41819f91cfeef7adba2c P b442ca0236f04fb7aea55f3b9a8de884: Time spent starting tablet: real 0.014s user 0.007s sys 0.006s
I20260812 01:05:48.282546 17064 heartbeater.cc:503] Master 127.4.201.126:33537 was elected leader, sending a full tablet report...
I20260812 01:05:48.289567 17362 raft_consensus.cc:348] T 8325822b33cc41819f91cfeef7adba2c P 0d9da262268f431ab7801aeae643ef8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "216b202088db425cbeb2f5f7da3ed2c3" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 40181 } } peers { permanent_uuid: "b442ca0236f04fb7aea55f3b9a8de884" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 40883 } } peers { permanent_uuid: "0d9da262268f431ab7801aeae643ef8e" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 36613 } }
I20260812 01:05:48.290019 17362 raft_consensus.cc:374] T 8325822b33cc41819f91cfeef7adba2c P 0d9da262268f431ab7801aeae643ef8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:48.290126 17362 raft_consensus.cc:729] T 8325822b33cc41819f91cfeef7adba2c P 0d9da262268f431ab7801aeae643ef8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d9da262268f431ab7801aeae643ef8e, State: Initialized, Role: FOLLOWER
I20260812 01:05:48.290656 17362 consensus_queue.cc:260] T 8325822b33cc41819f91cfeef7adba2c P 0d9da262268f431ab7801aeae643ef8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "216b202088db425cbeb2f5f7da3ed2c3" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 40181 } } peers { permanent_uuid: "b442ca0236f04fb7aea55f3b9a8de884" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 40883 } } peers { permanent_uuid: "0d9da262268f431ab7801aeae643ef8e" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 36613 } }
I20260812 01:05:48.292193 17362 ts_tablet_manager.cc:1428] T 8325822b33cc41819f91cfeef7adba2c P 0d9da262268f431ab7801aeae643ef8e: Time spent starting tablet: real 0.016s user 0.008s sys 0.005s
W20260812 01:05:48.356984 16827 tablet.cc:2369] T 8325822b33cc41819f91cfeef7adba2c P 0d9da262268f431ab7801aeae643ef8e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:05:48.366587 17304 tablet.cc:2369] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:05:48.481132 17069 tablet.cc:2369] T 8325822b33cc41819f91cfeef7adba2c P b442ca0236f04fb7aea55f3b9a8de884: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:05:48.540686 17368 raft_consensus.cc:482] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:05:48.541013 17368 raft_consensus.cc:504] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "216b202088db425cbeb2f5f7da3ed2c3" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 40181 } } peers { permanent_uuid: "b442ca0236f04fb7aea55f3b9a8de884" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 40883 } } peers { permanent_uuid: "0d9da262268f431ab7801aeae643ef8e" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 36613 } }
I20260812 01:05:48.542861 17368 leader_election.cc:288] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b442ca0236f04fb7aea55f3b9a8de884 (127.4.201.66:40883), 0d9da262268f431ab7801aeae643ef8e (127.4.201.65:36613)
I20260812 01:05:48.550261 17356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:48.543776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:48189 (local address 127.4.201.65:36613)
0812 01:05:48.543961 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:48.543966 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:48.543992 (+ 26us) server_negotiation.cc:407] Connection header received
0812 01:05:48.544060 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:48.544066 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:48.544148 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:48.544243 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:48.544686 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.545701 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.547939 (+ 2238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.549172 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.549354 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:48.549427 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:48.549872 (+ 445us) server_negotiation.cc:299] Negotiation successful
0812 01:05:48.550005 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 01:05:48.550266 17354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:48.543238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:58791 (local address 127.4.201.66:40883)
0812 01:05:48.543468 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:48.543485 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:48.543509 (+ 24us) server_negotiation.cc:407] Connection header received
0812 01:05:48.543751 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:48.543757 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:48.543839 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:48.543934 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:48.544391 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.545492 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.547939 (+ 2447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.549278 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.549424 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:48.549496 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:48.549870 (+ 374us) server_negotiation.cc:299] Negotiation successful
0812 01:05:48.549999 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 01:05:48.550330 17312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:48.543607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:36613 (local address 127.4.201.67:48189)
0812 01:05:48.543844 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:48.543859 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:48.543943 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:48.544306 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:48.544310 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:48.544335 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:48.544523 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:48.544534 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.545823 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.545829 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:48.547786 (+ 1957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:48.547802 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.549349 (+ 1547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.549355 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:48.549652 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:48.549740 (+ 88us) client_negotiation.cc:769] Sending connection context
0812 01:05:48.549831 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 01:05:48.550008 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"mutex_wait_us":106}
I20260812 01:05:48.550323 17309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:48.543207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:40883 (local address 127.4.201.67:58791)
0812 01:05:48.543397 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:48.543415 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:48.543563 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:48.543979 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:48.543984 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:48.544027 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:48.544217 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:48.544230 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.545613 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.545617 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:48.547794 (+ 2177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:48.547804 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.549409 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.549414 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:48.549646 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:48.549738 (+ 92us) client_negotiation.cc:769] Sending connection context
0812 01:05:48.549828 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 01:05:48.550001 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52,"mutex_wait_us":124}
I20260812 01:05:48.551446 16986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8325822b33cc41819f91cfeef7adba2c" candidate_uuid: "216b202088db425cbeb2f5f7da3ed2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b442ca0236f04fb7aea55f3b9a8de884" is_pre_election: true
I20260812 01:05:48.551460 16749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8325822b33cc41819f91cfeef7adba2c" candidate_uuid: "216b202088db425cbeb2f5f7da3ed2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9da262268f431ab7801aeae643ef8e" is_pre_election: true
I20260812 01:05:48.551903 16749 raft_consensus.cc:2454] T 8325822b33cc41819f91cfeef7adba2c P 0d9da262268f431ab7801aeae643ef8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216b202088db425cbeb2f5f7da3ed2c3 in term 0.
I20260812 01:05:48.551919 16986 raft_consensus.cc:2454] T 8325822b33cc41819f91cfeef7adba2c P b442ca0236f04fb7aea55f3b9a8de884 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216b202088db425cbeb2f5f7da3ed2c3 in term 0.
I20260812 01:05:48.552604 17114 leader_election.cc:302] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216b202088db425cbeb2f5f7da3ed2c3, b442ca0236f04fb7aea55f3b9a8de884; no voters:
I20260812 01:05:48.552946 17368 raft_consensus.cc:2781] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:05:48.553105 17368 raft_consensus.cc:482] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:05:48.553241 17368 raft_consensus.cc:3037] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:48.555403 17368 raft_consensus.cc:504] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "216b202088db425cbeb2f5f7da3ed2c3" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 40181 } } peers { permanent_uuid: "b442ca0236f04fb7aea55f3b9a8de884" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 40883 } } peers { permanent_uuid: "0d9da262268f431ab7801aeae643ef8e" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 36613 } }
I20260812 01:05:48.555945 17368 leader_election.cc:288] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3 [CANDIDATE]: Term 1 election: Requested vote from peers b442ca0236f04fb7aea55f3b9a8de884 (127.4.201.66:40883), 0d9da262268f431ab7801aeae643ef8e (127.4.201.65:36613)
I20260812 01:05:48.556313 16986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8325822b33cc41819f91cfeef7adba2c" candidate_uuid: "216b202088db425cbeb2f5f7da3ed2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b442ca0236f04fb7aea55f3b9a8de884"
I20260812 01:05:48.556463 16749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8325822b33cc41819f91cfeef7adba2c" candidate_uuid: "216b202088db425cbeb2f5f7da3ed2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9da262268f431ab7801aeae643ef8e"
I20260812 01:05:48.556479 16986 raft_consensus.cc:3037] T 8325822b33cc41819f91cfeef7adba2c P b442ca0236f04fb7aea55f3b9a8de884 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:48.556646 16749 raft_consensus.cc:3037] T 8325822b33cc41819f91cfeef7adba2c P 0d9da262268f431ab7801aeae643ef8e [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:48.558827 16986 raft_consensus.cc:2454] T 8325822b33cc41819f91cfeef7adba2c P b442ca0236f04fb7aea55f3b9a8de884 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216b202088db425cbeb2f5f7da3ed2c3 in term 1.
I20260812 01:05:48.558838 16749 raft_consensus.cc:2454] T 8325822b33cc41819f91cfeef7adba2c P 0d9da262268f431ab7801aeae643ef8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216b202088db425cbeb2f5f7da3ed2c3 in term 1.
I20260812 01:05:48.559168 17114 leader_election.cc:302] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d9da262268f431ab7801aeae643ef8e, 216b202088db425cbeb2f5f7da3ed2c3; no voters:
I20260812 01:05:48.559407 17368 raft_consensus.cc:2781] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:05:48.559792 17368 raft_consensus.cc:686] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3 [term 1 LEADER]: Becoming Leader. State: Replica: 216b202088db425cbeb2f5f7da3ed2c3, State: Running, Role: LEADER
I20260812 01:05:48.560357 17368 consensus_queue.cc:237] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "216b202088db425cbeb2f5f7da3ed2c3" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 40181 } } peers { permanent_uuid: "b442ca0236f04fb7aea55f3b9a8de884" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 40883 } } peers { permanent_uuid: "0d9da262268f431ab7801aeae643ef8e" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 36613 } }
I20260812 01:05:48.564890 15130 catalog_manager.cc:5495] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 216b202088db425cbeb2f5f7da3ed2c3 (127.4.201.67). New cstate: current_term: 1 leader_uuid: "216b202088db425cbeb2f5f7da3ed2c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "216b202088db425cbeb2f5f7da3ed2c3" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 40181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b442ca0236f04fb7aea55f3b9a8de884" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 40883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d9da262268f431ab7801aeae643ef8e" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 36613 } health_report { overall_health: UNKNOWN } } }
I20260812 01:05:48.583864 17357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:48.579206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34510 (local address 127.4.201.67:40181)
0812 01:05:48.579366 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:48.579371 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:48.579387 (+ 16us) server_negotiation.cc:407] Connection header received
0812 01:05:48.579567 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:48.579570 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:48.579646 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:48.579768 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:05:48.580054 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.580759 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.582071 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.582468 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.582563 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:48.582950 (+ 387us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:05:48.583453 (+ 503us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:05:48.583563 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:48.583600 (+ 37us) server_negotiation.cc:299] Negotiation successful
0812 01:05:48.583664 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 01:05:48.592188 16986 raft_consensus.cc:1261] T 8325822b33cc41819f91cfeef7adba2c P b442ca0236f04fb7aea55f3b9a8de884 [term 1 FOLLOWER]: Refusing update from remote peer 216b202088db425cbeb2f5f7da3ed2c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:48.592188 16749 raft_consensus.cc:1261] T 8325822b33cc41819f91cfeef7adba2c P 0d9da262268f431ab7801aeae643ef8e [term 1 FOLLOWER]: Refusing update from remote peer 216b202088db425cbeb2f5f7da3ed2c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:48.593250 17376 consensus_queue.cc:1035] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d9da262268f431ab7801aeae643ef8e" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 36613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:48.593628 17368 consensus_queue.cc:1035] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b442ca0236f04fb7aea55f3b9a8de884" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 40883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:48.614717 17383 mvcc.cc:205] Tried to move back new op lower bound from 7317490682223476736 to 7317490682107174912. Current Snapshot: MvccSnapshot[applied={T|T < 7317490682223476736}]
I20260812 01:05:48.626386 15130 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50950:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:05:48.626744 15130 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50950:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:05:48.633987 15130 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 081f650c09e54aa883c6738258615c15: Sending DeleteTablet for 3 replicas of tablet 8325822b33cc41819f91cfeef7adba2c
I20260812 01:05:48.635048 17192 tablet_service.cc:1514] Processing DeleteTablet for tablet 8325822b33cc41819f91cfeef7adba2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:48 UTC) from {username='oryx', principal='oryx/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:34506
I20260812 01:05:48.635342 16953 tablet_service.cc:1514] Processing DeleteTablet for tablet 8325822b33cc41819f91cfeef7adba2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:48 UTC) from {username='oryx', principal='oryx/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:57692
I20260812 01:05:48.636534 16714 tablet_service.cc:1514] Processing DeleteTablet for tablet 8325822b33cc41819f91cfeef7adba2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:48 UTC) from {username='oryx', principal='oryx/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:39510
I20260812 01:05:48.637260 17404 tablet_replica.cc:330] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3: stopping tablet replica
I20260812 01:05:48.637790 17404 raft_consensus.cc:2229] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3 [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:05:48.638633 17404 raft_consensus.cc:2258] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:48.640996 17404 ts_tablet_manager.cc:1905] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:48.646742 17408 tablet_replica.cc:330] T 8325822b33cc41819f91cfeef7adba2c P 0d9da262268f431ab7801aeae643ef8e: stopping tablet replica
I20260812 01:05:48.647431 17408 raft_consensus.cc:2229] T 8325822b33cc41819f91cfeef7adba2c P 0d9da262268f431ab7801aeae643ef8e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:05:48.648674 17408 raft_consensus.cc:2258] T 8325822b33cc41819f91cfeef7adba2c P 0d9da262268f431ab7801aeae643ef8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:48.649582 17404 ts_tablet_manager.cc:1918] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:05:48.649777 17405 tablet_replica.cc:330] T 8325822b33cc41819f91cfeef7adba2c P b442ca0236f04fb7aea55f3b9a8de884: stopping tablet replica
I20260812 01:05:48.649832 17404 log.cc:1196] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/wal/wals/8325822b33cc41819f91cfeef7adba2c
I20260812 01:05:48.650574 17404 ts_tablet_manager.cc:1939] T 8325822b33cc41819f91cfeef7adba2c P 216b202088db425cbeb2f5f7da3ed2c3: Deleting consensus metadata
I20260812 01:05:48.650854 17405 raft_consensus.cc:2229] T 8325822b33cc41819f91cfeef7adba2c P b442ca0236f04fb7aea55f3b9a8de884 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:05:48.651368 17405 raft_consensus.cc:2258] T 8325822b33cc41819f91cfeef7adba2c P b442ca0236f04fb7aea55f3b9a8de884 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:48.652673 15111 catalog_manager.cc:4841] TS 216b202088db425cbeb2f5f7da3ed2c3 (127.4.201.67:40181): tablet 8325822b33cc41819f91cfeef7adba2c (table test-table [id=8f52512798db4475a60d84171d4ccf19]) successfully deleted
I20260812 01:05:48.653088 17408 ts_tablet_manager.cc:1905] T 8325822b33cc41819f91cfeef7adba2c P 0d9da262268f431ab7801aeae643ef8e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:48.654762 17405 ts_tablet_manager.cc:1905] T 8325822b33cc41819f91cfeef7adba2c P b442ca0236f04fb7aea55f3b9a8de884: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:48.660140 17408 ts_tablet_manager.cc:1918] T 8325822b33cc41819f91cfeef7adba2c P 0d9da262268f431ab7801aeae643ef8e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:05:48.660367 17408 log.cc:1196] T 8325822b33cc41819f91cfeef7adba2c P 0d9da262268f431ab7801aeae643ef8e: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/wal/wals/8325822b33cc41819f91cfeef7adba2c
I20260812 01:05:48.660957 17408 ts_tablet_manager.cc:1939] T 8325822b33cc41819f91cfeef7adba2c P 0d9da262268f431ab7801aeae643ef8e: Deleting consensus metadata
I20260812 01:05:48.661861 17405 ts_tablet_manager.cc:1918] T 8325822b33cc41819f91cfeef7adba2c P b442ca0236f04fb7aea55f3b9a8de884: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:05:48.662101 17405 log.cc:1196] T 8325822b33cc41819f91cfeef7adba2c P b442ca0236f04fb7aea55f3b9a8de884: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/wal/wals/8325822b33cc41819f91cfeef7adba2c
I20260812 01:05:48.662715 17405 ts_tablet_manager.cc:1939] T 8325822b33cc41819f91cfeef7adba2c P b442ca0236f04fb7aea55f3b9a8de884: Deleting consensus metadata
I20260812 01:05:48.662982 15112 catalog_manager.cc:4841] TS 0d9da262268f431ab7801aeae643ef8e (127.4.201.65:36613): tablet 8325822b33cc41819f91cfeef7adba2c (table test-table [id=8f52512798db4475a60d84171d4ccf19]) successfully deleted
I20260812 01:05:48.664528 15112 catalog_manager.cc:4841] TS b442ca0236f04fb7aea55f3b9a8de884 (127.4.201.66:40883): tablet 8325822b33cc41819f91cfeef7adba2c (table test-table [id=8f52512798db4475a60d84171d4ccf19]) successfully deleted
I20260812 01:05:48.667194 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 15083
I20260812 01:05:48.670123 15182 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:48.683344 17331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:48.639321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46116 (local address 127.4.201.125:46425)
0812 01:05:48.639502 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:48.639509 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:48.665924 (+ 26415us) server_negotiation.cc:407] Connection header received
0812 01:05:48.666314 (+ 390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:48.666321 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:48.666414 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:48.666494 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:48.669358 (+ 2864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.670461 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.672263 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.672965 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.673112 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:48.676754 (+ 3642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:48.676761 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:48.676766 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:48.676808 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:48.680381 (+ 3573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:48.681184 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:48.681191 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:48.681194 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:48.681386 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:48.681817 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:48.681822 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:48.681826 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:48.682204 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:48.682450 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:48.682799 (+ 349us) server_negotiation.cc:299] Negotiation successful
0812 01:05:48.683033 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 01:05:48.702349 17316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:48.666068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41106 (local address 127.4.201.124:41233)
0812 01:05:48.666240 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:48.666246 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:48.683410 (+ 17164us) server_negotiation.cc:407] Connection header received
0812 01:05:48.683697 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:48.683703 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:48.683793 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:48.683901 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:48.685652 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.686716 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.688592 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.689204 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.689371 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:48.693087 (+ 3716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:48.693094 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:48.693099 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:48.693146 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:48.698927 (+ 5781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:48.699805 (+ 878us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:48.699812 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:48.699815 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:48.699976 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:48.700461 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:48.700466 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:48.700470 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:48.700870 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:48.701112 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:48.701717 (+ 605us) server_negotiation.cc:299] Negotiation successful
0812 01:05:48.701974 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 01:05:48.811066 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 15083
I20260812 01:05:48.881417 17331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:48.851506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46130 (local address 127.4.201.125:46425)
0812 01:05:48.852624 (+ 1118us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:48.852631 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:48.860582 (+ 7951us) server_negotiation.cc:407] Connection header received
0812 01:05:48.862025 (+ 1443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:48.862032 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:48.862128 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:48.862210 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:48.866969 (+ 4759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.868235 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.870652 (+ 2417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.871274 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.871398 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:48.875261 (+ 3863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:48.875268 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:48.875273 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:48.875327 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:48.878745 (+ 3418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:48.879446 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:48.879452 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:48.879456 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:48.879603 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:48.879951 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:48.879956 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:48.879960 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:48.880256 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:48.880516 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:48.880839 (+ 323us) server_negotiation.cc:299] Negotiation successful
0812 01:05:48.881060 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":978}
I20260812 01:05:48.884496 17316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:48.851481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41112 (local address 127.4.201.124:41233)
0812 01:05:48.853632 (+ 2151us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:48.853639 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:48.867795 (+ 14156us) server_negotiation.cc:407] Connection header received
0812 01:05:48.868630 (+ 835us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:48.868636 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:48.868725 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:48.868797 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:48.871542 (+ 2745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.872638 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.874507 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:48.875309 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:48.875450 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:48.878454 (+ 3004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:48.878461 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:48.878466 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:48.878505 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:48.882025 (+ 3520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:48.882644 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:48.882649 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:48.882652 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:48.882780 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:48.883155 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:48.883160 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:48.883164 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:48.883435 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:48.883657 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:48.883978 (+ 321us) server_negotiation.cc:299] Negotiation successful
0812 01:05:48.884197 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2007}
I20260812 01:05:49.618351 17424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:49.617601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.4.201.65:45385)
0812 01:05:49.618061 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:49.618186 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":223,"threads_started":1}
W20260812 01:05:49.618818 16824 heartbeater.cc:644] Failed to heartbeat to 127.4.201.126:33537 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
I20260812 01:05:49.624050 17429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:49.623231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.4.201.67:51097)
0812 01:05:49.623701 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:49.623844 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":246,"threads_started":1}
W20260812 01:05:49.624418 17302 heartbeater.cc:644] Failed to heartbeat to 127.4.201.126:33537 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
I20260812 01:05:49.638013 17430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:49.637317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.4.201.66:40053)
0812 01:05:49.637724 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:49.637839 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":194,"threads_started":1}
W20260812 01:05:49.638408 17064 heartbeater.cc:644] Failed to heartbeat to 127.4.201.126:33537 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
I20260812 01:05:50.133728 17432 raft_consensus.cc:482] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 081f650c09e54aa883c6738258615c15)
I20260812 01:05:50.134039 17432 raft_consensus.cc:504] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: false } }
I20260812 01:05:50.135169 17433 raft_consensus.cc:482] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 081f650c09e54aa883c6738258615c15)
I20260812 01:05:50.135476 17432 leader_election.cc:288] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 081f650c09e54aa883c6738258615c15 (127.4.201.126:33537), e1c5c0b2488d4caa9a7c97fa81dbb68a (127.4.201.125:46425)
I20260812 01:05:50.135437 17433 raft_consensus.cc:504] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: false } }
I20260812 01:05:50.136744 17437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:50.135632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.0.0.1:51400)
0812 01:05:50.136255 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:50.136479 (+ 224us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":474,"threads_started":1}
W20260812 01:05:50.137817 16433 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
I20260812 01:05:50.137889 17433 leader_election.cc:288] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 081f650c09e54aa883c6738258615c15 (127.4.201.126:33537), ace92aa71c3f4ee89cc1be563b67418f (127.4.201.124:41233)
I20260812 01:05:50.138806 17440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:50.137176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.0.0.1:51414)
0812 01:05:50.138367 (+ 1191us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:50.138556 (+ 189us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1080,"thread_start_us":957,"threads_started":1}
W20260812 01:05:50.139128 16104 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
I20260812 01:05:50.141562 17435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:50.141002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.0.0.1:51422)
0812 01:05:50.141162 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:50.141355 (+ 193us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260812 01:05:50.141906 16433 leader_election.cc:334] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 081f650c09e54aa883c6738258615c15 (127.4.201.126:33537): Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
I20260812 01:05:50.143883 17445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:50.143200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.0.0.1:51428)
0812 01:05:50.143393 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:50.143651 (+ 258us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260812 01:05:50.144131 16104 leader_election.cc:334] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 081f650c09e54aa883c6738258615c15 (127.4.201.126:33537): Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
I20260812 01:05:50.146479 17437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:50.135721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:46425 (local address 127.0.0.1:46144)
0812 01:05:50.137052 (+ 1331us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:50.137072 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:50.137245 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:50.140161 (+ 2916us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:50.140166 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:50.140195 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:50.140523 (+ 328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:50.140540 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:50.142394 (+ 1854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:50.142404 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:50.144392 (+ 1988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:50.144407 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:50.145595 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:50.145601 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:50.145846 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:50.145873 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 01:05:50.145967 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 01:05:50.146156 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1222,"mutex_wait_us":35,"thread_start_us":544,"threads_started":1}
I20260812 01:05:50.146534 17439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:50.136051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46144 (local address 127.4.201.125:46425)
0812 01:05:50.139794 (+ 3743us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:50.139801 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:50.139821 (+ 20us) server_negotiation.cc:407] Connection header received
0812 01:05:50.139895 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:50.139901 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:50.139978 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:50.140693 (+ 715us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:50.140934 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:50.142200 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:50.144540 (+ 2340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:50.145423 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:50.145549 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:50.145643 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:50.146000 (+ 357us) server_negotiation.cc:299] Negotiation successful
0812 01:05:50.146132 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3630,"thread_start_us":3425,"threads_started":1}
I20260812 01:05:50.147125 17440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:50.138557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:41233 (local address 127.0.0.1:41126)
0812 01:05:50.139068 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:50.139086 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:50.139223 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:50.141394 (+ 2171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:50.141400 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:50.141431 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:50.141772 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:50.141783 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:50.143479 (+ 1696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:50.143484 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:50.144994 (+ 1510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:50.145011 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:50.146301 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:50.146305 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:50.146467 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:50.146508 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 01:05:50.146746 (+ 238us) client_negotiation.cc:240] Negotiation successful
0812 01:05:50.146889 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":3633,"threads_started":1}
I20260812 01:05:50.147425 17450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:50.140274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41126 (local address 127.4.201.124:41233)
0812 01:05:50.141012 (+ 738us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:50.141019 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:50.141046 (+ 27us) server_negotiation.cc:407] Connection header received
0812 01:05:50.141110 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:50.141116 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:50.141190 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:50.141923 (+ 733us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:50.142227 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:50.143352 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:50.145152 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:50.146081 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:50.146879 (+ 798us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:50.146977 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:50.147023 (+ 46us) server_negotiation.cc:299] Negotiation successful
0812 01:05:50.147114 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":81,"server-negotiator.queue_time_us":594,"thread_start_us":454,"threads_started":1}
I20260812 01:05:50.147293 16146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ace92aa71c3f4ee89cc1be563b67418f" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" is_pre_election: true
I20260812 01:05:50.147625 16146 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ace92aa71c3f4ee89cc1be563b67418f in term 1.
I20260812 01:05:50.147928 16478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "ace92aa71c3f4ee89cc1be563b67418f" is_pre_election: true
I20260812 01:05:50.148138 16431 leader_election.cc:302] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ace92aa71c3f4ee89cc1be563b67418f, e1c5c0b2488d4caa9a7c97fa81dbb68a; no voters: 081f650c09e54aa883c6738258615c15
I20260812 01:05:50.148263 16478 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1c5c0b2488d4caa9a7c97fa81dbb68a in term 1.
I20260812 01:05:50.148564 17432 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 01:05:50.148696 17432 raft_consensus.cc:482] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 081f650c09e54aa883c6738258615c15)
I20260812 01:05:50.148795 17432 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [term 1 FOLLOWER]: Advancing to term 2
I20260812 01:05:50.148746 16105 leader_election.cc:302] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ace92aa71c3f4ee89cc1be563b67418f, e1c5c0b2488d4caa9a7c97fa81dbb68a; no voters: 081f650c09e54aa883c6738258615c15
I20260812 01:05:50.149121 17433 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 01:05:50.149271 17433 raft_consensus.cc:482] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 081f650c09e54aa883c6738258615c15)
I20260812 01:05:50.149379 17433 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [term 1 FOLLOWER]: Advancing to term 2
I20260812 01:05:50.151943 17432 raft_consensus.cc:504] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: false } }
I20260812 01:05:50.152293 17433 raft_consensus.cc:504] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: false } }
I20260812 01:05:50.152730 17432 leader_election.cc:288] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [CANDIDATE]: Term 2 election: Requested vote from peers 081f650c09e54aa883c6738258615c15 (127.4.201.126:33537), e1c5c0b2488d4caa9a7c97fa81dbb68a (127.4.201.125:46425)
I20260812 01:05:50.153033 17433 leader_election.cc:288] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [CANDIDATE]: Term 2 election: Requested vote from peers 081f650c09e54aa883c6738258615c15 (127.4.201.126:33537), ace92aa71c3f4ee89cc1be563b67418f (127.4.201.124:41233)
I20260812 01:05:50.153280 17437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:50.152805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.0.0.1:51444)
0812 01:05:50.153021 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:50.153109 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260812 01:05:50.153249 16146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ace92aa71c3f4ee89cc1be563b67418f" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a"
I20260812 01:05:50.153529 16478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "ace92aa71c3f4ee89cc1be563b67418f"
I20260812 01:05:50.153677 16146 raft_consensus.cc:2379] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ace92aa71c3f4ee89cc1be563b67418f in current term 2: Already voted for candidate e1c5c0b2488d4caa9a7c97fa81dbb68a in this term.
I20260812 01:05:50.153796 16478 raft_consensus.cc:2379] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e1c5c0b2488d4caa9a7c97fa81dbb68a in current term 2: Already voted for candidate ace92aa71c3f4ee89cc1be563b67418f in this term.
I20260812 01:05:50.154243 17440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:50.153371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.0.0.1:51460)
0812 01:05:50.154008 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:50.154091 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":529}
I20260812 01:05:50.154625 17437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:50.153887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.0.0.1:51464)
0812 01:05:50.154401 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:50.154501 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":419}
W20260812 01:05:50.154875 16433 leader_election.cc:334] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 081f650c09e54aa883c6738258615c15 (127.4.201.126:33537): Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
I20260812 01:05:50.155004 16433 leader_election.cc:302] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ace92aa71c3f4ee89cc1be563b67418f; no voters: 081f650c09e54aa883c6738258615c15, e1c5c0b2488d4caa9a7c97fa81dbb68a
I20260812 01:05:50.155139 17440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:50.154791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.0.0.1:51472)
0812 01:05:50.154923 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:50.155025 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260812 01:05:50.155278 16104 leader_election.cc:334] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 081f650c09e54aa883c6738258615c15 (127.4.201.126:33537): Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
I20260812 01:05:50.155377 16104 leader_election.cc:302] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1c5c0b2488d4caa9a7c97fa81dbb68a; no voters: 081f650c09e54aa883c6738258615c15, ace92aa71c3f4ee89cc1be563b67418f
I20260812 01:05:50.155512 17432 raft_consensus.cc:2726] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 01:05:50.155633 17433 raft_consensus.cc:2726] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 01:05:50.620288 17451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:50.619487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.4.201.65:35093)
0812 01:05:50.619934 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:50.620044 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":239,"threads_started":1}
I20260812 01:05:50.625684 17452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:50.624992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.4.201.67:38199)
0812 01:05:50.625402 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:50.625511 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":241,"threads_started":1}
I20260812 01:05:50.639704 17453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:50.639038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.4.201.66:38141)
0812 01:05:50.639458 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:50.639552 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":221,"threads_started":1}
I20260812 01:05:51.622031 17454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:51.621255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.4.201.65:55321)
0812 01:05:51.621719 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:51.621820 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":233,"threads_started":1}
I20260812 01:05:51.627118 17457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:51.626420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.4.201.67:40135)
0812 01:05:51.626842 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:51.626924 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":214,"threads_started":1}
I20260812 01:05:51.641323 17458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:51.640473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.4.201.66:52555)
0812 01:05:51.640997 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:51.641099 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":264,"threads_started":1}
I20260812 01:05:51.831904 17459 raft_consensus.cc:482] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:05:51.832084 17459 raft_consensus.cc:504] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: false } }
I20260812 01:05:51.832652 17459 leader_election.cc:288] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 081f650c09e54aa883c6738258615c15 (127.4.201.126:33537), e1c5c0b2488d4caa9a7c97fa81dbb68a (127.4.201.125:46425)
I20260812 01:05:51.833165 16146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ace92aa71c3f4ee89cc1be563b67418f" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" is_pre_election: true
I20260812 01:05:51.833460 16146 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ace92aa71c3f4ee89cc1be563b67418f in term 2.
I20260812 01:05:51.833670 17461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:51.832816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.0.0.1:51712)
0812 01:05:51.833332 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:51.833469 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":257,"threads_started":1}
I20260812 01:05:51.833896 16431 leader_election.cc:302] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ace92aa71c3f4ee89cc1be563b67418f, e1c5c0b2488d4caa9a7c97fa81dbb68a; no voters:
I20260812 01:05:51.834295 17459 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 01:05:51.834430 17459 raft_consensus.cc:482] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:05:51.834537 17459 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [term 2 FOLLOWER]: Advancing to term 3
I20260812 01:05:51.835071 17461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:51.834709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.0.0.1:51728)
0812 01:05:51.834848 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:51.834941 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260812 01:05:51.835253 16433 leader_election.cc:334] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 081f650c09e54aa883c6738258615c15 (127.4.201.126:33537): Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
I20260812 01:05:51.837206 17459 raft_consensus.cc:504] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: false } }
I20260812 01:05:51.837796 17459 leader_election.cc:288] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [CANDIDATE]: Term 3 election: Requested vote from peers 081f650c09e54aa883c6738258615c15 (127.4.201.126:33537), e1c5c0b2488d4caa9a7c97fa81dbb68a (127.4.201.125:46425)
I20260812 01:05:51.838330 17461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:51.837940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.0.0.1:51732)
0812 01:05:51.838100 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:51.838176 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260812 01:05:51.838301 16146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ace92aa71c3f4ee89cc1be563b67418f" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a"
I20260812 01:05:51.838534 16146 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [term 2 FOLLOWER]: Advancing to term 3
I20260812 01:05:51.839285 17461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:51.838919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.0.0.1:51742)
0812 01:05:51.839068 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:51.839150 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260812 01:05:51.839444 16433 leader_election.cc:334] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 081f650c09e54aa883c6738258615c15 (127.4.201.126:33537): Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
I20260812 01:05:51.840879 16146 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ace92aa71c3f4ee89cc1be563b67418f in term 3.
I20260812 01:05:51.841293 16431 leader_election.cc:302] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ace92aa71c3f4ee89cc1be563b67418f, e1c5c0b2488d4caa9a7c97fa81dbb68a; no voters: 081f650c09e54aa883c6738258615c15
I20260812 01:05:51.841588 17459 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [term 3 FOLLOWER]: Leader election won for term 3
I20260812 01:05:51.841993 17459 raft_consensus.cc:686] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [term 3 LEADER]: Becoming Leader. State: Replica: ace92aa71c3f4ee89cc1be563b67418f, State: Running, Role: LEADER
I20260812 01:05:51.842370 17459 consensus_queue.cc:237] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: false } }
I20260812 01:05:51.843948 17464 sys_catalog.cc:455] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [sys.catalog]: SysCatalogTable state changed. Reason: New leader ace92aa71c3f4ee89cc1be563b67418f. Latest consensus state: current_term: 3 leader_uuid: "ace92aa71c3f4ee89cc1be563b67418f" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: false } } }
I20260812 01:05:51.844236 17464 sys_catalog.cc:458] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:51.844810 17467 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:05:51.848608 17467 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:05:51.849468 17467 catalog_manager.cc:1259] Loaded cluster ID: 72fc76d9a85b4758a0868c4aac8aad14
I20260812 01:05:51.849553 17467 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:05:51.850728 17467 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:05:51.851549 17467 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f: Loaded TSK: 0
I20260812 01:05:51.852375 17467 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:05:51.911007 16457 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41112:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:05:51.917972 16457 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:05:51.922277 17461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:51.921822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.0.0.1:51760)
0812 01:05:51.922016 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:51.922110 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260812 01:05:51.922364 16146 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [term 3 FOLLOWER]: Refusing update from remote peer ace92aa71c3f4ee89cc1be563b67418f: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260812 01:05:51.923056 17464 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260812 01:05:51.923295 17461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:51.922923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.0.0.1:51770)
0812 01:05:51.923089 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:51.923159 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260812 01:05:51.923509 16433 consensus_peers.cc:487] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f -> Peer 081f650c09e54aa883c6738258615c15 (127.4.201.126:33537): Couldn't send request to peer 081f650c09e54aa883c6738258615c15. Status: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 01:05:51.925843 17472 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [sys.catalog]: SysCatalogTable state changed. Reason: New leader ace92aa71c3f4ee89cc1be563b67418f. Latest consensus state: current_term: 3 leader_uuid: "ace92aa71c3f4ee89cc1be563b67418f" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: false } } }
I20260812 01:05:51.926163 17472 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:05:51.927320 17464 sys_catalog.cc:455] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "ace92aa71c3f4ee89cc1be563b67418f" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: false } } }
I20260812 01:05:51.927611 17464 sys_catalog.cc:458] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:51.929265 17472 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "ace92aa71c3f4ee89cc1be563b67418f" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "081f650c09e54aa883c6738258615c15" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33537 } } peers { permanent_uuid: "e1c5c0b2488d4caa9a7c97fa81dbb68a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 46425 } attrs { promote: false } } peers { permanent_uuid: "ace92aa71c3f4ee89cc1be563b67418f" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 41233 } attrs { promote: false } } }
I20260812 01:05:51.929540 17472 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1c5c0b2488d4caa9a7c97fa81dbb68a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:05:51.944900 17488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:51.936497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:36613 (local address 127.0.0.1:39520)
0812 01:05:51.937013 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:51.937030 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:51.937142 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:51.938064 (+ 922us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:51.938069 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:51.938093 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:51.938446 (+ 353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:51.938459 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:51.940045 (+ 1586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:51.940051 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:51.942165 (+ 2114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:51.942178 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:51.944016 (+ 1838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:51.944023 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:51.944237 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:51.944274 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 01:05:51.944364 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 01:05:51.944512 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":612,"threads_started":1}
I20260812 01:05:51.945783 17490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:51.936933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39520 (local address 127.4.201.65:36613)
0812 01:05:51.937511 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:51.937517 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:51.937540 (+ 23us) server_negotiation.cc:407] Connection header received
0812 01:05:51.937620 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:51.937626 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:51.937722 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:51.937832 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:51.938678 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:51.939860 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:51.942370 (+ 2510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:51.943654 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:51.943782 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:51.943902 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:51.945274 (+ 1372us) server_negotiation.cc:299] Negotiation successful
0812 01:05:51.945435 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":636,"threads_started":1}
I20260812 01:05:51.950038 16714 tablet_service.cc:1467] Processing CreateTablet for tablet 75764571b45240cda58488ce3f58f7de (DEFAULT_TABLE table=test-table [id=a06ce774f81b41fa8d568d1b303d7815]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:51.950534 16714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75764571b45240cda58488ce3f58f7de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:51.955487 17488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:51.937437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:40883 (local address 127.0.0.1:57702)
0812 01:05:51.946317 (+ 8880us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:51.946333 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:51.946421 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:51.950013 (+ 3592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:51.950018 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:51.950045 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:51.950196 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:51.950207 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:51.951535 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:51.951540 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:51.953246 (+ 1706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:51.953262 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:51.954806 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:51.954811 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:51.955000 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:51.955024 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 01:05:51.955097 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 01:05:51.955239 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8803,"thread_start_us":11820,"threads_started":1}
I20260812 01:05:51.955618 17494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:51.937587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57702 (local address 127.4.201.66:40883)
0812 01:05:51.949677 (+ 12090us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:51.949684 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:51.949705 (+ 21us) server_negotiation.cc:407] Connection header received
0812 01:05:51.949782 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:51.949788 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:51.949867 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:51.949975 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:51.950373 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:51.951362 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:51.953450 (+ 2088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:51.954586 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:51.954765 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:51.954862 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:51.955146 (+ 284us) server_negotiation.cc:299] Negotiation successful
0812 01:05:51.955280 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11946,"thread_start_us":11807,"threads_started":1}
I20260812 01:05:51.956498 16953 tablet_service.cc:1467] Processing CreateTablet for tablet 75764571b45240cda58488ce3f58f7de (DEFAULT_TABLE table=test-table [id=a06ce774f81b41fa8d568d1b303d7815]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:51.956964 16953 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75764571b45240cda58488ce3f58f7de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:51.959592 17461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:51.936089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:40181 (local address 127.0.0.1:34516)
0812 01:05:51.936225 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:51.936244 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:51.936361 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:51.954514 (+ 18153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:51.954519 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:51.954544 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:51.954818 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:51.954828 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:51.956149 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:51.956155 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:51.957830 (+ 1675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:51.957843 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:51.958960 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:51.958966 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:51.959107 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:51.959130 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 01:05:51.959208 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 01:05:51.959326 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 01:05:51.959707 17487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:51.936214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34516 (local address 127.4.201.67:40181)
0812 01:05:51.954239 (+ 18025us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:51.954243 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:51.954259 (+ 16us) server_negotiation.cc:407] Connection header received
0812 01:05:51.954317 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:51.954320 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:51.954375 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:51.954466 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:51.954975 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:51.955993 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:51.957982 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:51.958767 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:51.958884 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:51.958987 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:51.959251 (+ 264us) server_negotiation.cc:299] Negotiation successful
0812 01:05:51.959394 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17912,"thread_start_us":18378,"threads_started":1}
I20260812 01:05:51.960399 17192 tablet_service.cc:1467] Processing CreateTablet for tablet 75764571b45240cda58488ce3f58f7de (DEFAULT_TABLE table=test-table [id=a06ce774f81b41fa8d568d1b303d7815]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:51.960750 17192 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75764571b45240cda58488ce3f58f7de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:51.965114 17496 tablet_bootstrap.cc:492] T 75764571b45240cda58488ce3f58f7de P b442ca0236f04fb7aea55f3b9a8de884: Bootstrap starting.
I20260812 01:05:51.966192 17497 tablet_bootstrap.cc:492] T 75764571b45240cda58488ce3f58f7de P 216b202088db425cbeb2f5f7da3ed2c3: Bootstrap starting.
I20260812 01:05:51.966912 17496 tablet_bootstrap.cc:654] T 75764571b45240cda58488ce3f58f7de P b442ca0236f04fb7aea55f3b9a8de884: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:51.968027 17497 tablet_bootstrap.cc:654] T 75764571b45240cda58488ce3f58f7de P 216b202088db425cbeb2f5f7da3ed2c3: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:51.968115 17495 tablet_bootstrap.cc:492] T 75764571b45240cda58488ce3f58f7de P 0d9da262268f431ab7801aeae643ef8e: Bootstrap starting.
I20260812 01:05:51.969722 17495 tablet_bootstrap.cc:654] T 75764571b45240cda58488ce3f58f7de P 0d9da262268f431ab7801aeae643ef8e: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:51.970150 17497 tablet_bootstrap.cc:492] T 75764571b45240cda58488ce3f58f7de P 216b202088db425cbeb2f5f7da3ed2c3: No bootstrap required, opened a new log
I20260812 01:05:51.970284 17497 ts_tablet_manager.cc:1397] T 75764571b45240cda58488ce3f58f7de P 216b202088db425cbeb2f5f7da3ed2c3: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260812 01:05:51.971077 17497 raft_consensus.cc:348] T 75764571b45240cda58488ce3f58f7de P 216b202088db425cbeb2f5f7da3ed2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "216b202088db425cbeb2f5f7da3ed2c3" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 40181 } } peers { permanent_uuid: "0d9da262268f431ab7801aeae643ef8e" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 36613 } } peers { permanent_uuid: "b442ca0236f04fb7aea55f3b9a8de884" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 40883 } }
I20260812 01:05:51.971310 17497 raft_consensus.cc:374] T 75764571b45240cda58488ce3f58f7de P 216b202088db425cbeb2f5f7da3ed2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:51.971422 17497 raft_consensus.cc:729] T 75764571b45240cda58488ce3f58f7de P 216b202088db425cbeb2f5f7da3ed2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216b202088db425cbeb2f5f7da3ed2c3, State: Initialized, Role: FOLLOWER
I20260812 01:05:51.971496 17496 tablet_bootstrap.cc:492] T 75764571b45240cda58488ce3f58f7de P b442ca0236f04fb7aea55f3b9a8de884: No bootstrap required, opened a new log
I20260812 01:05:51.971645 17496 ts_tablet_manager.cc:1397] T 75764571b45240cda58488ce3f58f7de P b442ca0236f04fb7aea55f3b9a8de884: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260812 01:05:51.971803 17495 tablet_bootstrap.cc:492] T 75764571b45240cda58488ce3f58f7de P 0d9da262268f431ab7801aeae643ef8e: No bootstrap required, opened a new log
I20260812 01:05:51.971652 17497 consensus_queue.cc:260] T 75764571b45240cda58488ce3f58f7de P 216b202088db425cbeb2f5f7da3ed2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "216b202088db425cbeb2f5f7da3ed2c3" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 40181 } } peers { permanent_uuid: "0d9da262268f431ab7801aeae643ef8e" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 36613 } } peers { permanent_uuid: "b442ca0236f04fb7aea55f3b9a8de884" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 40883 } }
I20260812 01:05:51.971943 17495 ts_tablet_manager.cc:1397] T 75764571b45240cda58488ce3f58f7de P 0d9da262268f431ab7801aeae643ef8e: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260812 01:05:51.972447 17496 raft_consensus.cc:348] T 75764571b45240cda58488ce3f58f7de P b442ca0236f04fb7aea55f3b9a8de884 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "216b202088db425cbeb2f5f7da3ed2c3" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 40181 } } peers { permanent_uuid: "0d9da262268f431ab7801aeae643ef8e" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 36613 } } peers { permanent_uuid: "b442ca0236f04fb7aea55f3b9a8de884" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 40883 } }
I20260812 01:05:51.972710 17495 raft_consensus.cc:348] T 75764571b45240cda58488ce3f58f7de P 0d9da262268f431ab7801aeae643ef8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "216b202088db425cbeb2f5f7da3ed2c3" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 40181 } } peers { permanent_uuid: "0d9da262268f431ab7801aeae643ef8e" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 36613 } } peers { permanent_uuid: "b442ca0236f04fb7aea55f3b9a8de884" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 40883 } }
I20260812 01:05:51.972975 17495 raft_consensus.cc:374] T 75764571b45240cda58488ce3f58f7de P 0d9da262268f431ab7801aeae643ef8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:51.973111 17495 raft_consensus.cc:729] T 75764571b45240cda58488ce3f58f7de P 0d9da262268f431ab7801aeae643ef8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d9da262268f431ab7801aeae643ef8e, State: Initialized, Role: FOLLOWER
I20260812 01:05:51.973111 17496 raft_consensus.cc:374] T 75764571b45240cda58488ce3f58f7de P b442ca0236f04fb7aea55f3b9a8de884 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:51.973246 17496 raft_consensus.cc:729] T 75764571b45240cda58488ce3f58f7de P b442ca0236f04fb7aea55f3b9a8de884 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b442ca0236f04fb7aea55f3b9a8de884, State: Initialized, Role: FOLLOWER
I20260812 01:05:51.973425 17495 consensus_queue.cc:260] T 75764571b45240cda58488ce3f58f7de P 0d9da262268f431ab7801aeae643ef8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "216b202088db425cbeb2f5f7da3ed2c3" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 40181 } } peers { permanent_uuid: "0d9da262268f431ab7801aeae643ef8e" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 36613 } } peers { permanent_uuid: "b442ca0236f04fb7aea55f3b9a8de884" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 40883 } }
I20260812 01:05:51.973536 17496 consensus_queue.cc:260] T 75764571b45240cda58488ce3f58f7de P b442ca0236f04fb7aea55f3b9a8de884 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "216b202088db425cbeb2f5f7da3ed2c3" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 40181 } } peers { permanent_uuid: "0d9da262268f431ab7801aeae643ef8e" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 36613 } } peers { permanent_uuid: "b442ca0236f04fb7aea55f3b9a8de884" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 40883 } }
I20260812 01:05:51.974902 17496 ts_tablet_manager.cc:1428] T 75764571b45240cda58488ce3f58f7de P b442ca0236f04fb7aea55f3b9a8de884: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 01:05:51.975808 17454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:51.975362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.4.201.65:47833)
0812 01:05:51.975533 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:51.975640 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260812 01:05:51.976776 17458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:51.976358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.4.201.66:41049)
0812 01:05:51.976534 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:51.976635 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 01:05:51.977385 17495 ts_tablet_manager.cc:1428] T 75764571b45240cda58488ce3f58f7de P 0d9da262268f431ab7801aeae643ef8e: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260812 01:05:51.978395 17454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:51.977931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.4.201.65:57733)
0812 01:05:51.978156 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:51.978246 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125}
I20260812 01:05:51.978749 17063 heartbeater.cc:503] Master 127.4.201.124:41233 was elected leader, sending a full tablet report...
I20260812 01:05:51.978889 16823 heartbeater.cc:503] Master 127.4.201.124:41233 was elected leader, sending a full tablet report...
I20260812 01:05:51.980571 17497 ts_tablet_manager.cc:1428] T 75764571b45240cda58488ce3f58f7de P 216b202088db425cbeb2f5f7da3ed2c3: Time spent starting tablet: real 0.010s user 0.002s sys 0.004s
I20260812 01:05:51.981365 17457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:51.980911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.4.201.67:33841)
0812 01:05:51.981073 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:51.981167 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260812 01:05:51.982298 17301 heartbeater.cc:503] Master 127.4.201.124:41233 was elected leader, sending a full tablet report...
I20260812 01:05:51.982942 17457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:51.982516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.4.201.67:36617)
0812 01:05:51.982705 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:51.982792 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260812 01:05:52.155150 17506 raft_consensus.cc:482] T 75764571b45240cda58488ce3f58f7de P b442ca0236f04fb7aea55f3b9a8de884 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:05:52.155417 17506 raft_consensus.cc:504] T 75764571b45240cda58488ce3f58f7de P b442ca0236f04fb7aea55f3b9a8de884 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "216b202088db425cbeb2f5f7da3ed2c3" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 40181 } } peers { permanent_uuid: "0d9da262268f431ab7801aeae643ef8e" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 36613 } } peers { permanent_uuid: "b442ca0236f04fb7aea55f3b9a8de884" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 40883 } }
I20260812 01:05:52.157085 17506 leader_election.cc:288] T 75764571b45240cda58488ce3f58f7de P b442ca0236f04fb7aea55f3b9a8de884 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 216b202088db425cbeb2f5f7da3ed2c3 (127.4.201.67:40181), 0d9da262268f431ab7801aeae643ef8e (127.4.201.65:36613)
I20260812 01:05:52.162732 17487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:52.157507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:48567 (local address 127.4.201.67:40181)
0812 01:05:52.157808 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:52.157814 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:52.157835 (+ 21us) server_negotiation.cc:407] Connection header received
0812 01:05:52.157999 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:52.158003 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:52.158063 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:52.158140 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:52.158635 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:52.159368 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:52.161061 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:52.161862 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:52.162027 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:52.162105 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:52.162352 (+ 247us) server_negotiation.cc:299] Negotiation successful
0812 01:05:52.162477 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132}
I20260812 01:05:52.162750 17458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:52.157339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:40181 (local address 127.4.201.66:48567)
0812 01:05:52.157642 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:52.157663 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:52.157820 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:52.158196 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:52.158202 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:52.158232 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:52.158488 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:52.158498 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:52.159518 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:52.159522 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:52.160907 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:52.160919 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:52.162045 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:52.162052 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:52.162208 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:52.162232 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 01:05:52.162316 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 01:05:52.162458 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181}
I20260812 01:05:52.163138 17490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:52.157522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:58913 (local address 127.4.201.65:36613)
0812 01:05:52.157770 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:52.157777 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:52.158281 (+ 504us) server_negotiation.cc:407] Connection header received
0812 01:05:52.158463 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:52.158467 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:52.158528 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:52.158604 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:52.159112 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:52.159791 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:52.161467 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:52.162239 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:52.162393 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:52.162463 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:52.162750 (+ 287us) server_negotiation.cc:299] Negotiation successful
0812 01:05:52.162880 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260812 01:05:52.163266 17508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:52.157558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:36613 (local address 127.4.201.66:58913)
0812 01:05:52.158180 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:52.158194 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:52.158327 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:52.158636 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:52.158640 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:52.158664 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:52.158968 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:52.158977 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:52.159924 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:52.159929 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:52.161319 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:52.161332 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:52.162448 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:52.162455 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:52.162608 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:52.162631 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 01:05:52.162710 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 01:05:52.162965 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":382,"threads_started":1}
I20260812 01:05:52.163647 17224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75764571b45240cda58488ce3f58f7de" candidate_uuid: "b442ca0236f04fb7aea55f3b9a8de884" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216b202088db425cbeb2f5f7da3ed2c3" is_pre_election: true
I20260812 01:05:52.163969 16749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75764571b45240cda58488ce3f58f7de" candidate_uuid: "b442ca0236f04fb7aea55f3b9a8de884" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9da262268f431ab7801aeae643ef8e" is_pre_election: true
I20260812 01:05:52.164093 17224 raft_consensus.cc:2454] T 75764571b45240cda58488ce3f58f7de P 216b202088db425cbeb2f5f7da3ed2c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b442ca0236f04fb7aea55f3b9a8de884 in term 0.
I20260812 01:05:52.164222 16749 raft_consensus.cc:2454] T 75764571b45240cda58488ce3f58f7de P 0d9da262268f431ab7801aeae643ef8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b442ca0236f04fb7aea55f3b9a8de884 in term 0.
I20260812 01:05:52.164685 16880 leader_election.cc:302] T 75764571b45240cda58488ce3f58f7de P b442ca0236f04fb7aea55f3b9a8de884 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216b202088db425cbeb2f5f7da3ed2c3, b442ca0236f04fb7aea55f3b9a8de884; no voters:
I20260812 01:05:52.165045 17506 raft_consensus.cc:2781] T 75764571b45240cda58488ce3f58f7de P b442ca0236f04fb7aea55f3b9a8de884 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:05:52.165179 17506 raft_consensus.cc:482] T 75764571b45240cda58488ce3f58f7de P b442ca0236f04fb7aea55f3b9a8de884 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:05:52.165305 17506 raft_consensus.cc:3037] T 75764571b45240cda58488ce3f58f7de P b442ca0236f04fb7aea55f3b9a8de884 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:52.167415 17506 raft_consensus.cc:504] T 75764571b45240cda58488ce3f58f7de P b442ca0236f04fb7aea55f3b9a8de884 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "216b202088db425cbeb2f5f7da3ed2c3" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 40181 } } peers { permanent_uuid: "0d9da262268f431ab7801aeae643ef8e" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 36613 } } peers { permanent_uuid: "b442ca0236f04fb7aea55f3b9a8de884" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 40883 } }
I20260812 01:05:52.168080 17506 leader_election.cc:288] T 75764571b45240cda58488ce3f58f7de P b442ca0236f04fb7aea55f3b9a8de884 [CANDIDATE]: Term 1 election: Requested vote from peers 216b202088db425cbeb2f5f7da3ed2c3 (127.4.201.67:40181), 0d9da262268f431ab7801aeae643ef8e (127.4.201.65:36613)
I20260812 01:05:52.168488 17224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75764571b45240cda58488ce3f58f7de" candidate_uuid: "b442ca0236f04fb7aea55f3b9a8de884" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "216b202088db425cbeb2f5f7da3ed2c3"
I20260812 01:05:52.168720 17224 raft_consensus.cc:3037] T 75764571b45240cda58488ce3f58f7de P 216b202088db425cbeb2f5f7da3ed2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:52.168664 16749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75764571b45240cda58488ce3f58f7de" candidate_uuid: "b442ca0236f04fb7aea55f3b9a8de884" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d9da262268f431ab7801aeae643ef8e"
I20260812 01:05:52.168882 16749 raft_consensus.cc:3037] T 75764571b45240cda58488ce3f58f7de P 0d9da262268f431ab7801aeae643ef8e [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:52.171775 16749 raft_consensus.cc:2454] T 75764571b45240cda58488ce3f58f7de P 0d9da262268f431ab7801aeae643ef8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b442ca0236f04fb7aea55f3b9a8de884 in term 1.
I20260812 01:05:52.171775 17224 raft_consensus.cc:2454] T 75764571b45240cda58488ce3f58f7de P 216b202088db425cbeb2f5f7da3ed2c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b442ca0236f04fb7aea55f3b9a8de884 in term 1.
I20260812 01:05:52.172186 16880 leader_election.cc:302] T 75764571b45240cda58488ce3f58f7de P b442ca0236f04fb7aea55f3b9a8de884 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216b202088db425cbeb2f5f7da3ed2c3, b442ca0236f04fb7aea55f3b9a8de884; no voters:
I20260812 01:05:52.172480 17506 raft_consensus.cc:2781] T 75764571b45240cda58488ce3f58f7de P b442ca0236f04fb7aea55f3b9a8de884 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:05:52.172904 17506 raft_consensus.cc:686] T 75764571b45240cda58488ce3f58f7de P b442ca0236f04fb7aea55f3b9a8de884 [term 1 LEADER]: Becoming Leader. State: Replica: b442ca0236f04fb7aea55f3b9a8de884, State: Running, Role: LEADER
I20260812 01:05:52.173563 17506 consensus_queue.cc:237] T 75764571b45240cda58488ce3f58f7de P b442ca0236f04fb7aea55f3b9a8de884 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "216b202088db425cbeb2f5f7da3ed2c3" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 40181 } } peers { permanent_uuid: "0d9da262268f431ab7801aeae643ef8e" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 36613 } } peers { permanent_uuid: "b442ca0236f04fb7aea55f3b9a8de884" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 40883 } }
I20260812 01:05:52.173985 17508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:52.173456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.4.201.66:55045)
0812 01:05:52.173715 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:52.173830 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149}
I20260812 01:05:52.177573 16457 catalog_manager.cc:5495] T 75764571b45240cda58488ce3f58f7de P b442ca0236f04fb7aea55f3b9a8de884 reported cstate change: term changed from 0 to 1, leader changed from <none> to b442ca0236f04fb7aea55f3b9a8de884 (127.4.201.66). New cstate: current_term: 1 leader_uuid: "b442ca0236f04fb7aea55f3b9a8de884" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "216b202088db425cbeb2f5f7da3ed2c3" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 40181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d9da262268f431ab7801aeae643ef8e" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 36613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b442ca0236f04fb7aea55f3b9a8de884" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 40883 } health_report { overall_health: HEALTHY } } }
I20260812 01:05:52.236749 17494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:52.232120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57704 (local address 127.4.201.66:40883)
0812 01:05:52.232289 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:52.232294 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:52.232313 (+ 19us) server_negotiation.cc:407] Connection header received
0812 01:05:52.232492 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:52.232496 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:52.232589 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:52.232713 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:05:52.232991 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:52.233720 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:52.234976 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:52.235409 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:52.235511 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:52.235819 (+ 308us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:05:52.236333 (+ 514us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:05:52.236439 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:52.236484 (+ 45us) server_negotiation.cc:299] Negotiation successful
0812 01:05:52.236548 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 01:05:52.240914 16749 raft_consensus.cc:1261] T 75764571b45240cda58488ce3f58f7de P 0d9da262268f431ab7801aeae643ef8e [term 1 FOLLOWER]: Refusing update from remote peer b442ca0236f04fb7aea55f3b9a8de884: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:52.241297 17224 raft_consensus.cc:1261] T 75764571b45240cda58488ce3f58f7de P 216b202088db425cbeb2f5f7da3ed2c3 [term 1 FOLLOWER]: Refusing update from remote peer b442ca0236f04fb7aea55f3b9a8de884: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:52.241730 17509 consensus_queue.cc:1035] T 75764571b45240cda58488ce3f58f7de P b442ca0236f04fb7aea55f3b9a8de884 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d9da262268f431ab7801aeae643ef8e" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 36613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:52.242208 17506 consensus_queue.cc:1035] T 75764571b45240cda58488ce3f58f7de P b442ca0236f04fb7aea55f3b9a8de884 [LEADER]: Connected to new peer: Peer: permanent_uuid: "216b202088db425cbeb2f5f7da3ed2c3" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 40181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:52.244997 17454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:52.244484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.4.201.65:45603)
0812 01:05:52.244715 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:52.244812 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
I20260812 01:05:52.245615 17457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:52.244713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.4.201.67:33219)
0812 01:05:52.245363 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:52.245463 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":537}
I20260812 01:05:52.250440 17457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:52.250016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.4.201.67:36935)
0812 01:05:52.250161 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:52.250253 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260812 01:05:52.256258 17508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:52.255671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.4.201.66:37461)
0812 01:05:52.255998 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:52.256089 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226}
I20260812 01:05:52.263074 17514 mvcc.cc:205] Tried to move back new op lower bound from 7317490697171275776 to 7317490696906899456. Current Snapshot: MvccSnapshot[applied={T|T < 7317490697171275776}]
I20260812 01:05:52.263939 17454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:52.263323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.4.201.65:58303)
0812 01:05:52.263623 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:52.263722 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166}
I20260812 01:05:52.270530 17508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:52.270047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.4.201.66:33411)
0812 01:05:52.270248 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:52.270338 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
I20260812 01:05:52.275120 16457 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41112:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:05:52.275415 16457 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41112:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:05:52.280735 16457 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ace92aa71c3f4ee89cc1be563b67418f: Sending DeleteTablet for 3 replicas of tablet 75764571b45240cda58488ce3f58f7de
I20260812 01:05:52.281735 17192 tablet_service.cc:1514] Processing DeleteTablet for tablet 75764571b45240cda58488ce3f58f7de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:52 UTC) from {username='oryx', principal='oryx/127.4.201.124@KRBTEST.COM'} at 127.0.0.1:34516
I20260812 01:05:52.282220 16714 tablet_service.cc:1514] Processing DeleteTablet for tablet 75764571b45240cda58488ce3f58f7de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:52 UTC) from {username='oryx', principal='oryx/127.4.201.124@KRBTEST.COM'} at 127.0.0.1:39520
I20260812 01:05:52.282428 17531 tablet_replica.cc:330] T 75764571b45240cda58488ce3f58f7de P 216b202088db425cbeb2f5f7da3ed2c3: stopping tablet replica
I20260812 01:05:52.282634 17531 raft_consensus.cc:2229] T 75764571b45240cda58488ce3f58f7de P 216b202088db425cbeb2f5f7da3ed2c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:05:52.282958 17531 raft_consensus.cc:2258] T 75764571b45240cda58488ce3f58f7de P 216b202088db425cbeb2f5f7da3ed2c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:52.284199 17531 ts_tablet_manager.cc:1905] T 75764571b45240cda58488ce3f58f7de P 216b202088db425cbeb2f5f7da3ed2c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:52.284603 16953 tablet_service.cc:1514] Processing DeleteTablet for tablet 75764571b45240cda58488ce3f58f7de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:52 UTC) from {username='oryx', principal='oryx/127.4.201.124@KRBTEST.COM'} at 127.0.0.1:57702
I20260812 01:05:52.285549 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 16414
I20260812 01:05:52.291476 17531 ts_tablet_manager.cc:1918] T 75764571b45240cda58488ce3f58f7de P 216b202088db425cbeb2f5f7da3ed2c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:05:52.291626 17531 log.cc:1196] T 75764571b45240cda58488ce3f58f7de P 216b202088db425cbeb2f5f7da3ed2c3: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-2/wal/wals/75764571b45240cda58488ce3f58f7de
I20260812 01:05:52.292090 17531 ts_tablet_manager.cc:1939] T 75764571b45240cda58488ce3f58f7de P 216b202088db425cbeb2f5f7da3ed2c3: Deleting consensus metadata
I20260812 01:05:52.293337 16434 catalog_manager.cc:4841] TS 216b202088db425cbeb2f5f7da3ed2c3 (127.4.201.67:40181): tablet 75764571b45240cda58488ce3f58f7de (table test-table [id=a06ce774f81b41fa8d568d1b303d7815]) successfully deleted
I20260812 01:05:52.296813 17539 tablet_replica.cc:330] T 75764571b45240cda58488ce3f58f7de P b442ca0236f04fb7aea55f3b9a8de884: stopping tablet replica
I20260812 01:05:52.297034 17539 raft_consensus.cc:2229] T 75764571b45240cda58488ce3f58f7de P b442ca0236f04fb7aea55f3b9a8de884 [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:05:52.297706 17539 raft_consensus.cc:2258] T 75764571b45240cda58488ce3f58f7de P b442ca0236f04fb7aea55f3b9a8de884 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:52.298323 17536 tablet_replica.cc:330] T 75764571b45240cda58488ce3f58f7de P 0d9da262268f431ab7801aeae643ef8e: stopping tablet replica
I20260812 01:05:52.298759 17536 raft_consensus.cc:2229] T 75764571b45240cda58488ce3f58f7de P 0d9da262268f431ab7801aeae643ef8e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:05:52.299134 17539 ts_tablet_manager.cc:1905] T 75764571b45240cda58488ce3f58f7de P b442ca0236f04fb7aea55f3b9a8de884: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:52.299175 17536 raft_consensus.cc:2258] T 75764571b45240cda58488ce3f58f7de P 0d9da262268f431ab7801aeae643ef8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:52.300305 17536 ts_tablet_manager.cc:1905] T 75764571b45240cda58488ce3f58f7de P 0d9da262268f431ab7801aeae643ef8e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:52.306810 17539 ts_tablet_manager.cc:1918] T 75764571b45240cda58488ce3f58f7de P b442ca0236f04fb7aea55f3b9a8de884: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:05:52.306859 17536 ts_tablet_manager.cc:1918] T 75764571b45240cda58488ce3f58f7de P 0d9da262268f431ab7801aeae643ef8e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:05:52.306983 17539 log.cc:1196] T 75764571b45240cda58488ce3f58f7de P b442ca0236f04fb7aea55f3b9a8de884: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-1/wal/wals/75764571b45240cda58488ce3f58f7de
I20260812 01:05:52.307209 17536 log.cc:1196] T 75764571b45240cda58488ce3f58f7de P 0d9da262268f431ab7801aeae643ef8e: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786496689953932-4901-0/minicluster-data/ts-0/wal/wals/75764571b45240cda58488ce3f58f7de
I20260812 01:05:52.307495 17539 ts_tablet_manager.cc:1939] T 75764571b45240cda58488ce3f58f7de P b442ca0236f04fb7aea55f3b9a8de884: Deleting consensus metadata
I20260812 01:05:52.307837 17536 ts_tablet_manager.cc:1939] T 75764571b45240cda58488ce3f58f7de P 0d9da262268f431ab7801aeae643ef8e: Deleting consensus metadata
I20260812 01:05:52.308820 16436 catalog_manager.cc:4841] TS b442ca0236f04fb7aea55f3b9a8de884 (127.4.201.66:40883): tablet 75764571b45240cda58488ce3f58f7de (table test-table [id=a06ce774f81b41fa8d568d1b303d7815]) successfully deleted
I20260812 01:05:52.309134 16436 catalog_manager.cc:4841] TS 0d9da262268f431ab7801aeae643ef8e (127.4.201.65:36613): tablet 75764571b45240cda58488ce3f58f7de (table test-table [id=a06ce774f81b41fa8d568d1b303d7815]) successfully deleted
I20260812 01:05:52.315680 17490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:52.286571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39536 (local address 127.4.201.65:36613)
0812 01:05:52.286745 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:52.286751 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:52.298595 (+ 11844us) server_negotiation.cc:407] Connection header received
0812 01:05:52.298892 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:52.298898 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:52.299006 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:52.299083 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:52.302125 (+ 3042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:52.303372 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:52.305260 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:52.305894 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:52.305998 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:52.310042 (+ 4044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:52.310058 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:52.310076 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:52.310108 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:52.312929 (+ 2821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:52.313629 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:52.313637 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:52.313639 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:52.313773 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:52.314143 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:52.314147 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:52.314149 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:52.314522 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:52.314811 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:52.315141 (+ 330us) server_negotiation.cc:299] Negotiation successful
0812 01:05:52.315373 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 01:05:52.316272 16816 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:52.422079 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 16414
I20260812 01:05:52.434384 17461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:52.433883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.0.0.1:51784)
0812 01:05:52.434083 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:52.434195 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260812 01:05:52.435810 17461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:52.435410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33537 (local address 127.0.0.1:51790)
0812 01:05:52.435567 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:52.435650 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:33537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260812 01:05:52.451838 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 16837
I20260812 01:05:52.470975 17494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:52.453132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57714 (local address 127.4.201.66:40883)
0812 01:05:52.453354 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:52.453360 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:52.453389 (+ 29us) server_negotiation.cc:407] Connection header received
0812 01:05:52.453454 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:52.453459 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:52.453578 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:52.453678 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:52.455773 (+ 2095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:52.456986 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:52.458746 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:52.459514 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:52.459647 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:52.462952 (+ 3305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:52.462970 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:52.462992 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:52.463034 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:52.467306 (+ 4272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:52.468299 (+ 993us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:52.468311 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:52.468315 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:52.468545 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:52.469049 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:52.469054 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:52.469058 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:52.469636 (+ 578us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:52.469969 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:52.470321 (+ 352us) server_negotiation.cc:299] Negotiation successful
0812 01:05:52.470562 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 01:05:52.471714 17054 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:52.592985 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 16837
I20260812 01:05:52.619318 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 17088
I20260812 01:05:52.632642 17487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:52.620106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34522 (local address 127.4.201.67:40181)
0812 01:05:52.620305 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:52.620311 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:52.620331 (+ 20us) server_negotiation.cc:407] Connection header received
0812 01:05:52.620537 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:52.620541 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:52.620604 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:52.620691 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:52.622132 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:52.622869 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:52.624059 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:52.624477 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:52.624593 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:52.627106 (+ 2513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:52.627123 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:52.627143 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:52.627180 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:52.629973 (+ 2793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:52.630584 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:52.630592 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:52.630594 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:52.630733 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:52.631089 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:52.631092 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:52.631095 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:52.631508 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:52.631805 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:52.632112 (+ 307us) server_negotiation.cc:299] Negotiation successful
0812 01:05:52.632330 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 01:05:52.633356 17294 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:52.753250 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 17088
I20260812 01:05:52.783028 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 15910
I20260812 01:05:52.784180 16178 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:52.902591 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 15910
I20260812 01:05:52.927949 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 16072
I20260812 01:05:52.929015 16525 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:05:53.050951 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 16072
2026-08-12T01:05:53Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (11736 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:05:53 dist-test-slave-bndk krb5kdc[17561](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:05:53 dist-test-slave-bndk krb5kdc[17561](info): set up 2 sockets
Aug 12 01:05:53 dist-test-slave-bndk krb5kdc[17561](info): commencing operation
krb5kdc: starting...
W20260812 01:05:54.291549 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.191s user 0.000s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:05:54 dist-test-slave-bndk krb5kdc[17561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496754, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:05:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:05:54Z Disabled control of system clock
WARNING: no policy specified for oryx/127.4.201.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.201.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.201.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.126.keytab.
Entry for principal oryx/127.4.201.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.126.keytab.
I20260812 01:05:54.526803 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:44603
--webserver_interface=127.4.201.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.126.keytab
--principal=oryx/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:36243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:44603
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:54.851075 17587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:54.851362 17587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:54.851498 17587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:54.858523 17587 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:05:54.858624 17587 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 01:05:54.858690 17587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:54.858773 17587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:54.858834 17587 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:05:54.858919 17587 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:05:54.868461 17587 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:36243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:44603
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.126.keytab
--principal=oryx/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:44603
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:54.869717 17587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:54.871042 17587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:54.882525 17595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:54.882596 17601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:54.882560 17606 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:54.883345 17587 server_base.cc:1034] running on GCE node
I20260812 01:05:54.884078 17587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:54.885385 17587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:54.886607 17587 hybrid_clock.cc:648] HybridClock initialized: now 1786496754886550 us; error 31 us; skew 500 ppm
I20260812 01:05:54.886902 17587 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:54 dist-test-slave-bndk krb5kdc[17561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496754, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:54.889907 17587 init.cc:377] Logged in from keytab as oryx/127.4.201.126@KRBTEST.COM (short username oryx)
I20260812 01:05:54.891345 17587 webserver.cc:460] Webserver started at http://127.4.201.126:36595/ using document root <none> and password file <none>
I20260812 01:05:54.892016 17587 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:54.892118 17587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:54.892443 17587 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:54.895519 17587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "4c6e00c48ab34d75bf69a57126ac3d79"
format_stamp: "Formatted at 2026-08-12 01:05:54 on dist-test-slave-bndk"
server_key: "0008476d9b301acae910573ff300a0d8"
server_key_iv: "5da27fdebe92edea5f20e5d4145877b3"
server_key_version: "encryptionkey@0"
I20260812 01:05:54.896306 17587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "4c6e00c48ab34d75bf69a57126ac3d79"
format_stamp: "Formatted at 2026-08-12 01:05:54 on dist-test-slave-bndk"
server_key: "0008476d9b301acae910573ff300a0d8"
server_key_iv: "5da27fdebe92edea5f20e5d4145877b3"
server_key_version: "encryptionkey@0"
I20260812 01:05:54.901363 17587 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260812 01:05:54.904659 17614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:54.905975 17587 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:05:54.906131 17587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "4c6e00c48ab34d75bf69a57126ac3d79"
format_stamp: "Formatted at 2026-08-12 01:05:54 on dist-test-slave-bndk"
server_key: "0008476d9b301acae910573ff300a0d8"
server_key_iv: "5da27fdebe92edea5f20e5d4145877b3"
server_key_version: "encryptionkey@0"
I20260812 01:05:54.906329 17587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:54.921986 17587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:54.925590 17587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:54.925819 17587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:54.945436 17587 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:44603
I20260812 01:05:54.945461 17726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:44603 every 8 connection(s)
I20260812 01:05:54.946744 17587 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:05:54.950364 17727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:54.955992 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 17587
I20260812 01:05:54.956158 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:05:54.956776 4901 external_mini_cluster.cc:1428] Setting key 2a226d47b11a30e0c33a7d15d92a8af2
I20260812 01:05:54.960860 17727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c6e00c48ab34d75bf69a57126ac3d79: Bootstrap starting.
I20260812 01:05:54.964406 17727 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c6e00c48ab34d75bf69a57126ac3d79: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:54.965540 17727 log.cc:824] T 00000000000000000000000000000000 P 4c6e00c48ab34d75bf69a57126ac3d79: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:54.968405 17727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c6e00c48ab34d75bf69a57126ac3d79: No bootstrap required, opened a new log
Aug 12 01:05:54 dist-test-slave-bndk krb5kdc[17561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496754, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM
I20260812 01:05:54.977349 17727 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c6e00c48ab34d75bf69a57126ac3d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c6e00c48ab34d75bf69a57126ac3d79" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44603 } }
I20260812 01:05:54.977814 17727 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4c6e00c48ab34d75bf69a57126ac3d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:54.977928 17727 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c6e00c48ab34d75bf69a57126ac3d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c6e00c48ab34d75bf69a57126ac3d79, State: Initialized, Role: FOLLOWER
I20260812 01:05:54.978567 17727 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c6e00c48ab34d75bf69a57126ac3d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c6e00c48ab34d75bf69a57126ac3d79" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44603 } }
I20260812 01:05:54.978801 17727 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4c6e00c48ab34d75bf69a57126ac3d79 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:05:54.978937 17727 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c6e00c48ab34d75bf69a57126ac3d79 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:05:54.979115 17727 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c6e00c48ab34d75bf69a57126ac3d79 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:54.979346 17730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:54.958722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56452 (local address 127.4.201.126:44603)
0812 01:05:54.959524 (+ 802us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:54.959536 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:54.959580 (+ 44us) server_negotiation.cc:407] Connection header received
0812 01:05:54.961278 (+ 1698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:54.961300 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:54.961669 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:54.961968 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:54.963774 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:54.965103 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:54.966667 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:54.967298 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:54.967424 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:54.972085 (+ 4661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:54.972096 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:54.972110 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:54.972144 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:54.975118 (+ 2974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:54.975910 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:54.975916 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:54.975921 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:54.976079 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:54.976451 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:54.976454 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:54.976456 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:54.976958 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:54.977168 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:54.977632 (+ 464us) server_negotiation.cc:299] Negotiation successful
0812 01:05:54.978130 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":599,"thread_start_us":358,"threads_started":1}
I20260812 01:05:54.981462 17727 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c6e00c48ab34d75bf69a57126ac3d79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c6e00c48ab34d75bf69a57126ac3d79" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44603 } }
I20260812 01:05:54.981956 17727 leader_election.cc:302] T 00000000000000000000000000000000 P 4c6e00c48ab34d75bf69a57126ac3d79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c6e00c48ab34d75bf69a57126ac3d79; no voters:
I20260812 01:05:54.982538 17727 leader_election.cc:288] T 00000000000000000000000000000000 P 4c6e00c48ab34d75bf69a57126ac3d79 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:05:54.982640 17733 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4c6e00c48ab34d75bf69a57126ac3d79 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:05:54.983304 17733 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4c6e00c48ab34d75bf69a57126ac3d79 [term 1 LEADER]: Becoming Leader. State: Replica: 4c6e00c48ab34d75bf69a57126ac3d79, State: Running, Role: LEADER
I20260812 01:05:54.983846 17733 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c6e00c48ab34d75bf69a57126ac3d79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c6e00c48ab34d75bf69a57126ac3d79" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44603 } }
I20260812 01:05:54.984474 17727 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c6e00c48ab34d75bf69a57126ac3d79 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:05:54.986616 17735 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c6e00c48ab34d75bf69a57126ac3d79 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c6e00c48ab34d75bf69a57126ac3d79. Latest consensus state: current_term: 1 leader_uuid: "4c6e00c48ab34d75bf69a57126ac3d79" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c6e00c48ab34d75bf69a57126ac3d79" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44603 } } }
I20260812 01:05:54.986986 17735 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c6e00c48ab34d75bf69a57126ac3d79 [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:54.987454 17734 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c6e00c48ab34d75bf69a57126ac3d79 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4c6e00c48ab34d75bf69a57126ac3d79" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c6e00c48ab34d75bf69a57126ac3d79" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44603 } } }
I20260812 01:05:54.987707 17734 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c6e00c48ab34d75bf69a57126ac3d79 [sys.catalog]: This master's current role is: LEADER
I20260812 01:05:54.990022 17744 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:05:54.995003 17744 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:05:55.004827 17744 catalog_manager.cc:1347] Generated new cluster ID: dc6dd58a18f44140af29e16aa5e17b9f
I20260812 01:05:55.004944 17744 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:05:55.023332 17744 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:05:55.024528 17744 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:05:55.032822 17744 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4c6e00c48ab34d75bf69a57126ac3d79: Generated new TSK 0
I20260812 01:05:55.033638 17744 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.4.201.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.201.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.201.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.65.keytab.
Entry for principal oryx/127.4.201.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.65.keytab.
I20260812 01:05:55.100952 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:0
--local_ip_for_outbound_sockets=127.4.201.65
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:44603
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.65.keytab
--principal=oryx/127.4.201.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:36243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:55.437095 17767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:55.437404 17767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:55.437511 17767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:55.444505 17767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:55.444602 17767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:55.444689 17767 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 01:05:55.444767 17767 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:05:55.453979 17767 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:36243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.65.keytab
--principal=oryx/127.4.201.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.201.126:44603
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:55.455138 17767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:55.456537 17767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:55.468989 17776 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:55.469061 17779 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:55.469038 17777 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:55.469866 17767 server_base.cc:1034] running on GCE node
I20260812 01:05:55.470498 17767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:55.471370 17767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:55.472584 17767 hybrid_clock.cc:648] HybridClock initialized: now 1786496755472515 us; error 44 us; skew 500 ppm
I20260812 01:05:55.472864 17767 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:55 dist-test-slave-bndk krb5kdc[17561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496755, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:55.475854 17767 init.cc:377] Logged in from keytab as oryx/127.4.201.65@KRBTEST.COM (short username oryx)
I20260812 01:05:55.477280 17767 webserver.cc:460] Webserver started at http://127.4.201.65:44253/ using document root <none> and password file <none>
I20260812 01:05:55.478003 17767 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:55.478118 17767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:55.478410 17767 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:55.481202 17767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-0/data/instance:
uuid: "9955e74d851642efba7f624884009661"
format_stamp: "Formatted at 2026-08-12 01:05:55 on dist-test-slave-bndk"
server_key: "d93060821cf4996a384acdd76bf68578"
server_key_iv: "5578af602d955084a5b6c48feca025d7"
server_key_version: "encryptionkey@0"
I20260812 01:05:55.482003 17767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance:
uuid: "9955e74d851642efba7f624884009661"
format_stamp: "Formatted at 2026-08-12 01:05:55 on dist-test-slave-bndk"
server_key: "d93060821cf4996a384acdd76bf68578"
server_key_iv: "5578af602d955084a5b6c48feca025d7"
server_key_version: "encryptionkey@0"
I20260812 01:05:55.486986 17767 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 01:05:55.490403 17793 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:55.491744 17767 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 01:05:55.491890 17767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "9955e74d851642efba7f624884009661"
format_stamp: "Formatted at 2026-08-12 01:05:55 on dist-test-slave-bndk"
server_key: "d93060821cf4996a384acdd76bf68578"
server_key_iv: "5578af602d955084a5b6c48feca025d7"
server_key_version: "encryptionkey@0"
I20260812 01:05:55.492079 17767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:55.505720 17767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:55.509609 17767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:55.509882 17767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:55.512785 17767 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:55.512871 17767 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:55.513011 17767 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:55.513069 17767 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 01:05:55 dist-test-slave-bndk krb5kdc[17561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496755, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM
I20260812 01:05:55.537823 17810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:55.513398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:39063 (local address 127.4.201.126:44603)
0812 01:05:55.521540 (+ 8142us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:55.521545 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:55.521562 (+ 17us) server_negotiation.cc:407] Connection header received
0812 01:05:55.521618 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:55.521622 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:55.521683 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:55.521787 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:55.523503 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:55.524291 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:55.526215 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:55.526736 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:55.526871 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:55.531495 (+ 4624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:55.531500 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:55.531504 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:55.531542 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:55.534861 (+ 3319us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:55.535549 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:55.535555 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:55.535559 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:55.535684 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:55.536110 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:55.536115 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:55.536119 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:55.536392 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:55.536530 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:55.537251 (+ 721us) server_negotiation.cc:299] Negotiation successful
0812 01:05:55.537472 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8027,"thread_start_us":7927,"threads_started":1}
I20260812 01:05:55.538800 17811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:55.514037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:44603 (local address 127.4.201.65:39063)
0812 01:05:55.514887 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:55.514944 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:55.516798 (+ 1854us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:55.522054 (+ 5256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:55.522062 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:55.522572 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:55.523307 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:55.523332 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:55.524455 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:55.524460 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:55.526071 (+ 1611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:55.526088 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:55.527006 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:55.527014 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:55.527308 (+ 294us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:55.528090 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:55.528120 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:55.531256 (+ 3136us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:55.534988 (+ 3732us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:55.534998 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:55.535014 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:55.535418 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:55.535789 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:55.535795 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:55.535799 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:55.535992 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:55.536537 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:55.536545 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:55.536868 (+ 323us) client_negotiation.cc:769] Sending connection context
0812 01:05:55.537098 (+ 230us) client_negotiation.cc:240] Negotiation successful
0812 01:05:55.537667 (+ 569us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":375,"threads_started":1}
I20260812 01:05:55.565454 17810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:55.552098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:44949 (local address 127.4.201.126:44603)
0812 01:05:55.552248 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:55.552252 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:55.552857 (+ 605us) server_negotiation.cc:407] Connection header received
0812 01:05:55.553026 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:55.553030 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:55.553091 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:55.553172 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:55.554104 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:55.554790 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:55.556655 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:55.557285 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:55.557424 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:55.559637 (+ 2213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:55.559645 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:55.559650 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:55.559694 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:55.562758 (+ 3064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:55.563561 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:55.563567 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:55.563570 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:55.563703 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:55.564051 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:55.564056 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:55.564060 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:55.564331 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:55.564473 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:55.564872 (+ 399us) server_negotiation.cc:299] Negotiation successful
0812 01:05:55.565081 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 01:05:55.565553 17942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:55.552194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:44603 (local address 127.4.201.65:44949)
0812 01:05:55.552758 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:55.552774 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:55.552898 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:55.553240 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:55.553245 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:55.553682 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:55.553964 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:55.553973 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:55.554964 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:55.554970 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:55.556490 (+ 1520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:55.556508 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:55.557458 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:55.557464 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:55.557599 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:55.558290 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:55.558314 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:55.559415 (+ 1101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:55.562870 (+ 3455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:55.562876 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:55.562880 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:55.563443 (+ 563us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:55.563808 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:55.563814 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:55.563818 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:55.563942 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:55.564449 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:55.564454 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:55.564633 (+ 179us) client_negotiation.cc:769] Sending connection context
0812 01:05:55.564753 (+ 120us) client_negotiation.cc:240] Negotiation successful
0812 01:05:55.565081 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":308,"threads_started":1}
I20260812 01:05:55.571666 17767 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:42805
I20260812 01:05:55.571688 18003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:42805 every 8 connection(s)
I20260812 01:05:55.572858 17767 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:05:55.574661 18004 heartbeater.cc:347] Connected to a master server at 127.4.201.126:44603
I20260812 01:05:55.574857 18004 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:55.575423 18004 heartbeater.cc:511] Master 127.4.201.126:44603 requested a full tablet report, sending...
I20260812 01:05:55.577267 17650 ts_manager.cc:194] Registered new tserver with Master: 9955e74d851642efba7f624884009661 (127.4.201.65:42805)
I20260812 01:05:55.578667 17650 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.201.65@KRBTEST.COM'} at 127.4.201.65:39063
I20260812 01:05:55.580531 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 17767
I20260812 01:05:55.580704 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance
I20260812 01:05:55.581360 4901 external_mini_cluster.cc:1428] Setting key f31a4aa836deb3401260e7fd41dcaf52
WARNING: no policy specified for oryx/127.4.201.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.201.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.201.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.66.keytab.
Entry for principal oryx/127.4.201.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.66.keytab.
I20260812 01:05:55.630580 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:0
--local_ip_for_outbound_sockets=127.4.201.66
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:44603
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.66.keytab
--principal=oryx/127.4.201.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:36243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:55.959949 18008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:55.960235 18008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:55.960471 18008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:55.967489 18008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:55.967599 18008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:55.967736 18008 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 01:05:55.967849 18008 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:05:55.977155 18008 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:36243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.66.keytab
--principal=oryx/127.4.201.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.201.126:44603
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:55.978444 18008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:55.979724 18008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:55.992585 18015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:55.992508 18018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:55.992547 18016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:55.993423 18008 server_base.cc:1034] running on GCE node
I20260812 01:05:55.994022 18008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:55.994884 18008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:55.996120 18008 hybrid_clock.cc:648] HybridClock initialized: now 1786496755996030 us; error 61 us; skew 500 ppm
I20260812 01:05:55.996425 18008 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:55 dist-test-slave-bndk krb5kdc[17561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496755, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:55.999584 18008 init.cc:377] Logged in from keytab as oryx/127.4.201.66@KRBTEST.COM (short username oryx)
I20260812 01:05:56.000996 18008 webserver.cc:460] Webserver started at http://127.4.201.66:37413/ using document root <none> and password file <none>
I20260812 01:05:56.001708 18008 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:56.001811 18008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:56.002138 18008 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:56.005004 18008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-1/data/instance:
uuid: "e3073f1fde454c0d83c50929aa72a0d4"
format_stamp: "Formatted at 2026-08-12 01:05:56 on dist-test-slave-bndk"
server_key: "835a7c6823ea389b0402240b53040ee9"
server_key_iv: "28d2638a935babecf3a17d72b6215873"
server_key_version: "encryptionkey@0"
I20260812 01:05:56.005822 18008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance:
uuid: "e3073f1fde454c0d83c50929aa72a0d4"
format_stamp: "Formatted at 2026-08-12 01:05:56 on dist-test-slave-bndk"
server_key: "835a7c6823ea389b0402240b53040ee9"
server_key_iv: "28d2638a935babecf3a17d72b6215873"
server_key_version: "encryptionkey@0"
I20260812 01:05:56.010823 18008 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 01:05:56.014158 18028 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:56.015391 18008 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 01:05:56.015544 18008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "e3073f1fde454c0d83c50929aa72a0d4"
format_stamp: "Formatted at 2026-08-12 01:05:56 on dist-test-slave-bndk"
server_key: "835a7c6823ea389b0402240b53040ee9"
server_key_iv: "28d2638a935babecf3a17d72b6215873"
server_key_version: "encryptionkey@0"
I20260812 01:05:56.015749 18008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:56.031008 18008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:56.034653 18008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:56.034904 18008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:56.037578 18008 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:56.037686 18008 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:56.037843 18008 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:56.037921 18008 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 01:05:56 dist-test-slave-bndk krb5kdc[17561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496755, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM
I20260812 01:05:56.059670 17810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:56.037921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:49845 (local address 127.4.201.126:44603)
0812 01:05:56.038083 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:56.038088 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:56.039595 (+ 1507us) server_negotiation.cc:407] Connection header received
0812 01:05:56.041902 (+ 2307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:56.041910 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:56.042008 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:56.042087 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:56.044474 (+ 2387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:56.045659 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:56.047814 (+ 2155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:56.048438 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:56.048571 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:56.053085 (+ 4514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:56.053092 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:56.053097 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:56.053141 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:56.056312 (+ 3171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:56.057163 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:56.057169 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:56.057173 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:56.057360 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:56.057927 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:56.057933 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:56.057936 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:56.058263 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:56.058406 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:56.059115 (+ 709us) server_negotiation.cc:299] Negotiation successful
0812 01:05:56.059333 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 01:05:56.060683 18042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:56.038617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:44603 (local address 127.4.201.66:49845)
0812 01:05:56.039393 (+ 776us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:56.039429 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:56.041584 (+ 2155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:56.042623 (+ 1039us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:56.042636 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:56.043403 (+ 767us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:56.044204 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:56.044239 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:56.045842 (+ 1603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:56.045851 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:56.047667 (+ 1816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:56.047680 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:56.048728 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:56.048738 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:56.049018 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:56.049711 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:56.049742 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:56.052852 (+ 3110us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:56.056443 (+ 3591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:56.056452 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:56.056469 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:56.057057 (+ 588us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:56.057490 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:56.057496 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:56.057499 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:56.057792 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:56.058417 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:56.058429 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:56.058758 (+ 329us) client_negotiation.cc:769] Sending connection context
0812 01:05:56.059004 (+ 246us) client_negotiation.cc:240] Negotiation successful
0812 01:05:56.059508 (+ 504us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":340,"threads_started":1}
I20260812 01:05:56.079819 18141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:56.066412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:44603 (local address 127.4.201.66:49847)
0812 01:05:56.067044 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:56.067066 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:56.067211 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:56.067509 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:56.067515 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:56.068098 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:56.068489 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:56.068502 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:56.069543 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:56.069547 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:56.070897 (+ 1350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:56.070911 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:56.071647 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:56.071654 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:56.071806 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:56.072424 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:56.072473 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:56.073479 (+ 1006us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:56.077394 (+ 3915us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:56.077399 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:56.077403 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:56.077772 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:56.078155 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:56.078158 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:56.078160 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:56.078279 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:56.078920 (+ 641us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:56.078925 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:56.079128 (+ 203us) client_negotiation.cc:769] Sending connection context
0812 01:05:56.079279 (+ 151us) client_negotiation.cc:240] Negotiation successful
0812 01:05:56.079503 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":323,"threads_started":1}
I20260812 01:05:56.079977 17810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:56.066269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:49847 (local address 127.4.201.126:44603)
0812 01:05:56.066442 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:56.066447 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:56.067158 (+ 711us) server_negotiation.cc:407] Connection header received
0812 01:05:56.067324 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:56.067327 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:56.067397 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:56.067469 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:56.068635 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:56.069378 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:56.071040 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:56.071465 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:56.071579 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:56.073756 (+ 2177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:56.073763 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:56.073769 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:56.073811 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:56.077266 (+ 3455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:56.077874 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:56.077879 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:56.077883 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:56.078047 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:56.078365 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:56.078369 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:56.078373 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:56.078813 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:56.078966 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:56.079400 (+ 434us) server_negotiation.cc:299] Negotiation successful
0812 01:05:56.079635 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 01:05:56.090694 18008 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:38091
I20260812 01:05:56.090723 18229 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:38091 every 8 connection(s)
I20260812 01:05:56.091967 18008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:05:56.092461 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 18008
I20260812 01:05:56.092638 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance
I20260812 01:05:56.093207 4901 external_mini_cluster.cc:1428] Setting key a970564209c012b12e280e21792e24c3
I20260812 01:05:56.095000 18231 heartbeater.cc:347] Connected to a master server at 127.4.201.126:44603
I20260812 01:05:56.095225 18231 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:56.096096 18231 heartbeater.cc:511] Master 127.4.201.126:44603 requested a full tablet report, sending...
I20260812 01:05:56.097608 17648 ts_manager.cc:194] Registered new tserver with Master: e3073f1fde454c0d83c50929aa72a0d4 (127.4.201.66:38091)
I20260812 01:05:56.098424 17648 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.201.66@KRBTEST.COM'} at 127.4.201.66:49845
WARNING: no policy specified for oryx/127.4.201.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.201.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.201.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.67.keytab.
Entry for principal oryx/127.4.201.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.67.keytab.
I20260812 01:05:56.145615 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:0
--local_ip_for_outbound_sockets=127.4.201.67
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:44603
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.67.keytab
--principal=oryx/127.4.201.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:36243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:05:56.472919 18237 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:05:56.473193 18237 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:05:56.473367 18237 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:05:56.480257 18237 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:05:56.480369 18237 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:05:56.480490 18237 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 01:05:56.480602 18237 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:05:56.493860 18237 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:36243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.67.keytab
--principal=oryx/127.4.201.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.201.126:44603
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:05:56.495538 18237 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:05:56.497311 18237 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:05:56.511974 18247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:56.512395 18249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:05:56.512009 18246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:05:56.513201 18237 server_base.cc:1034] running on GCE node
I20260812 01:05:56.513957 18237 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:05:56.515084 18237 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:05:56.516350 18237 hybrid_clock.cc:648] HybridClock initialized: now 1786496756516266 us; error 36 us; skew 500 ppm
I20260812 01:05:56.516695 18237 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:05:56 dist-test-slave-bndk krb5kdc[17561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496756, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:05:56.520517 18237 init.cc:377] Logged in from keytab as oryx/127.4.201.67@KRBTEST.COM (short username oryx)
I20260812 01:05:56.521910 18237 webserver.cc:460] Webserver started at http://127.4.201.67:36137/ using document root <none> and password file <none>
I20260812 01:05:56.522568 18237 fs_manager.cc:359] Metadata directory not provided
I20260812 01:05:56.522663 18237 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:05:56.522965 18237 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:05:56.525857 18237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-2/data/instance:
uuid: "2269ff65530b4f2abcb88d00827ae903"
format_stamp: "Formatted at 2026-08-12 01:05:56 on dist-test-slave-bndk"
server_key: "b00b2ab461b0e58bbd921e2326ec301c"
server_key_iv: "5cd56cb2b8420d2bb3ca3a8f3f6ea594"
server_key_version: "encryptionkey@0"
I20260812 01:05:56.526613 18237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance:
uuid: "2269ff65530b4f2abcb88d00827ae903"
format_stamp: "Formatted at 2026-08-12 01:05:56 on dist-test-slave-bndk"
server_key: "b00b2ab461b0e58bbd921e2326ec301c"
server_key_iv: "5cd56cb2b8420d2bb3ca3a8f3f6ea594"
server_key_version: "encryptionkey@0"
I20260812 01:05:56.531400 18237 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 01:05:56.534618 18261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:56.535887 18237 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 01:05:56.536051 18237 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "2269ff65530b4f2abcb88d00827ae903"
format_stamp: "Formatted at 2026-08-12 01:05:56 on dist-test-slave-bndk"
server_key: "b00b2ab461b0e58bbd921e2326ec301c"
server_key_iv: "5cd56cb2b8420d2bb3ca3a8f3f6ea594"
server_key_version: "encryptionkey@0"
I20260812 01:05:56.536257 18237 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:05:56.557400 18237 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:05:56.560943 18237 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:05:56.561180 18237 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:05:56.563700 18237 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:05:56.563805 18237 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:05:56.563952 18237 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:05:56.564023 18237 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 01:05:56 dist-test-slave-bndk krb5kdc[17561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496756, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM
I20260812 01:05:56.581139 18004 heartbeater.cc:503] Master 127.4.201.126:44603 was elected leader, sending a full tablet report...
I20260812 01:05:56.587698 17810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:56.564554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:55041 (local address 127.4.201.126:44603)
0812 01:05:56.564788 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:56.564793 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:56.566144 (+ 1351us) server_negotiation.cc:407] Connection header received
0812 01:05:56.568127 (+ 1983us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:56.568134 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:56.568230 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:56.568344 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:56.570712 (+ 2368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:56.571783 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:56.574521 (+ 2738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:56.575183 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:56.575317 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:56.580264 (+ 4947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:56.580272 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:56.580279 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:56.580325 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:56.583881 (+ 3556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:56.584781 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:56.584786 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:56.584791 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:56.584965 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:56.585477 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:56.585492 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:56.585496 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:56.585859 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:56.586010 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:56.587041 (+ 1031us) server_negotiation.cc:299] Negotiation successful
0812 01:05:56.587304 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260812 01:05:56.588486 18277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:56.565093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:44603 (local address 127.4.201.67:55041)
0812 01:05:56.565967 (+ 874us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:56.566024 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:56.567836 (+ 1812us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:56.568636 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:56.568648 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:56.569539 (+ 891us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:56.570491 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:56.570525 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:56.572018 (+ 1493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:56.572024 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:56.574348 (+ 2324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:56.574367 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:56.575638 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:56.575646 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:56.575964 (+ 318us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:56.576762 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:56.576802 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:56.579975 (+ 3173us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:56.584017 (+ 4042us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:56.584024 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:56.584058 (+ 34us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:56.584674 (+ 616us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:56.585081 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:56.585084 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:56.585087 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:56.585331 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:56.586078 (+ 747us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:56.586084 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:56.586572 (+ 488us) client_negotiation.cc:769] Sending connection context
0812 01:05:56.586865 (+ 293us) client_negotiation.cc:240] Negotiation successful
0812 01:05:56.587299 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":633,"thread_start_us":384,"threads_started":1}
I20260812 01:05:56.607867 17810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:56.594388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:52969 (local address 127.4.201.126:44603)
0812 01:05:56.594545 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:56.594549 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:56.595227 (+ 678us) server_negotiation.cc:407] Connection header received
0812 01:05:56.595351 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:56.595356 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:56.595448 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:56.595553 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:56.596470 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:56.597655 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:56.598864 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:56.599546 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:56.599672 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:56.601656 (+ 1984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:56.601661 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:56.601664 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:56.601692 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:56.604783 (+ 3091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:56.605737 (+ 954us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:56.605743 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:56.605747 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:56.605899 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:56.606326 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:56.606332 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:56.606335 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:56.606703 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:56.606865 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:56.607303 (+ 438us) server_negotiation.cc:299] Negotiation successful
0812 01:05:56.607515 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 01:05:56.607973 18389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:56.594490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:44603 (local address 127.4.201.67:52969)
0812 01:05:56.595139 (+ 649us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:56.595157 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:56.595261 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:56.595589 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:56.595593 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:56.596063 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:56.596348 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:56.596357 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:56.597779 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:56.597783 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:56.598746 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:56.598757 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:56.599709 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:56.599713 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:56.599841 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:56.600373 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:56.600389 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:56.601439 (+ 1050us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:56.604917 (+ 3478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:56.604925 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:56.604929 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:56.605602 (+ 673us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:56.606022 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:56.606030 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:56.606034 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:56.606196 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:56.606825 (+ 629us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:56.606834 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:56.607041 (+ 207us) client_negotiation.cc:769] Sending connection context
0812 01:05:56.607196 (+ 155us) client_negotiation.cc:240] Negotiation successful
0812 01:05:56.607515 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":327,"threads_started":1}
I20260812 01:05:56.617549 18237 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:38813
I20260812 01:05:56.617590 18486 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:38813 every 8 connection(s)
I20260812 01:05:56.618738 18237 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:05:56.620864 18491 heartbeater.cc:347] Connected to a master server at 127.4.201.126:44603
I20260812 01:05:56.621073 18491 heartbeater.cc:464] Registering TS with master...
I20260812 01:05:56.621716 18491 heartbeater.cc:511] Master 127.4.201.126:44603 requested a full tablet report, sending...
I20260812 01:05:56.622969 17648 ts_manager.cc:194] Registered new tserver with Master: 2269ff65530b4f2abcb88d00827ae903 (127.4.201.67:38813)
I20260812 01:05:56.623754 17648 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.201.67@KRBTEST.COM'} at 127.4.201.67:55041
I20260812 01:05:56.625756 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 18237
I20260812 01:05:56.625903 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance
I20260812 01:05:56.626299 4901 external_mini_cluster.cc:1428] Setting key 9a21009e4b9acfa197b834090cc61a36
I20260812 01:05:56.628904 4901 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 01:05:56 dist-test-slave-bndk krb5kdc[17561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496756, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 01:05:56 dist-test-slave-bndk krb5kdc[17561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:05:56 dist-test-slave-bndk krb5kdc[17561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:05:57.101022 18231 heartbeater.cc:503] Master 127.4.201.126:44603 was elected leader, sending a full tablet report...
I20260812 01:05:57.625960 18491 heartbeater.cc:503] Master 127.4.201.126:44603 was elected leader, sending a full tablet report...
W20260812 01:05:57.710716 18500 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.030s user 0.000s sys 0.017s
W20260812 01:05:57.711969 17810 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:05:56.674957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46286 (local address 127.4.201.126:44603)
0812 01:05:56.675188 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:56.675195 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:56.675320 (+ 125us) server_negotiation.cc:407] Connection header received
0812 01:05:56.675511 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:56.675515 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:56.675581 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:56.675670 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:56.677046 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:56.677830 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:56.679071 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:56.679481 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:56.679595 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:57.711648 (+1032053us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46286: BlockingRecv error: recv got EOF from 127.0.0.1:46286 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 12 01:05:57 dist-test-slave-bndk krb5kdc[17561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496756, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM
I20260812 01:05:57.732671 17810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:57.715442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46292 (local address 127.4.201.126:44603)
0812 01:05:57.715642 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:57.715649 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:57.715899 (+ 250us) server_negotiation.cc:407] Connection header received
0812 01:05:57.716086 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:57.716090 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:57.716179 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:57.716269 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:57.717479 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:57.718216 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:57.719434 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:57.719867 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:57.719977 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:57.727994 (+ 8017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:57.728000 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:57.728004 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:57.728042 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:57.730448 (+ 2406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:57.731087 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:57.731092 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:57.731094 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:57.731220 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:57.731516 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:57.731519 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:57.731521 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:57.731777 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:57.731986 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:57.732186 (+ 200us) server_negotiation.cc:299] Negotiation successful
0812 01:05:57.732350 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 01:05:57.736732 17648 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46292:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:05:57.743799 17648 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:05:57.779722 18526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:57.756711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59274 (local address 127.4.201.66:38091)
0812 01:05:57.769883 (+ 13172us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:57.769891 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:57.770776 (+ 885us) server_negotiation.cc:407] Connection header received
0812 01:05:57.771095 (+ 319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:57.771104 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:57.771710 (+ 606us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:57.771895 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:57.773117 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:57.774771 (+ 1654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:57.777258 (+ 2487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:57.778588 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:57.778727 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:57.778943 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:57.779234 (+ 291us) server_negotiation.cc:299] Negotiation successful
0812 01:05:57.779406 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13012,"thread_start_us":13167,"threads_started":1}
I20260812 01:05:57.779834 18522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:57.756282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:38091 (local address 127.0.0.1:59274)
0812 01:05:57.770646 (+ 14364us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:57.770665 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:57.770889 (+ 224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:57.772204 (+ 1315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:57.772212 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:57.772257 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:57.772851 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:57.772871 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:57.774897 (+ 2026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:57.774902 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:57.777034 (+ 2132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:57.777048 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:57.778791 (+ 1743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:57.778798 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:57.778984 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:57.779041 (+ 57us) client_negotiation.cc:769] Sending connection context
0812 01:05:57.779180 (+ 139us) client_negotiation.cc:240] Negotiation successful
0812 01:05:57.779366 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14229,"mutex_wait_us":143,"spinlock_wait_cycles":8576,"thread_start_us":13941,"threads_started":1}
I20260812 01:05:57.780464 18527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:57.770235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:42805 (local address 127.0.0.1:54626)
0812 01:05:57.771592 (+ 1357us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:57.771610 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:57.771718 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:57.772701 (+ 983us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:57.772706 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:57.772733 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:57.773199 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:57.773238 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:57.775126 (+ 1888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:57.775131 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:57.777422 (+ 2291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:57.777438 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:57.779675 (+ 2237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:57.779681 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:57.779851 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:57.779883 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 01:05:57.779981 (+ 98us) client_negotiation.cc:240] Negotiation successful
0812 01:05:57.780108 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1253,"mutex_wait_us":22,"thread_start_us":1125,"threads_started":1}
I20260812 01:05:57.780646 18528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:57.770305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54626 (local address 127.4.201.65:42805)
0812 01:05:57.772262 (+ 1957us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:57.772269 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:57.772294 (+ 25us) server_negotiation.cc:407] Connection header received
0812 01:05:57.772376 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:57.772381 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:57.772518 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:57.772683 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:57.773440 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:57.774979 (+ 1539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:57.777967 (+ 2988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:57.779211 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:57.779334 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:57.779524 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:57.780172 (+ 648us) server_negotiation.cc:299] Negotiation successful
0812 01:05:57.780336 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1814,"thread_start_us":1660,"threads_started":1}
I20260812 01:05:57.781147 18520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:57.756048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:38813 (local address 127.0.0.1:38630)
0812 01:05:57.769472 (+ 13424us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:57.769556 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:57.769868 (+ 312us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:57.772223 (+ 2355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:57.772227 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:57.772260 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:57.773031 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:57.773044 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:57.776066 (+ 3022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:57.776072 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:57.778183 (+ 2111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:57.778197 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:57.780374 (+ 2177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:57.780381 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:57.780562 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:57.780593 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 01:05:57.780680 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 01:05:57.780799 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13083,"mutex_wait_us":57,"spinlock_wait_cycles":6784,"thread_start_us":12944,"threads_started":1}
I20260812 01:05:57.782385 18525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:57.756277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38630 (local address 127.4.201.67:38813)
0812 01:05:57.768619 (+ 12342us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:57.768631 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:57.769683 (+ 1052us) server_negotiation.cc:407] Connection header received
0812 01:05:57.771656 (+ 1973us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:57.771664 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:57.771902 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:57.772106 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:57.773175 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:57.774987 (+ 1812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:57.778335 (+ 3348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:57.779646 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:57.779781 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:57.779975 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:57.781926 (+ 1951us) server_negotiation.cc:299] Negotiation successful
0812 01:05:57.782096 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12115,"thread_start_us":12345,"threads_started":1}
I20260812 01:05:57.784116 18119 tablet_service.cc:1467] Processing CreateTablet for tablet 429afb2b821647a2b42e52978487ad7f (DEFAULT_TABLE table=test-table [id=39bbb9702b634029b831d53dd5be5a92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:57.784202 17880 tablet_service.cc:1467] Processing CreateTablet for tablet 429afb2b821647a2b42e52978487ad7f (DEFAULT_TABLE table=test-table [id=39bbb9702b634029b831d53dd5be5a92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:57.785476 18119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 429afb2b821647a2b42e52978487ad7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:57.785647 17880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 429afb2b821647a2b42e52978487ad7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:57.785796 18357 tablet_service.cc:1467] Processing CreateTablet for tablet 429afb2b821647a2b42e52978487ad7f (DEFAULT_TABLE table=test-table [id=39bbb9702b634029b831d53dd5be5a92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:57.787117 18357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 429afb2b821647a2b42e52978487ad7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:57.797433 18530 tablet_bootstrap.cc:492] T 429afb2b821647a2b42e52978487ad7f P e3073f1fde454c0d83c50929aa72a0d4: Bootstrap starting.
I20260812 01:05:57.800607 18530 tablet_bootstrap.cc:654] T 429afb2b821647a2b42e52978487ad7f P e3073f1fde454c0d83c50929aa72a0d4: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:57.801856 18530 log.cc:824] T 429afb2b821647a2b42e52978487ad7f P e3073f1fde454c0d83c50929aa72a0d4: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:57.803695 18531 tablet_bootstrap.cc:492] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661: Bootstrap starting.
I20260812 01:05:57.805876 18534 tablet_bootstrap.cc:492] T 429afb2b821647a2b42e52978487ad7f P 2269ff65530b4f2abcb88d00827ae903: Bootstrap starting.
I20260812 01:05:57.807502 18531 tablet_bootstrap.cc:654] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:57.808614 18531 log.cc:824] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:57.808943 18534 tablet_bootstrap.cc:654] T 429afb2b821647a2b42e52978487ad7f P 2269ff65530b4f2abcb88d00827ae903: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:57.810245 18534 log.cc:824] T 429afb2b821647a2b42e52978487ad7f P 2269ff65530b4f2abcb88d00827ae903: Log is configured to *not* fsync() on all Append() calls
I20260812 01:05:57.810626 18530 tablet_bootstrap.cc:492] T 429afb2b821647a2b42e52978487ad7f P e3073f1fde454c0d83c50929aa72a0d4: No bootstrap required, opened a new log
I20260812 01:05:57.811048 18530 ts_tablet_manager.cc:1397] T 429afb2b821647a2b42e52978487ad7f P e3073f1fde454c0d83c50929aa72a0d4: Time spent bootstrapping tablet: real 0.014s user 0.009s sys 0.004s
I20260812 01:05:57.813117 18531 tablet_bootstrap.cc:492] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661: No bootstrap required, opened a new log
I20260812 01:05:57.813308 18534 tablet_bootstrap.cc:492] T 429afb2b821647a2b42e52978487ad7f P 2269ff65530b4f2abcb88d00827ae903: No bootstrap required, opened a new log
I20260812 01:05:57.813396 18531 ts_tablet_manager.cc:1397] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20260812 01:05:57.813570 18534 ts_tablet_manager.cc:1397] T 429afb2b821647a2b42e52978487ad7f P 2269ff65530b4f2abcb88d00827ae903: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.004s
I20260812 01:05:57.820676 18531 raft_consensus.cc:348] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } } peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } }
I20260812 01:05:57.821089 18531 raft_consensus.cc:374] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:57.821195 18531 raft_consensus.cc:729] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9955e74d851642efba7f624884009661, State: Initialized, Role: FOLLOWER
I20260812 01:05:57.821295 18530 raft_consensus.cc:348] T 429afb2b821647a2b42e52978487ad7f P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } } peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } }
I20260812 01:05:57.821704 18530 raft_consensus.cc:374] T 429afb2b821647a2b42e52978487ad7f P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:57.821803 18530 raft_consensus.cc:729] T 429afb2b821647a2b42e52978487ad7f P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3073f1fde454c0d83c50929aa72a0d4, State: Initialized, Role: FOLLOWER
I20260812 01:05:57.821826 18531 consensus_queue.cc:260] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } } peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } }
I20260812 01:05:57.822364 18530 consensus_queue.cc:260] T 429afb2b821647a2b42e52978487ad7f P e3073f1fde454c0d83c50929aa72a0d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } } peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } }
I20260812 01:05:57.823638 18531 ts_tablet_manager.cc:1428] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661: Time spent starting tablet: real 0.010s user 0.009s sys 0.000s
I20260812 01:05:57.823525 18534 raft_consensus.cc:348] T 429afb2b821647a2b42e52978487ad7f P 2269ff65530b4f2abcb88d00827ae903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } } peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } }
I20260812 01:05:57.823987 18534 raft_consensus.cc:374] T 429afb2b821647a2b42e52978487ad7f P 2269ff65530b4f2abcb88d00827ae903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:57.824098 18534 raft_consensus.cc:729] T 429afb2b821647a2b42e52978487ad7f P 2269ff65530b4f2abcb88d00827ae903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2269ff65530b4f2abcb88d00827ae903, State: Initialized, Role: FOLLOWER
I20260812 01:05:57.824694 18534 consensus_queue.cc:260] T 429afb2b821647a2b42e52978487ad7f P 2269ff65530b4f2abcb88d00827ae903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } } peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } }
W20260812 01:05:57.825712 18005 tablet.cc:2369] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:05:57.827386 18534 ts_tablet_manager.cc:1428] T 429afb2b821647a2b42e52978487ad7f P 2269ff65530b4f2abcb88d00827ae903: Time spent starting tablet: real 0.014s user 0.005s sys 0.007s
I20260812 01:05:57.829530 18530 ts_tablet_manager.cc:1428] T 429afb2b821647a2b42e52978487ad7f P e3073f1fde454c0d83c50929aa72a0d4: Time spent starting tablet: real 0.018s user 0.012s sys 0.004s
W20260812 01:05:57.845830 18232 tablet.cc:2369] T 429afb2b821647a2b42e52978487ad7f P e3073f1fde454c0d83c50929aa72a0d4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:05:57.871032 18492 tablet.cc:2369] T 429afb2b821647a2b42e52978487ad7f P 2269ff65530b4f2abcb88d00827ae903: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:05:58.142710 18541 raft_consensus.cc:482] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:05:58.143029 18541 raft_consensus.cc:504] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } } peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } }
I20260812 01:05:58.144812 18541 leader_election.cc:288] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3073f1fde454c0d83c50929aa72a0d4 (127.4.201.66:38091), 2269ff65530b4f2abcb88d00827ae903 (127.4.201.67:38813)
I20260812 01:05:58.151629 18525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:58.145481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:39229 (local address 127.4.201.67:38813)
0812 01:05:58.145687 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:58.145694 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:58.146547 (+ 853us) server_negotiation.cc:407] Connection header received
0812 01:05:58.146710 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:58.146713 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:58.146783 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:58.146857 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:58.147517 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.148211 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.149999 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.150744 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.150890 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:58.150964 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:58.151257 (+ 293us) server_negotiation.cc:299] Negotiation successful
0812 01:05:58.151392 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 01:05:58.151630 18526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:58.145340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:53173 (local address 127.4.201.66:38091)
0812 01:05:58.145586 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:58.145592 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:58.146460 (+ 868us) server_negotiation.cc:407] Connection header received
0812 01:05:58.146663 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:58.146667 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:58.146739 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:58.146814 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:58.147415 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.148127 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.150013 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.150768 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.150911 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:58.150996 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:58.151271 (+ 275us) server_negotiation.cc:299] Negotiation successful
0812 01:05:58.151408 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 01:05:58.151777 18544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:58.145303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:38813 (local address 127.4.201.65:39229)
0812 01:05:58.146441 (+ 1138us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:58.146456 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:58.146583 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:58.146885 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:58.146889 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:58.146912 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:58.147352 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:58.147361 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.148349 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.148353 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:58.149847 (+ 1494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:58.149861 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.150958 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.150965 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:58.151098 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:58.151130 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 01:05:58.151214 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 01:05:58.151352 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1029,"mutex_wait_us":13,"thread_start_us":574,"threads_started":1}
I20260812 01:05:58.151835 18545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:58.145262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:38091 (local address 127.4.201.65:53173)
0812 01:05:58.146353 (+ 1091us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:58.146369 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:58.146526 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:58.146842 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:58.146846 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:58.146869 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:58.147262 (+ 393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:58.147272 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.148251 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.148256 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:58.149858 (+ 1602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:58.149872 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.150997 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.151003 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:58.151127 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:58.151149 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 01:05:58.151228 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 01:05:58.151363 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":942,"mutex_wait_us":41,"thread_start_us":842,"threads_started":1}
I20260812 01:05:58.153014 18155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "429afb2b821647a2b42e52978487ad7f" candidate_uuid: "9955e74d851642efba7f624884009661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3073f1fde454c0d83c50929aa72a0d4" is_pre_election: true
I20260812 01:05:58.153023 18398 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "429afb2b821647a2b42e52978487ad7f" candidate_uuid: "9955e74d851642efba7f624884009661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2269ff65530b4f2abcb88d00827ae903" is_pre_election: true
I20260812 01:05:58.153644 18398 raft_consensus.cc:2454] T 429afb2b821647a2b42e52978487ad7f P 2269ff65530b4f2abcb88d00827ae903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9955e74d851642efba7f624884009661 in term 0.
I20260812 01:05:58.153645 18155 raft_consensus.cc:2454] T 429afb2b821647a2b42e52978487ad7f P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9955e74d851642efba7f624884009661 in term 0.
I20260812 01:05:58.154304 17796 leader_election.cc:302] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2269ff65530b4f2abcb88d00827ae903, 9955e74d851642efba7f624884009661; no voters:
I20260812 01:05:58.154670 18541 raft_consensus.cc:2781] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:05:58.154824 18541 raft_consensus.cc:482] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:05:58.154932 18541 raft_consensus.cc:3037] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:58.157085 18541 raft_consensus.cc:504] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } } peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } }
I20260812 01:05:58.157714 18541 leader_election.cc:288] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661 [CANDIDATE]: Term 1 election: Requested vote from peers e3073f1fde454c0d83c50929aa72a0d4 (127.4.201.66:38091), 2269ff65530b4f2abcb88d00827ae903 (127.4.201.67:38813)
I20260812 01:05:58.158092 18155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "429afb2b821647a2b42e52978487ad7f" candidate_uuid: "9955e74d851642efba7f624884009661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3073f1fde454c0d83c50929aa72a0d4"
I20260812 01:05:58.158205 18398 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "429afb2b821647a2b42e52978487ad7f" candidate_uuid: "9955e74d851642efba7f624884009661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2269ff65530b4f2abcb88d00827ae903"
I20260812 01:05:58.158290 18155 raft_consensus.cc:3037] T 429afb2b821647a2b42e52978487ad7f P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:58.158403 18398 raft_consensus.cc:3037] T 429afb2b821647a2b42e52978487ad7f P 2269ff65530b4f2abcb88d00827ae903 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:58.160522 18155 raft_consensus.cc:2454] T 429afb2b821647a2b42e52978487ad7f P e3073f1fde454c0d83c50929aa72a0d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9955e74d851642efba7f624884009661 in term 1.
I20260812 01:05:58.160643 18398 raft_consensus.cc:2454] T 429afb2b821647a2b42e52978487ad7f P 2269ff65530b4f2abcb88d00827ae903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9955e74d851642efba7f624884009661 in term 1.
I20260812 01:05:58.160913 17799 leader_election.cc:302] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9955e74d851642efba7f624884009661, e3073f1fde454c0d83c50929aa72a0d4; no voters:
I20260812 01:05:58.161252 18541 raft_consensus.cc:2781] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:05:58.161646 18541 raft_consensus.cc:686] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661 [term 1 LEADER]: Becoming Leader. State: Replica: 9955e74d851642efba7f624884009661, State: Running, Role: LEADER
I20260812 01:05:58.162094 18541 consensus_queue.cc:237] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } } peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } }
I20260812 01:05:58.166712 17648 catalog_manager.cc:5495] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9955e74d851642efba7f624884009661 (127.4.201.65). New cstate: current_term: 1 leader_uuid: "9955e74d851642efba7f624884009661" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } health_report { overall_health: HEALTHY } } }
I20260812 01:05:58.233209 18528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:58.228453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54636 (local address 127.4.201.65:42805)
0812 01:05:58.228637 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:58.228641 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:58.228705 (+ 64us) server_negotiation.cc:407] Connection header received
0812 01:05:58.228904 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:58.228908 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:58.229018 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:58.229144 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:05:58.229463 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.230142 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.231379 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.231775 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.231862 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:58.232184 (+ 322us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:05:58.232694 (+ 510us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:05:58.232799 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:58.232857 (+ 58us) server_negotiation.cc:299] Negotiation successful
0812 01:05:58.232936 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 01:05:58.241080 18398 raft_consensus.cc:1261] T 429afb2b821647a2b42e52978487ad7f P 2269ff65530b4f2abcb88d00827ae903 [term 1 FOLLOWER]: Refusing update from remote peer 9955e74d851642efba7f624884009661: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:58.241108 18155 raft_consensus.cc:1261] T 429afb2b821647a2b42e52978487ad7f P e3073f1fde454c0d83c50929aa72a0d4 [term 1 FOLLOWER]: Refusing update from remote peer 9955e74d851642efba7f624884009661: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:58.242070 18549 consensus_queue.cc:1035] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:58.242471 18541 consensus_queue.cc:1035] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:58.251910 18554 mvcc.cc:205] Tried to move back new op lower bound from 7317490721746165760 to 7317490721435447296. Current Snapshot: MvccSnapshot[applied={T|T < 7317490721746165760}]
I20260812 01:05:58.252885 18558 mvcc.cc:205] Tried to move back new op lower bound from 7317490721746165760 to 7317490721435447296. Current Snapshot: MvccSnapshot[applied={T|T < 7317490721746165760}]
I20260812 01:05:58.266682 17650 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46292:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:05:58.266924 17650 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46292:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:05:58.270170 17650 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4c6e00c48ab34d75bf69a57126ac3d79: Sending DeleteTablet for 3 replicas of tablet 429afb2b821647a2b42e52978487ad7f
I20260812 01:05:58.271286 18119 tablet_service.cc:1514] Processing DeleteTablet for tablet 429afb2b821647a2b42e52978487ad7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:58 UTC) from {username='oryx', principal='oryx/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:59274
I20260812 01:05:58.271284 18357 tablet_service.cc:1514] Processing DeleteTablet for tablet 429afb2b821647a2b42e52978487ad7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:58 UTC) from {username='oryx', principal='oryx/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:38630
I20260812 01:05:58.271710 17880 tablet_service.cc:1514] Processing DeleteTablet for tablet 429afb2b821647a2b42e52978487ad7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:58 UTC) from {username='oryx', principal='oryx/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:54626
I20260812 01:05:58.275297 17650 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46292:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:05:58.275979 17650 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:05:58.284235 17876 tablet_service.cc:1467] Processing CreateTablet for tablet 8e38fa409051466cb39c74d8032486f1 (DEFAULT_TABLE table=test-table [id=8c9651b044994edf85431b821d9370ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:58.284884 17876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e38fa409051466cb39c74d8032486f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:58.284780 18356 tablet_service.cc:1467] Processing CreateTablet for tablet 8e38fa409051466cb39c74d8032486f1 (DEFAULT_TABLE table=test-table [id=8c9651b044994edf85431b821d9370ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:58.285439 18356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e38fa409051466cb39c74d8032486f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:58.290339 18117 tablet_service.cc:1467] Processing CreateTablet for tablet 8e38fa409051466cb39c74d8032486f1 (DEFAULT_TABLE table=test-table [id=8c9651b044994edf85431b821d9370ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:58.290881 18117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e38fa409051466cb39c74d8032486f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:58.292550 18531 tablet_bootstrap.cc:492] T 8e38fa409051466cb39c74d8032486f1 P 9955e74d851642efba7f624884009661: Bootstrap starting.
I20260812 01:05:58.292989 18534 tablet_bootstrap.cc:492] T 8e38fa409051466cb39c74d8032486f1 P 2269ff65530b4f2abcb88d00827ae903: Bootstrap starting.
I20260812 01:05:58.294531 18531 tablet_bootstrap.cc:654] T 8e38fa409051466cb39c74d8032486f1 P 9955e74d851642efba7f624884009661: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:58.294539 18534 tablet_bootstrap.cc:654] T 8e38fa409051466cb39c74d8032486f1 P 2269ff65530b4f2abcb88d00827ae903: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:58.298023 18530 tablet_bootstrap.cc:492] T 8e38fa409051466cb39c74d8032486f1 P e3073f1fde454c0d83c50929aa72a0d4: Bootstrap starting.
I20260812 01:05:58.299767 18530 tablet_bootstrap.cc:654] T 8e38fa409051466cb39c74d8032486f1 P e3073f1fde454c0d83c50929aa72a0d4: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:58.307404 18534 tablet_bootstrap.cc:492] T 8e38fa409051466cb39c74d8032486f1 P 2269ff65530b4f2abcb88d00827ae903: No bootstrap required, opened a new log
I20260812 01:05:58.307636 18534 ts_tablet_manager.cc:1397] T 8e38fa409051466cb39c74d8032486f1 P 2269ff65530b4f2abcb88d00827ae903: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.000s
I20260812 01:05:58.308725 18534 raft_consensus.cc:348] T 8e38fa409051466cb39c74d8032486f1 P 2269ff65530b4f2abcb88d00827ae903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:58.309034 18534 raft_consensus.cc:374] T 8e38fa409051466cb39c74d8032486f1 P 2269ff65530b4f2abcb88d00827ae903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:58.309186 18534 raft_consensus.cc:729] T 8e38fa409051466cb39c74d8032486f1 P 2269ff65530b4f2abcb88d00827ae903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2269ff65530b4f2abcb88d00827ae903, State: Initialized, Role: FOLLOWER
I20260812 01:05:58.309608 18534 consensus_queue.cc:260] T 8e38fa409051466cb39c74d8032486f1 P 2269ff65530b4f2abcb88d00827ae903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:58.311359 18534 ts_tablet_manager.cc:1428] T 8e38fa409051466cb39c74d8032486f1 P 2269ff65530b4f2abcb88d00827ae903: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260812 01:05:58.312533 18530 tablet_bootstrap.cc:492] T 8e38fa409051466cb39c74d8032486f1 P e3073f1fde454c0d83c50929aa72a0d4: No bootstrap required, opened a new log
I20260812 01:05:58.312772 18530 ts_tablet_manager.cc:1397] T 8e38fa409051466cb39c74d8032486f1 P e3073f1fde454c0d83c50929aa72a0d4: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.006s
I20260812 01:05:58.313630 18530 raft_consensus.cc:348] T 8e38fa409051466cb39c74d8032486f1 P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:58.313997 18530 raft_consensus.cc:374] T 8e38fa409051466cb39c74d8032486f1 P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:58.314150 18530 raft_consensus.cc:729] T 8e38fa409051466cb39c74d8032486f1 P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3073f1fde454c0d83c50929aa72a0d4, State: Initialized, Role: FOLLOWER
I20260812 01:05:58.314407 18531 tablet_bootstrap.cc:492] T 8e38fa409051466cb39c74d8032486f1 P 9955e74d851642efba7f624884009661: No bootstrap required, opened a new log
I20260812 01:05:58.314639 18531 ts_tablet_manager.cc:1397] T 8e38fa409051466cb39c74d8032486f1 P 9955e74d851642efba7f624884009661: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.006s
I20260812 01:05:58.314538 18530 consensus_queue.cc:260] T 8e38fa409051466cb39c74d8032486f1 P e3073f1fde454c0d83c50929aa72a0d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:58.315598 18531 raft_consensus.cc:348] T 8e38fa409051466cb39c74d8032486f1 P 9955e74d851642efba7f624884009661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:58.315904 18531 raft_consensus.cc:374] T 8e38fa409051466cb39c74d8032486f1 P 9955e74d851642efba7f624884009661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:58.316011 18530 ts_tablet_manager.cc:1428] T 8e38fa409051466cb39c74d8032486f1 P e3073f1fde454c0d83c50929aa72a0d4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260812 01:05:58.316056 18531 raft_consensus.cc:729] T 8e38fa409051466cb39c74d8032486f1 P 9955e74d851642efba7f624884009661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9955e74d851642efba7f624884009661, State: Initialized, Role: FOLLOWER
I20260812 01:05:58.316452 18531 consensus_queue.cc:260] T 8e38fa409051466cb39c74d8032486f1 P 9955e74d851642efba7f624884009661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:58.317468 18579 tablet_replica.cc:330] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661: stopping tablet replica
I20260812 01:05:58.317982 18579 raft_consensus.cc:2229] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661 [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:05:58.318709 18579 raft_consensus.cc:2258] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:58.319646 18576 tablet_replica.cc:330] T 429afb2b821647a2b42e52978487ad7f P 2269ff65530b4f2abcb88d00827ae903: stopping tablet replica
I20260812 01:05:58.319789 18531 ts_tablet_manager.cc:1428] T 8e38fa409051466cb39c74d8032486f1 P 9955e74d851642efba7f624884009661: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260812 01:05:58.320086 18576 raft_consensus.cc:2229] T 429afb2b821647a2b42e52978487ad7f P 2269ff65530b4f2abcb88d00827ae903 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:05:58.320574 18576 raft_consensus.cc:2258] T 429afb2b821647a2b42e52978487ad7f P 2269ff65530b4f2abcb88d00827ae903 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:58.321341 18575 tablet_replica.cc:330] T 429afb2b821647a2b42e52978487ad7f P e3073f1fde454c0d83c50929aa72a0d4: stopping tablet replica
I20260812 01:05:58.321684 18575 raft_consensus.cc:2229] T 429afb2b821647a2b42e52978487ad7f P e3073f1fde454c0d83c50929aa72a0d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:05:58.322046 18575 raft_consensus.cc:2258] T 429afb2b821647a2b42e52978487ad7f P e3073f1fde454c0d83c50929aa72a0d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:58.323617 18575 ts_tablet_manager.cc:1905] T 429afb2b821647a2b42e52978487ad7f P e3073f1fde454c0d83c50929aa72a0d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:58.323837 18576 ts_tablet_manager.cc:1905] T 429afb2b821647a2b42e52978487ad7f P 2269ff65530b4f2abcb88d00827ae903: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:58.326515 18579 ts_tablet_manager.cc:1905] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:58.329944 18575 ts_tablet_manager.cc:1918] T 429afb2b821647a2b42e52978487ad7f P e3073f1fde454c0d83c50929aa72a0d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:05:58.330168 18575 log.cc:1196] T 429afb2b821647a2b42e52978487ad7f P e3073f1fde454c0d83c50929aa72a0d4: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-1/wal/wals/429afb2b821647a2b42e52978487ad7f
I20260812 01:05:58.330758 18575 ts_tablet_manager.cc:1939] T 429afb2b821647a2b42e52978487ad7f P e3073f1fde454c0d83c50929aa72a0d4: Deleting consensus metadata
I20260812 01:05:58.330909 18576 ts_tablet_manager.cc:1918] T 429afb2b821647a2b42e52978487ad7f P 2269ff65530b4f2abcb88d00827ae903: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:05:58.331158 18576 log.cc:1196] T 429afb2b821647a2b42e52978487ad7f P 2269ff65530b4f2abcb88d00827ae903: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-2/wal/wals/429afb2b821647a2b42e52978487ad7f
I20260812 01:05:58.331750 18576 ts_tablet_manager.cc:1939] T 429afb2b821647a2b42e52978487ad7f P 2269ff65530b4f2abcb88d00827ae903: Deleting consensus metadata
I20260812 01:05:58.332660 17619 catalog_manager.cc:4841] TS e3073f1fde454c0d83c50929aa72a0d4 (127.4.201.66:38091): tablet 429afb2b821647a2b42e52978487ad7f (table test-table [id=39bbb9702b634029b831d53dd5be5a92]) successfully deleted
I20260812 01:05:58.333459 17616 catalog_manager.cc:4841] TS 2269ff65530b4f2abcb88d00827ae903 (127.4.201.67:38813): tablet 429afb2b821647a2b42e52978487ad7f (table test-table [id=39bbb9702b634029b831d53dd5be5a92]) successfully deleted
I20260812 01:05:58.334437 18579 ts_tablet_manager.cc:1918] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:05:58.334592 18579 log.cc:1196] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-0/wal/wals/429afb2b821647a2b42e52978487ad7f
I20260812 01:05:58.335000 18579 ts_tablet_manager.cc:1939] T 429afb2b821647a2b42e52978487ad7f P 9955e74d851642efba7f624884009661: Deleting consensus metadata
I20260812 01:05:58.336234 17616 catalog_manager.cc:4841] TS 9955e74d851642efba7f624884009661 (127.4.201.65:42805): tablet 429afb2b821647a2b42e52978487ad7f (table test-table [id=39bbb9702b634029b831d53dd5be5a92]) successfully deleted
I20260812 01:05:58.439165 18542 raft_consensus.cc:482] T 8e38fa409051466cb39c74d8032486f1 P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:05:58.439373 18542 raft_consensus.cc:504] T 8e38fa409051466cb39c74d8032486f1 P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:58.441083 18542 leader_election.cc:288] T 8e38fa409051466cb39c74d8032486f1 P e3073f1fde454c0d83c50929aa72a0d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9955e74d851642efba7f624884009661 (127.4.201.65:42805), 2269ff65530b4f2abcb88d00827ae903 (127.4.201.67:38813)
I20260812 01:05:58.448948 18588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:58.441516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:42805 (local address 127.4.201.66:43307)
0812 01:05:58.442063 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:58.442084 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:58.442225 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:58.442713 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:58.442719 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:58.442758 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:58.443204 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:58.443220 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.444554 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.444560 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:58.446396 (+ 1836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:58.446412 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.448112 (+ 1700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.448119 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:58.448279 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:58.448319 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 01:05:58.448427 (+ 108us) client_negotiation.cc:240] Negotiation successful
0812 01:05:58.448554 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":427,"mutex_wait_us":48,"thread_start_us":283,"threads_started":1}
I20260812 01:05:58.448956 18528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:58.441458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:43307 (local address 127.4.201.65:42805)
0812 01:05:58.441626 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:58.441630 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:58.442275 (+ 645us) server_negotiation.cc:407] Connection header received
0812 01:05:58.442358 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:58.442363 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:58.442433 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:58.442532 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:58.443401 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.444426 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.446571 (+ 2145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.447870 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.448042 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:58.448118 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:58.448465 (+ 347us) server_negotiation.cc:299] Negotiation successful
0812 01:05:58.448604 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 01:05:58.449162 18525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:58.442448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:42163 (local address 127.4.201.67:38813)
0812 01:05:58.442619 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:58.442624 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:58.443258 (+ 634us) server_negotiation.cc:407] Connection header received
0812 01:05:58.443388 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:58.443394 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:58.443480 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:58.443578 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:58.444176 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.445283 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.447251 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.448037 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.448197 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:58.448268 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:58.448785 (+ 517us) server_negotiation.cc:299] Negotiation successful
0812 01:05:58.448914 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 01:05:58.449740 18591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:58.442231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:38813 (local address 127.4.201.66:42163)
0812 01:05:58.443128 (+ 897us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:58.443150 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:58.443274 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:58.443603 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:58.443607 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:58.443636 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:58.443994 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:58.444008 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.445449 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.445455 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:58.447105 (+ 1650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:58.447117 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.448415 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.448422 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:58.448594 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:58.448624 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 01:05:58.449264 (+ 640us) client_negotiation.cc:240] Negotiation successful
0812 01:05:58.449383 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":755,"mutex_wait_us":5,"thread_start_us":539,"threads_started":1}
I20260812 01:05:58.450423 17911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e38fa409051466cb39c74d8032486f1" candidate_uuid: "e3073f1fde454c0d83c50929aa72a0d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9955e74d851642efba7f624884009661" is_pre_election: true
I20260812 01:05:58.450554 18398 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e38fa409051466cb39c74d8032486f1" candidate_uuid: "e3073f1fde454c0d83c50929aa72a0d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2269ff65530b4f2abcb88d00827ae903" is_pre_election: true
I20260812 01:05:58.450801 18398 raft_consensus.cc:2454] T 8e38fa409051466cb39c74d8032486f1 P 2269ff65530b4f2abcb88d00827ae903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3073f1fde454c0d83c50929aa72a0d4 in term 0.
I20260812 01:05:58.450861 17911 raft_consensus.cc:2454] T 8e38fa409051466cb39c74d8032486f1 P 9955e74d851642efba7f624884009661 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3073f1fde454c0d83c50929aa72a0d4 in term 0.
I20260812 01:05:58.451413 18029 leader_election.cc:302] T 8e38fa409051466cb39c74d8032486f1 P e3073f1fde454c0d83c50929aa72a0d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2269ff65530b4f2abcb88d00827ae903, e3073f1fde454c0d83c50929aa72a0d4; no voters:
I20260812 01:05:58.451804 18542 raft_consensus.cc:2781] T 8e38fa409051466cb39c74d8032486f1 P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:05:58.451920 18542 raft_consensus.cc:482] T 8e38fa409051466cb39c74d8032486f1 P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:05:58.452021 18542 raft_consensus.cc:3037] T 8e38fa409051466cb39c74d8032486f1 P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:58.454164 18542 raft_consensus.cc:504] T 8e38fa409051466cb39c74d8032486f1 P e3073f1fde454c0d83c50929aa72a0d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:58.454703 18542 leader_election.cc:288] T 8e38fa409051466cb39c74d8032486f1 P e3073f1fde454c0d83c50929aa72a0d4 [CANDIDATE]: Term 1 election: Requested vote from peers 9955e74d851642efba7f624884009661 (127.4.201.65:42805), 2269ff65530b4f2abcb88d00827ae903 (127.4.201.67:38813)
I20260812 01:05:58.455174 17911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e38fa409051466cb39c74d8032486f1" candidate_uuid: "e3073f1fde454c0d83c50929aa72a0d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9955e74d851642efba7f624884009661"
I20260812 01:05:58.455219 18398 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e38fa409051466cb39c74d8032486f1" candidate_uuid: "e3073f1fde454c0d83c50929aa72a0d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2269ff65530b4f2abcb88d00827ae903"
I20260812 01:05:58.455385 18398 raft_consensus.cc:3037] T 8e38fa409051466cb39c74d8032486f1 P 2269ff65530b4f2abcb88d00827ae903 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:58.455392 17911 raft_consensus.cc:3037] T 8e38fa409051466cb39c74d8032486f1 P 9955e74d851642efba7f624884009661 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:58.457376 18398 raft_consensus.cc:2454] T 8e38fa409051466cb39c74d8032486f1 P 2269ff65530b4f2abcb88d00827ae903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3073f1fde454c0d83c50929aa72a0d4 in term 1.
I20260812 01:05:58.457744 18029 leader_election.cc:302] T 8e38fa409051466cb39c74d8032486f1 P e3073f1fde454c0d83c50929aa72a0d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2269ff65530b4f2abcb88d00827ae903, e3073f1fde454c0d83c50929aa72a0d4; no voters:
I20260812 01:05:58.457985 18542 raft_consensus.cc:2781] T 8e38fa409051466cb39c74d8032486f1 P e3073f1fde454c0d83c50929aa72a0d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:05:58.458432 18542 raft_consensus.cc:686] T 8e38fa409051466cb39c74d8032486f1 P e3073f1fde454c0d83c50929aa72a0d4 [term 1 LEADER]: Becoming Leader. State: Replica: e3073f1fde454c0d83c50929aa72a0d4, State: Running, Role: LEADER
I20260812 01:05:58.458729 17911 raft_consensus.cc:2454] T 8e38fa409051466cb39c74d8032486f1 P 9955e74d851642efba7f624884009661 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3073f1fde454c0d83c50929aa72a0d4 in term 1.
I20260812 01:05:58.459067 18542 consensus_queue.cc:237] T 8e38fa409051466cb39c74d8032486f1 P e3073f1fde454c0d83c50929aa72a0d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:58.462422 17650 catalog_manager.cc:5495] T 8e38fa409051466cb39c74d8032486f1 P e3073f1fde454c0d83c50929aa72a0d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3073f1fde454c0d83c50929aa72a0d4 (127.4.201.66). New cstate: current_term: 1 leader_uuid: "e3073f1fde454c0d83c50929aa72a0d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } health_report { overall_health: UNKNOWN } } }
Aug 12 01:05:58 dist-test-slave-bndk krb5kdc[17561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496754, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.126@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM
I20260812 01:05:58.529338 18607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:58.515540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46300 (local address 127.4.201.126:44603)
0812 01:05:58.516455 (+ 915us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:58.516461 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:58.516480 (+ 19us) server_negotiation.cc:407] Connection header received
0812 01:05:58.516523 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:58.516527 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:58.516579 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:58.516667 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:58.517811 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.518626 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.519885 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.520335 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.520441 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:58.523949 (+ 3508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:58.523954 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:58.523958 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:58.523995 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:58.526565 (+ 2570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:58.527422 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:58.527426 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:58.527428 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:58.527552 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:58.527964 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:58.527967 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:58.527969 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:58.528242 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:58.528356 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:58.528841 (+ 485us) server_negotiation.cc:299] Negotiation successful
0812 01:05:58.529016 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":789,"thread_start_us":644,"threads_started":1}
I20260812 01:05:58.529769 18606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:58.515511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:44603 (local address 127.0.0.1:46300)
0812 01:05:58.516145 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:58.516171 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:58.516333 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:58.516729 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:58.516734 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:58.517417 (+ 683us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:05:58.517654 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:58.517664 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.518752 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.518756 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:58.519754 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:58.519768 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.520499 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.520506 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:58.520668 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:58.521302 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:05:58.521326 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:05:58.523720 (+ 2394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:05:58.526700 (+ 2980us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:58.526714 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:58.526722 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:58.527298 (+ 576us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:58.527660 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:05:58.527665 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:05:58.527669 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:05:58.527863 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:05:58.528374 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:05:58.528383 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:05:58.528580 (+ 197us) client_negotiation.cc:769] Sending connection context
0812 01:05:58.528772 (+ 192us) client_negotiation.cc:240] Negotiation successful
0812 01:05:58.529194 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"mutex_wait_us":120,"thread_start_us":318,"threads_started":1}
I20260812 01:05:58.535045 17650 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:46300:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 01:05:58.536398 17650 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:05:58.543581 17880 tablet_service.cc:1467] Processing CreateTablet for tablet 477ccba9457844f5a29176ef9583d390 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=743ee88ee6f1458f97f7c91ad47880c7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 01:05:58.544238 17880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 477ccba9457844f5a29176ef9583d390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:58.544049 18357 tablet_service.cc:1467] Processing CreateTablet for tablet 477ccba9457844f5a29176ef9583d390 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=743ee88ee6f1458f97f7c91ad47880c7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 01:05:58.544592 18357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 477ccba9457844f5a29176ef9583d390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:58.549746 18119 tablet_service.cc:1467] Processing CreateTablet for tablet 477ccba9457844f5a29176ef9583d390 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=743ee88ee6f1458f97f7c91ad47880c7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 01:05:58.550285 18119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 477ccba9457844f5a29176ef9583d390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:58.551599 18534 tablet_bootstrap.cc:492] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903: Bootstrap starting.
I20260812 01:05:58.553205 18534 tablet_bootstrap.cc:654] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:58.553611 18531 tablet_bootstrap.cc:492] T 477ccba9457844f5a29176ef9583d390 P 9955e74d851642efba7f624884009661: Bootstrap starting.
I20260812 01:05:58.555385 18531 tablet_bootstrap.cc:654] T 477ccba9457844f5a29176ef9583d390 P 9955e74d851642efba7f624884009661: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:58.557559 18530 tablet_bootstrap.cc:492] T 477ccba9457844f5a29176ef9583d390 P e3073f1fde454c0d83c50929aa72a0d4: Bootstrap starting.
I20260812 01:05:58.559290 18530 tablet_bootstrap.cc:654] T 477ccba9457844f5a29176ef9583d390 P e3073f1fde454c0d83c50929aa72a0d4: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:58.569101 18530 tablet_bootstrap.cc:492] T 477ccba9457844f5a29176ef9583d390 P e3073f1fde454c0d83c50929aa72a0d4: No bootstrap required, opened a new log
I20260812 01:05:58.569373 18530 ts_tablet_manager.cc:1397] T 477ccba9457844f5a29176ef9583d390 P e3073f1fde454c0d83c50929aa72a0d4: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.002s
I20260812 01:05:58.570184 18530 raft_consensus.cc:348] T 477ccba9457844f5a29176ef9583d390 P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:58.570580 18530 raft_consensus.cc:374] T 477ccba9457844f5a29176ef9583d390 P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:58.570704 18530 raft_consensus.cc:729] T 477ccba9457844f5a29176ef9583d390 P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3073f1fde454c0d83c50929aa72a0d4, State: Initialized, Role: FOLLOWER
I20260812 01:05:58.571020 18530 consensus_queue.cc:260] T 477ccba9457844f5a29176ef9583d390 P e3073f1fde454c0d83c50929aa72a0d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:58.571545 18542 tablet_replica.cc:439] T 477ccba9457844f5a29176ef9583d390 P e3073f1fde454c0d83c50929aa72a0d4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } } }
I20260812 01:05:58.571831 18542 tablet_replica.cc:442] T 477ccba9457844f5a29176ef9583d390 P e3073f1fde454c0d83c50929aa72a0d4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:05:58.572393 18530 ts_tablet_manager.cc:1428] T 477ccba9457844f5a29176ef9583d390 P e3073f1fde454c0d83c50929aa72a0d4: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260812 01:05:58.576421 18534 tablet_bootstrap.cc:492] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903: No bootstrap required, opened a new log
I20260812 01:05:58.576609 18534 ts_tablet_manager.cc:1397] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903: Time spent bootstrapping tablet: real 0.025s user 0.009s sys 0.009s
I20260812 01:05:58.577431 18534 raft_consensus.cc:348] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:58.577708 18534 raft_consensus.cc:374] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:58.577819 18534 raft_consensus.cc:729] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2269ff65530b4f2abcb88d00827ae903, State: Initialized, Role: FOLLOWER
I20260812 01:05:58.578135 18534 consensus_queue.cc:260] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:58.578805 18534 ts_tablet_manager.cc:1428] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 01:05:58.578665 18543 tablet_replica.cc:439] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } } }
I20260812 01:05:58.579059 18543 tablet_replica.cc:442] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:05:58.585752 18531 tablet_bootstrap.cc:492] T 477ccba9457844f5a29176ef9583d390 P 9955e74d851642efba7f624884009661: No bootstrap required, opened a new log
I20260812 01:05:58.585965 18531 ts_tablet_manager.cc:1397] T 477ccba9457844f5a29176ef9583d390 P 9955e74d851642efba7f624884009661: Time spent bootstrapping tablet: real 0.032s user 0.007s sys 0.022s
I20260812 01:05:58.586575 18531 raft_consensus.cc:348] T 477ccba9457844f5a29176ef9583d390 P 9955e74d851642efba7f624884009661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:58.586769 18531 raft_consensus.cc:374] T 477ccba9457844f5a29176ef9583d390 P 9955e74d851642efba7f624884009661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:58.586866 18531 raft_consensus.cc:729] T 477ccba9457844f5a29176ef9583d390 P 9955e74d851642efba7f624884009661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9955e74d851642efba7f624884009661, State: Initialized, Role: FOLLOWER
I20260812 01:05:58.587129 18531 consensus_queue.cc:260] T 477ccba9457844f5a29176ef9583d390 P 9955e74d851642efba7f624884009661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:58.587527 18568 tablet_replica.cc:439] T 477ccba9457844f5a29176ef9583d390 P 9955e74d851642efba7f624884009661: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } } }
I20260812 01:05:58.587949 18568 tablet_replica.cc:442] T 477ccba9457844f5a29176ef9583d390 P 9955e74d851642efba7f624884009661: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:05:58.588503 18531 ts_tablet_manager.cc:1428] T 477ccba9457844f5a29176ef9583d390 P 9955e74d851642efba7f624884009661: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 01:05:58.708662 18543 raft_consensus.cc:482] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:05:58.708958 18543 raft_consensus.cc:504] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:58.710906 18543 leader_election.cc:288] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9955e74d851642efba7f624884009661 (127.4.201.65:42805), e3073f1fde454c0d83c50929aa72a0d4 (127.4.201.66:38091)
I20260812 01:05:58.730918 18615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:58.711329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:51455 (local address 127.4.201.66:38091)
0812 01:05:58.723776 (+ 12447us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:58.723784 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:58.724617 (+ 833us) server_negotiation.cc:407] Connection header received
0812 01:05:58.724786 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:58.724791 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:58.724873 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:58.724971 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:58.725625 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.726409 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.729128 (+ 2719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.729963 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.730127 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:58.730209 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:58.730493 (+ 284us) server_negotiation.cc:299] Negotiation successful
0812 01:05:58.730630 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12295,"thread_start_us":12163,"threads_started":1}
I20260812 01:05:58.731014 18614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:58.711723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:38091 (local address 127.4.201.67:51455)
0812 01:05:58.724485 (+ 12762us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:58.724504 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:58.724640 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:58.724997 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:58.725002 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:58.725028 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:58.725461 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:58.725481 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.726547 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.726552 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:58.728917 (+ 2365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:58.728934 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.730185 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.730192 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:58.730334 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:58.730359 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 01:05:58.730444 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 01:05:58.730571 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12646,"mutex_wait_us":4,"thread_start_us":12075,"threads_started":1}
I20260812 01:05:58.731536 18528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:58.711486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:36689 (local address 127.4.201.65:42805)
0812 01:05:58.711970 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:58.711977 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:58.724221 (+ 12244us) server_negotiation.cc:407] Connection header received
0812 01:05:58.724615 (+ 394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:58.724621 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:58.724700 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:58.724782 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:05:58.725522 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.726593 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.729100 (+ 2507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.730381 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.730533 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:58.730596 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:58.731118 (+ 522us) server_negotiation.cc:299] Negotiation successful
0812 01:05:58.731251 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343}
I20260812 01:05:58.731854 18155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "477ccba9457844f5a29176ef9583d390" candidate_uuid: "2269ff65530b4f2abcb88d00827ae903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3073f1fde454c0d83c50929aa72a0d4" is_pre_election: true
I20260812 01:05:58.732103 18155 raft_consensus.cc:2454] T 477ccba9457844f5a29176ef9583d390 P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2269ff65530b4f2abcb88d00827ae903 in term 0.
I20260812 01:05:58.732237 18618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:58.711174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:42805 (local address 127.4.201.67:36689)
0812 01:05:58.724073 (+ 12899us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:58.724100 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:58.724392 (+ 292us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:58.724796 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:58.724801 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:58.724832 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:05:58.725304 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:58.725321 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.726738 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.726744 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:58.728923 (+ 2179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:58.728934 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.730762 (+ 1828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.730768 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:58.730923 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:58.730956 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 01:05:58.731780 (+ 824us) client_negotiation.cc:240] Negotiation successful
0812 01:05:58.731903 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12738,"mutex_wait_us":71,"thread_start_us":13009,"threads_started":1}
I20260812 01:05:58.732579 18267 leader_election.cc:302] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2269ff65530b4f2abcb88d00827ae903, e3073f1fde454c0d83c50929aa72a0d4; no voters:
I20260812 01:05:58.732860 17911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "477ccba9457844f5a29176ef9583d390" candidate_uuid: "2269ff65530b4f2abcb88d00827ae903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9955e74d851642efba7f624884009661" is_pre_election: true
I20260812 01:05:58.733012 18543 raft_consensus.cc:2781] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:05:58.733124 18543 raft_consensus.cc:482] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:05:58.733137 17911 raft_consensus.cc:2454] T 477ccba9457844f5a29176ef9583d390 P 9955e74d851642efba7f624884009661 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2269ff65530b4f2abcb88d00827ae903 in term 0.
I20260812 01:05:58.733198 18543 raft_consensus.cc:3037] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:58.736331 18543 raft_consensus.cc:504] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:58.736999 18543 leader_election.cc:288] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903 [CANDIDATE]: Term 1 election: Requested vote from peers 9955e74d851642efba7f624884009661 (127.4.201.65:42805), e3073f1fde454c0d83c50929aa72a0d4 (127.4.201.66:38091)
I20260812 01:05:58.737423 17911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "477ccba9457844f5a29176ef9583d390" candidate_uuid: "2269ff65530b4f2abcb88d00827ae903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9955e74d851642efba7f624884009661"
I20260812 01:05:58.737461 18155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "477ccba9457844f5a29176ef9583d390" candidate_uuid: "2269ff65530b4f2abcb88d00827ae903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3073f1fde454c0d83c50929aa72a0d4"
I20260812 01:05:58.737655 18155 raft_consensus.cc:3037] T 477ccba9457844f5a29176ef9583d390 P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:58.737656 17911 raft_consensus.cc:3037] T 477ccba9457844f5a29176ef9583d390 P 9955e74d851642efba7f624884009661 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:58.739954 17911 raft_consensus.cc:2454] T 477ccba9457844f5a29176ef9583d390 P 9955e74d851642efba7f624884009661 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2269ff65530b4f2abcb88d00827ae903 in term 1.
I20260812 01:05:58.740104 18155 raft_consensus.cc:2454] T 477ccba9457844f5a29176ef9583d390 P e3073f1fde454c0d83c50929aa72a0d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2269ff65530b4f2abcb88d00827ae903 in term 1.
I20260812 01:05:58.740341 18263 leader_election.cc:302] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2269ff65530b4f2abcb88d00827ae903, 9955e74d851642efba7f624884009661; no voters:
I20260812 01:05:58.740676 18543 raft_consensus.cc:2781] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:05:58.741096 18543 raft_consensus.cc:686] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903 [term 1 LEADER]: Becoming Leader. State: Replica: 2269ff65530b4f2abcb88d00827ae903, State: Running, Role: LEADER
I20260812 01:05:58.741540 18543 consensus_queue.cc:237] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:58.744204 18621 tablet_replica.cc:439] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903: TxnStatusTablet state changed. Reason: New leader 2269ff65530b4f2abcb88d00827ae903. Latest consensus state: current_term: 1 leader_uuid: "2269ff65530b4f2abcb88d00827ae903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } } }
I20260812 01:05:58.744660 18621 tablet_replica.cc:442] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903: This TxnStatusTablet replica's current role is: LEADER
I20260812 01:05:58.745322 18624 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 01:05:58.745553 18624 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 01:05:58.745586 17650 catalog_manager.cc:5495] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2269ff65530b4f2abcb88d00827ae903 (127.4.201.67). New cstate: current_term: 1 leader_uuid: "2269ff65530b4f2abcb88d00827ae903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } health_report { overall_health: HEALTHY } } }
I20260812 01:05:58.799044 18606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:58.792786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:38813 (local address 127.0.0.1:38644)
0812 01:05:58.793031 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:58.793049 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:58.793170 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:58.793748 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:58.793751 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:58.793762 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 01:05:58.793922 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:58.793929 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.795343 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.795349 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:58.796414 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:58.796429 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.797439 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.797444 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:58.797598 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:58.797656 (+ 58us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 01:05:58.798635 (+ 979us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 01:05:58.798647 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 01:05:58.798696 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 01:05:58.798808 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260812 01:05:58.799131 18525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:58.792782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38644 (local address 127.4.201.67:38813)
0812 01:05:58.793009 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:58.793016 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:58.793115 (+ 99us) server_negotiation.cc:407] Connection header received
0812 01:05:58.793441 (+ 326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:58.793448 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:58.793564 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:58.793740 (+ 176us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:05:58.794067 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.795208 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.796570 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.797298 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.797427 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:58.797839 (+ 412us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:05:58.798543 (+ 704us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:05:58.798696 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:58.798745 (+ 49us) server_negotiation.cc:299] Negotiation successful
0812 01:05:58.798830 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260812 01:05:58.803534 18155 raft_consensus.cc:1261] T 477ccba9457844f5a29176ef9583d390 P e3073f1fde454c0d83c50929aa72a0d4 [term 1 FOLLOWER]: Refusing update from remote peer 2269ff65530b4f2abcb88d00827ae903: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:58.803985 17911 raft_consensus.cc:1261] T 477ccba9457844f5a29176ef9583d390 P 9955e74d851642efba7f624884009661 [term 1 FOLLOWER]: Refusing update from remote peer 2269ff65530b4f2abcb88d00827ae903: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:58.804337 18621 consensus_queue.cc:1035] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:58.804728 18543 consensus_queue.cc:1035] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:58.807888 18542 tablet_replica.cc:439] T 477ccba9457844f5a29176ef9583d390 P e3073f1fde454c0d83c50929aa72a0d4: TxnStatusTablet state changed. Reason: New leader 2269ff65530b4f2abcb88d00827ae903. Latest consensus state: current_term: 1 leader_uuid: "2269ff65530b4f2abcb88d00827ae903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } } }
I20260812 01:05:58.808246 18542 tablet_replica.cc:442] T 477ccba9457844f5a29176ef9583d390 P e3073f1fde454c0d83c50929aa72a0d4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:05:58.812529 18630 mvcc.cc:205] Tried to move back new op lower bound from 7317490724052279296 to 7317490723809329152. Current Snapshot: MvccSnapshot[applied={T|T < 7317490724052279296}]
I20260812 01:05:58.816869 18542 tablet_replica.cc:439] T 477ccba9457844f5a29176ef9583d390 P e3073f1fde454c0d83c50929aa72a0d4: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2269ff65530b4f2abcb88d00827ae903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } } }
I20260812 01:05:58.817149 18542 tablet_replica.cc:442] T 477ccba9457844f5a29176ef9583d390 P e3073f1fde454c0d83c50929aa72a0d4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:05:58.817896 18543 tablet_replica.cc:439] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2269ff65530b4f2abcb88d00827ae903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } } }
I20260812 01:05:58.818177 18543 tablet_replica.cc:442] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903: This TxnStatusTablet replica's current role is: LEADER
I20260812 01:05:58.823231 18568 tablet_replica.cc:439] T 477ccba9457844f5a29176ef9583d390 P 9955e74d851642efba7f624884009661: TxnStatusTablet state changed. Reason: New leader 2269ff65530b4f2abcb88d00827ae903. Latest consensus state: current_term: 1 leader_uuid: "2269ff65530b4f2abcb88d00827ae903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } } }
I20260812 01:05:58.823537 18568 tablet_replica.cc:442] T 477ccba9457844f5a29176ef9583d390 P 9955e74d851642efba7f624884009661: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:05:58.825129 18543 tablet_replica.cc:439] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2269ff65530b4f2abcb88d00827ae903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } } }
I20260812 01:05:58.825397 18543 tablet_replica.cc:442] T 477ccba9457844f5a29176ef9583d390 P 2269ff65530b4f2abcb88d00827ae903: This TxnStatusTablet replica's current role is: LEADER
I20260812 01:05:58.828107 18568 tablet_replica.cc:439] T 477ccba9457844f5a29176ef9583d390 P 9955e74d851642efba7f624884009661: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2269ff65530b4f2abcb88d00827ae903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } } }
I20260812 01:05:58.828337 18568 tablet_replica.cc:442] T 477ccba9457844f5a29176ef9583d390 P 9955e74d851642efba7f624884009661: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 01:05:58.839502 18615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:58.829770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59288 (local address 127.4.201.66:38091)
0812 01:05:58.829935 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:58.829941 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:58.833985 (+ 4044us) server_negotiation.cc:407] Connection header received
0812 01:05:58.834181 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:58.834185 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:58.834270 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:58.834394 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:05:58.834904 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.835625 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.836968 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.837666 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.837798 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:58.838159 (+ 361us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:05:58.838904 (+ 745us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:05:58.839063 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:58.839114 (+ 51us) server_negotiation.cc:299] Negotiation successful
0812 01:05:58.839203 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 01:05:58.854910 18650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:58.849086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:38813 (local address 127.4.201.66:37963)
0812 01:05:58.849746 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:58.849763 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:58.849870 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:58.850173 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:58.850176 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:58.850184 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 01:05:58.850449 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:58.850457 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.851786 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.851789 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:58.852834 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:58.852846 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.853931 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.853936 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:58.854054 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:58.854105 (+ 51us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 01:05:58.854490 (+ 385us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 01:05:58.854497 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 01:05:58.854548 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 01:05:58.854644 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":350,"threads_started":1}
I20260812 01:05:58.855008 18525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:58.849104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:37963 (local address 127.4.201.67:38813)
0812 01:05:58.849302 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:58.849308 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:58.849836 (+ 528us) server_negotiation.cc:407] Connection header received
0812 01:05:58.849973 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:58.849978 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:58.850074 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:58.850170 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:05:58.850600 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.851675 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.852970 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.853741 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.853891 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:58.854280 (+ 389us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:05:58.854407 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:05:58.854505 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:58.854612 (+ 107us) server_negotiation.cc:299] Negotiation successful
0812 01:05:58.854691 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 01:05:58.864277 17911 raft_consensus.cc:1261] T 8e38fa409051466cb39c74d8032486f1 P 9955e74d851642efba7f624884009661 [term 1 FOLLOWER]: Refusing update from remote peer e3073f1fde454c0d83c50929aa72a0d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:58.864352 18398 raft_consensus.cc:1261] T 8e38fa409051466cb39c74d8032486f1 P 2269ff65530b4f2abcb88d00827ae903 [term 1 FOLLOWER]: Refusing update from remote peer e3073f1fde454c0d83c50929aa72a0d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:58.864939 18592 consensus_queue.cc:1035] T 8e38fa409051466cb39c74d8032486f1 P e3073f1fde454c0d83c50929aa72a0d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:58.865367 18542 consensus_queue.cc:1035] T 8e38fa409051466cb39c74d8032486f1 P e3073f1fde454c0d83c50929aa72a0d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:58.900810 18615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:58.893690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:39631 (local address 127.4.201.66:38091)
0812 01:05:58.893864 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:58.893870 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:58.894503 (+ 633us) server_negotiation.cc:407] Connection header received
0812 01:05:58.894730 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:58.894737 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:58.894832 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:58.894921 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:05:58.895725 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.896584 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.898724 (+ 2140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.899394 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.899502 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:58.900165 (+ 663us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:05:58.900289 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:05:58.900368 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:58.900517 (+ 149us) server_negotiation.cc:299] Negotiation successful
0812 01:05:58.900578 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 01:05:58.901052 18661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:58.893735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:38091 (local address 127.4.201.67:39631)
0812 01:05:58.894408 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0812 01:05:58.894424 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 01:05:58.894578 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:05:58.895072 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:05:58.895077 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:05:58.895090 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 01:05:58.895568 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:58.895582 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.896703 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.896709 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:58.898546 (+ 1837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:05:58.898564 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:05:58.899703 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:05:58.899709 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:05:58.899910 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:58.899978 (+ 68us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 01:05:58.900392 (+ 414us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 01:05:58.900411 (+ 19us) client_negotiation.cc:769] Sending connection context
0812 01:05:58.900504 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 01:05:58.900648 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":351,"threads_started":1}
I20260812 01:05:58.932899 17648 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46292:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:05:58.933151 17648 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46292:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:05:58.936594 17648 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4c6e00c48ab34d75bf69a57126ac3d79: Sending DeleteTablet for 3 replicas of tablet 8e38fa409051466cb39c74d8032486f1
I20260812 01:05:58.937461 18357 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e38fa409051466cb39c74d8032486f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:58 UTC) from {username='oryx', principal='oryx/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:38630
I20260812 01:05:58.937608 18119 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e38fa409051466cb39c74d8032486f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:58 UTC) from {username='oryx', principal='oryx/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:59274
I20260812 01:05:58.938216 17880 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e38fa409051466cb39c74d8032486f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:58 UTC) from {username='oryx', principal='oryx/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:54626
I20260812 01:05:58.963078 18668 tablet_replica.cc:330] T 8e38fa409051466cb39c74d8032486f1 P 9955e74d851642efba7f624884009661: stopping tablet replica
I20260812 01:05:58.963380 18668 raft_consensus.cc:2229] T 8e38fa409051466cb39c74d8032486f1 P 9955e74d851642efba7f624884009661 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:05:58.964228 18665 tablet_replica.cc:330] T 8e38fa409051466cb39c74d8032486f1 P 2269ff65530b4f2abcb88d00827ae903: stopping tablet replica
I20260812 01:05:58.963708 18668 raft_consensus.cc:2258] T 8e38fa409051466cb39c74d8032486f1 P 9955e74d851642efba7f624884009661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:58.965188 18666 tablet_replica.cc:330] T 8e38fa409051466cb39c74d8032486f1 P e3073f1fde454c0d83c50929aa72a0d4: stopping tablet replica
I20260812 01:05:58.965428 18666 raft_consensus.cc:2229] T 8e38fa409051466cb39c74d8032486f1 P e3073f1fde454c0d83c50929aa72a0d4 [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:05:58.966001 18668 ts_tablet_manager.cc:1905] T 8e38fa409051466cb39c74d8032486f1 P 9955e74d851642efba7f624884009661: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:58.966025 18666 raft_consensus.cc:2258] T 8e38fa409051466cb39c74d8032486f1 P e3073f1fde454c0d83c50929aa72a0d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:58.965505 18665 raft_consensus.cc:2229] T 8e38fa409051466cb39c74d8032486f1 P 2269ff65530b4f2abcb88d00827ae903 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:05:58.966501 18665 raft_consensus.cc:2258] T 8e38fa409051466cb39c74d8032486f1 P 2269ff65530b4f2abcb88d00827ae903 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:58.967202 18666 ts_tablet_manager.cc:1905] T 8e38fa409051466cb39c74d8032486f1 P e3073f1fde454c0d83c50929aa72a0d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:58.968276 18665 ts_tablet_manager.cc:1905] T 8e38fa409051466cb39c74d8032486f1 P 2269ff65530b4f2abcb88d00827ae903: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:58.974491 18666 ts_tablet_manager.cc:1918] T 8e38fa409051466cb39c74d8032486f1 P e3073f1fde454c0d83c50929aa72a0d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 01:05:58.974637 18666 log.cc:1196] T 8e38fa409051466cb39c74d8032486f1 P e3073f1fde454c0d83c50929aa72a0d4: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-1/wal/wals/8e38fa409051466cb39c74d8032486f1
I20260812 01:05:58.975111 18666 ts_tablet_manager.cc:1939] T 8e38fa409051466cb39c74d8032486f1 P e3073f1fde454c0d83c50929aa72a0d4: Deleting consensus metadata
I20260812 01:05:58.976313 17619 catalog_manager.cc:4841] TS e3073f1fde454c0d83c50929aa72a0d4 (127.4.201.66:38091): tablet 8e38fa409051466cb39c74d8032486f1 (table test-table [id=8c9651b044994edf85431b821d9370ad]) successfully deleted
I20260812 01:05:58.980295 18665 ts_tablet_manager.cc:1918] T 8e38fa409051466cb39c74d8032486f1 P 2269ff65530b4f2abcb88d00827ae903: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 01:05:58.982034 18668 ts_tablet_manager.cc:1918] T 8e38fa409051466cb39c74d8032486f1 P 9955e74d851642efba7f624884009661: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 01:05:58.982244 18668 log.cc:1196] T 8e38fa409051466cb39c74d8032486f1 P 9955e74d851642efba7f624884009661: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-0/wal/wals/8e38fa409051466cb39c74d8032486f1
I20260812 01:05:58.982744 18668 ts_tablet_manager.cc:1939] T 8e38fa409051466cb39c74d8032486f1 P 9955e74d851642efba7f624884009661: Deleting consensus metadata
I20260812 01:05:58.982910 18665 log.cc:1196] T 8e38fa409051466cb39c74d8032486f1 P 2269ff65530b4f2abcb88d00827ae903: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-2/wal/wals/8e38fa409051466cb39c74d8032486f1
I20260812 01:05:58.983417 18665 ts_tablet_manager.cc:1939] T 8e38fa409051466cb39c74d8032486f1 P 2269ff65530b4f2abcb88d00827ae903: Deleting consensus metadata
I20260812 01:05:58.984628 17616 catalog_manager.cc:4841] TS 9955e74d851642efba7f624884009661 (127.4.201.65:42805): tablet 8e38fa409051466cb39c74d8032486f1 (table test-table [id=8c9651b044994edf85431b821d9370ad]) successfully deleted
I20260812 01:05:58.985942 17616 catalog_manager.cc:4841] TS 2269ff65530b4f2abcb88d00827ae903 (127.4.201.67:38813): tablet 8e38fa409051466cb39c74d8032486f1 (table test-table [id=8c9651b044994edf85431b821d9370ad]) successfully deleted
Aug 12 01:05:59 dist-test-slave-bndk krb5kdc[17561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496759, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 01:05:59 dist-test-slave-bndk krb5kdc[17561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:05:59 dist-test-slave-bndk krb5kdc[17561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 01:05:59.041688 18607 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:05:59.027957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46306 (local address 127.4.201.126:44603)
0812 01:05:59.028179 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:59.028187 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:59.028603 (+ 416us) server_negotiation.cc:407] Connection header received
0812 01:05:59.028800 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:59.028806 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:59.028910 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:59.029029 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:59.030784 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:59.031958 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:59.033827 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:59.034457 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:59.034602 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:59.041414 (+ 6812us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46306: BlockingRecv error: recv got EOF from 127.0.0.1:46306 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 12 01:05:59 dist-test-slave-bndk krb5kdc[17561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496759, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM
I20260812 01:05:59.063773 18607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:59.045572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46316 (local address 127.4.201.126:44603)
0812 01:05:59.045746 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:59.045752 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:59.046499 (+ 747us) server_negotiation.cc:407] Connection header received
0812 01:05:59.046656 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:59.046662 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:59.046743 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:59.046840 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:05:59.048345 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:59.049439 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:59.051280 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:59.051928 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:59.052065 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:59.056810 (+ 4745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:05:59.056817 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:05:59.056830 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:05:59.056873 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:05:59.060327 (+ 3454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:59.061126 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:59.061132 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:59.061136 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:59.061603 (+ 467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:05:59.062047 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:05:59.062053 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:05:59.062056 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:05:59.062468 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:05:59.062723 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:59.063122 (+ 399us) server_negotiation.cc:299] Negotiation successful
0812 01:05:59.063400 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 01:05:59.068069 17648 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46316:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:05:59.068799 17648 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:05:59.076584 17880 tablet_service.cc:1467] Processing CreateTablet for tablet a49edacaafab4a46a7571966295b54da (DEFAULT_TABLE table=test-table [id=50f40a4c8e574204989103b7f56e7665]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:59.076866 18119 tablet_service.cc:1467] Processing CreateTablet for tablet a49edacaafab4a46a7571966295b54da (DEFAULT_TABLE table=test-table [id=50f40a4c8e574204989103b7f56e7665]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:59.077060 17880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a49edacaafab4a46a7571966295b54da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:59.077307 18119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a49edacaafab4a46a7571966295b54da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:59.084465 18531 tablet_bootstrap.cc:492] T a49edacaafab4a46a7571966295b54da P 9955e74d851642efba7f624884009661: Bootstrap starting.
I20260812 01:05:59.084897 18357 tablet_service.cc:1467] Processing CreateTablet for tablet a49edacaafab4a46a7571966295b54da (DEFAULT_TABLE table=test-table [id=50f40a4c8e574204989103b7f56e7665]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:59.085414 18357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a49edacaafab4a46a7571966295b54da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:59.086074 18531 tablet_bootstrap.cc:654] T a49edacaafab4a46a7571966295b54da P 9955e74d851642efba7f624884009661: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:59.105376 18690 tablet_bootstrap.cc:492] T a49edacaafab4a46a7571966295b54da P 2269ff65530b4f2abcb88d00827ae903: Bootstrap starting.
I20260812 01:05:59.107484 18690 tablet_bootstrap.cc:654] T a49edacaafab4a46a7571966295b54da P 2269ff65530b4f2abcb88d00827ae903: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:59.110312 18688 tablet_bootstrap.cc:492] T a49edacaafab4a46a7571966295b54da P e3073f1fde454c0d83c50929aa72a0d4: Bootstrap starting.
I20260812 01:05:59.112854 18688 tablet_bootstrap.cc:654] T a49edacaafab4a46a7571966295b54da P e3073f1fde454c0d83c50929aa72a0d4: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:59.118973 18690 tablet_bootstrap.cc:492] T a49edacaafab4a46a7571966295b54da P 2269ff65530b4f2abcb88d00827ae903: No bootstrap required, opened a new log
I20260812 01:05:59.119215 18690 ts_tablet_manager.cc:1397] T a49edacaafab4a46a7571966295b54da P 2269ff65530b4f2abcb88d00827ae903: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260812 01:05:59.121328 18690 raft_consensus.cc:348] T a49edacaafab4a46a7571966295b54da P 2269ff65530b4f2abcb88d00827ae903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:59.122103 18531 tablet_bootstrap.cc:492] T a49edacaafab4a46a7571966295b54da P 9955e74d851642efba7f624884009661: No bootstrap required, opened a new log
I20260812 01:05:59.122267 18690 raft_consensus.cc:374] T a49edacaafab4a46a7571966295b54da P 2269ff65530b4f2abcb88d00827ae903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:59.122277 18531 ts_tablet_manager.cc:1397] T a49edacaafab4a46a7571966295b54da P 9955e74d851642efba7f624884009661: Time spent bootstrapping tablet: real 0.038s user 0.010s sys 0.005s
I20260812 01:05:59.122466 18690 raft_consensus.cc:729] T a49edacaafab4a46a7571966295b54da P 2269ff65530b4f2abcb88d00827ae903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2269ff65530b4f2abcb88d00827ae903, State: Initialized, Role: FOLLOWER
I20260812 01:05:59.123109 18531 raft_consensus.cc:348] T a49edacaafab4a46a7571966295b54da P 9955e74d851642efba7f624884009661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:59.123394 18531 raft_consensus.cc:374] T a49edacaafab4a46a7571966295b54da P 9955e74d851642efba7f624884009661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:59.123493 18531 raft_consensus.cc:729] T a49edacaafab4a46a7571966295b54da P 9955e74d851642efba7f624884009661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9955e74d851642efba7f624884009661, State: Initialized, Role: FOLLOWER
I20260812 01:05:59.123760 18531 consensus_queue.cc:260] T a49edacaafab4a46a7571966295b54da P 9955e74d851642efba7f624884009661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:59.123775 18690 consensus_queue.cc:260] T a49edacaafab4a46a7571966295b54da P 2269ff65530b4f2abcb88d00827ae903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:59.124500 18690 ts_tablet_manager.cc:1428] T a49edacaafab4a46a7571966295b54da P 2269ff65530b4f2abcb88d00827ae903: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260812 01:05:59.129253 18531 ts_tablet_manager.cc:1428] T a49edacaafab4a46a7571966295b54da P 9955e74d851642efba7f624884009661: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260812 01:05:59.134815 18688 tablet_bootstrap.cc:492] T a49edacaafab4a46a7571966295b54da P e3073f1fde454c0d83c50929aa72a0d4: No bootstrap required, opened a new log
I20260812 01:05:59.134987 18688 ts_tablet_manager.cc:1397] T a49edacaafab4a46a7571966295b54da P e3073f1fde454c0d83c50929aa72a0d4: Time spent bootstrapping tablet: real 0.025s user 0.007s sys 0.015s
I20260812 01:05:59.135762 18688 raft_consensus.cc:348] T a49edacaafab4a46a7571966295b54da P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:59.136037 18688 raft_consensus.cc:374] T a49edacaafab4a46a7571966295b54da P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:59.136152 18688 raft_consensus.cc:729] T a49edacaafab4a46a7571966295b54da P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3073f1fde454c0d83c50929aa72a0d4, State: Initialized, Role: FOLLOWER
I20260812 01:05:59.136466 18688 consensus_queue.cc:260] T a49edacaafab4a46a7571966295b54da P e3073f1fde454c0d83c50929aa72a0d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:59.139037 18688 ts_tablet_manager.cc:1428] T a49edacaafab4a46a7571966295b54da P e3073f1fde454c0d83c50929aa72a0d4: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260812 01:05:59.466905 18657 raft_consensus.cc:482] T a49edacaafab4a46a7571966295b54da P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:05:59.467090 18657 raft_consensus.cc:504] T a49edacaafab4a46a7571966295b54da P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:59.467756 18657 leader_election.cc:288] T a49edacaafab4a46a7571966295b54da P e3073f1fde454c0d83c50929aa72a0d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9955e74d851642efba7f624884009661 (127.4.201.65:42805), 2269ff65530b4f2abcb88d00827ae903 (127.4.201.67:38813)
I20260812 01:05:59.468314 17911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a49edacaafab4a46a7571966295b54da" candidate_uuid: "e3073f1fde454c0d83c50929aa72a0d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9955e74d851642efba7f624884009661" is_pre_election: true
I20260812 01:05:59.468366 18398 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a49edacaafab4a46a7571966295b54da" candidate_uuid: "e3073f1fde454c0d83c50929aa72a0d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2269ff65530b4f2abcb88d00827ae903" is_pre_election: true
I20260812 01:05:59.468562 17911 raft_consensus.cc:2454] T a49edacaafab4a46a7571966295b54da P 9955e74d851642efba7f624884009661 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3073f1fde454c0d83c50929aa72a0d4 in term 0.
I20260812 01:05:59.468587 18398 raft_consensus.cc:2454] T a49edacaafab4a46a7571966295b54da P 2269ff65530b4f2abcb88d00827ae903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3073f1fde454c0d83c50929aa72a0d4 in term 0.
I20260812 01:05:59.469048 18029 leader_election.cc:302] T a49edacaafab4a46a7571966295b54da P e3073f1fde454c0d83c50929aa72a0d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9955e74d851642efba7f624884009661, e3073f1fde454c0d83c50929aa72a0d4; no voters:
I20260812 01:05:59.469344 18657 raft_consensus.cc:2781] T a49edacaafab4a46a7571966295b54da P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:05:59.469456 18657 raft_consensus.cc:482] T a49edacaafab4a46a7571966295b54da P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:05:59.469555 18657 raft_consensus.cc:3037] T a49edacaafab4a46a7571966295b54da P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:59.471516 18657 raft_consensus.cc:504] T a49edacaafab4a46a7571966295b54da P e3073f1fde454c0d83c50929aa72a0d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:59.471989 18657 leader_election.cc:288] T a49edacaafab4a46a7571966295b54da P e3073f1fde454c0d83c50929aa72a0d4 [CANDIDATE]: Term 1 election: Requested vote from peers 9955e74d851642efba7f624884009661 (127.4.201.65:42805), 2269ff65530b4f2abcb88d00827ae903 (127.4.201.67:38813)
I20260812 01:05:59.472500 17911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a49edacaafab4a46a7571966295b54da" candidate_uuid: "e3073f1fde454c0d83c50929aa72a0d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9955e74d851642efba7f624884009661"
I20260812 01:05:59.472569 18398 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a49edacaafab4a46a7571966295b54da" candidate_uuid: "e3073f1fde454c0d83c50929aa72a0d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2269ff65530b4f2abcb88d00827ae903"
I20260812 01:05:59.472672 17911 raft_consensus.cc:3037] T a49edacaafab4a46a7571966295b54da P 9955e74d851642efba7f624884009661 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:59.472759 18398 raft_consensus.cc:3037] T a49edacaafab4a46a7571966295b54da P 2269ff65530b4f2abcb88d00827ae903 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:59.474687 17911 raft_consensus.cc:2454] T a49edacaafab4a46a7571966295b54da P 9955e74d851642efba7f624884009661 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3073f1fde454c0d83c50929aa72a0d4 in term 1.
I20260812 01:05:59.474749 18398 raft_consensus.cc:2454] T a49edacaafab4a46a7571966295b54da P 2269ff65530b4f2abcb88d00827ae903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3073f1fde454c0d83c50929aa72a0d4 in term 1.
I20260812 01:05:59.475050 18029 leader_election.cc:302] T a49edacaafab4a46a7571966295b54da P e3073f1fde454c0d83c50929aa72a0d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9955e74d851642efba7f624884009661, e3073f1fde454c0d83c50929aa72a0d4; no voters:
I20260812 01:05:59.475307 18657 raft_consensus.cc:2781] T a49edacaafab4a46a7571966295b54da P e3073f1fde454c0d83c50929aa72a0d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:05:59.475646 18657 raft_consensus.cc:686] T a49edacaafab4a46a7571966295b54da P e3073f1fde454c0d83c50929aa72a0d4 [term 1 LEADER]: Becoming Leader. State: Replica: e3073f1fde454c0d83c50929aa72a0d4, State: Running, Role: LEADER
I20260812 01:05:59.475924 18657 consensus_queue.cc:237] T a49edacaafab4a46a7571966295b54da P e3073f1fde454c0d83c50929aa72a0d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:59.478399 17650 catalog_manager.cc:5495] T a49edacaafab4a46a7571966295b54da P e3073f1fde454c0d83c50929aa72a0d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3073f1fde454c0d83c50929aa72a0d4 (127.4.201.66). New cstate: current_term: 1 leader_uuid: "e3073f1fde454c0d83c50929aa72a0d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } health_report { overall_health: UNKNOWN } } }
I20260812 01:05:59.547971 18698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:05:59.543547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59294 (local address 127.4.201.66:38091)
0812 01:05:59.544012 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0812 01:05:59.544017 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:05:59.544034 (+ 17us) server_negotiation.cc:407] Connection header received
0812 01:05:59.544093 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:05:59.544097 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:05:59.544159 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:05:59.544247 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:05:59.544563 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:59.545272 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:59.546491 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:05:59.546912 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:05:59.547003 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:05:59.547337 (+ 334us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:05:59.547435 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:05:59.547498 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 01:05:59.547608 (+ 110us) server_negotiation.cc:299] Negotiation successful
0812 01:05:59.547672 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":260,"threads_started":1}
I20260812 01:05:59.550711 18398 raft_consensus.cc:1261] T a49edacaafab4a46a7571966295b54da P 2269ff65530b4f2abcb88d00827ae903 [term 1 FOLLOWER]: Refusing update from remote peer e3073f1fde454c0d83c50929aa72a0d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:59.550797 17911 raft_consensus.cc:1261] T a49edacaafab4a46a7571966295b54da P 9955e74d851642efba7f624884009661 [term 1 FOLLOWER]: Refusing update from remote peer e3073f1fde454c0d83c50929aa72a0d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:59.551342 18694 consensus_queue.cc:1035] T a49edacaafab4a46a7571966295b54da P e3073f1fde454c0d83c50929aa72a0d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:59.551641 18657 consensus_queue.cc:1035] T a49edacaafab4a46a7571966295b54da P e3073f1fde454c0d83c50929aa72a0d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:59.570770 17650 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46316:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:05:59.571002 17650 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46316:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:05:59.573752 17650 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4c6e00c48ab34d75bf69a57126ac3d79: Sending DeleteTablet for 3 replicas of tablet a49edacaafab4a46a7571966295b54da
I20260812 01:05:59.574651 18357 tablet_service.cc:1514] Processing DeleteTablet for tablet a49edacaafab4a46a7571966295b54da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:59 UTC) from {username='oryx', principal='oryx/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:38630
I20260812 01:05:59.574699 18119 tablet_service.cc:1514] Processing DeleteTablet for tablet a49edacaafab4a46a7571966295b54da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:59 UTC) from {username='oryx', principal='oryx/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:59274
I20260812 01:05:59.575068 17880 tablet_service.cc:1514] Processing DeleteTablet for tablet a49edacaafab4a46a7571966295b54da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:05:59 UTC) from {username='oryx', principal='oryx/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:54626
I20260812 01:05:59.575500 17650 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46316:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:05:59.576344 17650 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:05:59.582604 17876 tablet_service.cc:1467] Processing CreateTablet for tablet 0439202d099144a3a225aa308488635c (DEFAULT_TABLE table=test-table [id=43e1db4905f44f3ab2b3637716342906]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:59.583026 17876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0439202d099144a3a225aa308488635c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:59.588361 18531 tablet_bootstrap.cc:492] T 0439202d099144a3a225aa308488635c P 9955e74d851642efba7f624884009661: Bootstrap starting.
I20260812 01:05:59.589107 18117 tablet_service.cc:1467] Processing CreateTablet for tablet 0439202d099144a3a225aa308488635c (DEFAULT_TABLE table=test-table [id=43e1db4905f44f3ab2b3637716342906]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:59.589531 18117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0439202d099144a3a225aa308488635c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:59.590113 18531 tablet_bootstrap.cc:654] T 0439202d099144a3a225aa308488635c P 9955e74d851642efba7f624884009661: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:59.593194 18356 tablet_service.cc:1467] Processing CreateTablet for tablet 0439202d099144a3a225aa308488635c (DEFAULT_TABLE table=test-table [id=43e1db4905f44f3ab2b3637716342906]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:05:59.593683 18356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0439202d099144a3a225aa308488635c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:05:59.603179 18713 tablet_replica.cc:330] T a49edacaafab4a46a7571966295b54da P 9955e74d851642efba7f624884009661: stopping tablet replica
I20260812 01:05:59.603367 18713 raft_consensus.cc:2229] T a49edacaafab4a46a7571966295b54da P 9955e74d851642efba7f624884009661 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:05:59.603650 18531 tablet_bootstrap.cc:492] T 0439202d099144a3a225aa308488635c P 9955e74d851642efba7f624884009661: No bootstrap required, opened a new log
I20260812 01:05:59.603909 18531 ts_tablet_manager.cc:1397] T 0439202d099144a3a225aa308488635c P 9955e74d851642efba7f624884009661: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.004s
I20260812 01:05:59.604004 18690 tablet_bootstrap.cc:492] T 0439202d099144a3a225aa308488635c P 2269ff65530b4f2abcb88d00827ae903: Bootstrap starting.
I20260812 01:05:59.604081 18711 tablet_replica.cc:330] T a49edacaafab4a46a7571966295b54da P e3073f1fde454c0d83c50929aa72a0d4: stopping tablet replica
I20260812 01:05:59.604240 18711 raft_consensus.cc:2229] T a49edacaafab4a46a7571966295b54da P e3073f1fde454c0d83c50929aa72a0d4 [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:05:59.604552 18711 raft_consensus.cc:2258] T a49edacaafab4a46a7571966295b54da P e3073f1fde454c0d83c50929aa72a0d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:59.605638 18690 tablet_bootstrap.cc:654] T 0439202d099144a3a225aa308488635c P 2269ff65530b4f2abcb88d00827ae903: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:59.605672 18711 ts_tablet_manager.cc:1905] T a49edacaafab4a46a7571966295b54da P e3073f1fde454c0d83c50929aa72a0d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:59.606150 18531 raft_consensus.cc:348] T 0439202d099144a3a225aa308488635c P 9955e74d851642efba7f624884009661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:59.606508 18531 raft_consensus.cc:374] T 0439202d099144a3a225aa308488635c P 9955e74d851642efba7f624884009661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:59.606645 18531 raft_consensus.cc:729] T 0439202d099144a3a225aa308488635c P 9955e74d851642efba7f624884009661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9955e74d851642efba7f624884009661, State: Initialized, Role: FOLLOWER
I20260812 01:05:59.606951 18531 consensus_queue.cc:260] T 0439202d099144a3a225aa308488635c P 9955e74d851642efba7f624884009661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:59.603652 18713 raft_consensus.cc:2258] T a49edacaafab4a46a7571966295b54da P 9955e74d851642efba7f624884009661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:59.607479 18531 ts_tablet_manager.cc:1428] T 0439202d099144a3a225aa308488635c P 9955e74d851642efba7f624884009661: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260812 01:05:59.608777 18713 ts_tablet_manager.cc:1905] T a49edacaafab4a46a7571966295b54da P 9955e74d851642efba7f624884009661: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:59.611160 18688 tablet_bootstrap.cc:492] T 0439202d099144a3a225aa308488635c P e3073f1fde454c0d83c50929aa72a0d4: Bootstrap starting.
I20260812 01:05:59.612504 18688 tablet_bootstrap.cc:654] T 0439202d099144a3a225aa308488635c P e3073f1fde454c0d83c50929aa72a0d4: Neither blocks nor log segments found. Creating new log.
I20260812 01:05:59.614949 18688 tablet_bootstrap.cc:492] T 0439202d099144a3a225aa308488635c P e3073f1fde454c0d83c50929aa72a0d4: No bootstrap required, opened a new log
I20260812 01:05:59.614969 18713 ts_tablet_manager.cc:1918] T a49edacaafab4a46a7571966295b54da P 9955e74d851642efba7f624884009661: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:05:59.615103 18713 log.cc:1196] T a49edacaafab4a46a7571966295b54da P 9955e74d851642efba7f624884009661: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-0/wal/wals/a49edacaafab4a46a7571966295b54da
I20260812 01:05:59.615123 18688 ts_tablet_manager.cc:1397] T 0439202d099144a3a225aa308488635c P e3073f1fde454c0d83c50929aa72a0d4: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260812 01:05:59.615516 18713 ts_tablet_manager.cc:1939] T a49edacaafab4a46a7571966295b54da P 9955e74d851642efba7f624884009661: Deleting consensus metadata
I20260812 01:05:59.615813 18711 ts_tablet_manager.cc:1918] T a49edacaafab4a46a7571966295b54da P e3073f1fde454c0d83c50929aa72a0d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:05:59.615952 18711 log.cc:1196] T a49edacaafab4a46a7571966295b54da P e3073f1fde454c0d83c50929aa72a0d4: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-1/wal/wals/a49edacaafab4a46a7571966295b54da
I20260812 01:05:59.615901 18688 raft_consensus.cc:348] T 0439202d099144a3a225aa308488635c P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:59.616183 18688 raft_consensus.cc:374] T 0439202d099144a3a225aa308488635c P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:59.616267 18688 raft_consensus.cc:729] T 0439202d099144a3a225aa308488635c P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3073f1fde454c0d83c50929aa72a0d4, State: Initialized, Role: FOLLOWER
I20260812 01:05:59.616405 18711 ts_tablet_manager.cc:1939] T a49edacaafab4a46a7571966295b54da P e3073f1fde454c0d83c50929aa72a0d4: Deleting consensus metadata
I20260812 01:05:59.616699 17616 catalog_manager.cc:4841] TS 9955e74d851642efba7f624884009661 (127.4.201.65:42805): tablet a49edacaafab4a46a7571966295b54da (table test-table [id=50f40a4c8e574204989103b7f56e7665]) successfully deleted
I20260812 01:05:59.616791 18710 tablet_replica.cc:330] T a49edacaafab4a46a7571966295b54da P 2269ff65530b4f2abcb88d00827ae903: stopping tablet replica
I20260812 01:05:59.617000 18710 raft_consensus.cc:2229] T a49edacaafab4a46a7571966295b54da P 2269ff65530b4f2abcb88d00827ae903 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:05:59.617297 18710 raft_consensus.cc:2258] T a49edacaafab4a46a7571966295b54da P 2269ff65530b4f2abcb88d00827ae903 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:05:59.617571 17619 catalog_manager.cc:4841] TS e3073f1fde454c0d83c50929aa72a0d4 (127.4.201.66:38091): tablet a49edacaafab4a46a7571966295b54da (table test-table [id=50f40a4c8e574204989103b7f56e7665]) successfully deleted
I20260812 01:05:59.618782 18710 ts_tablet_manager.cc:1905] T a49edacaafab4a46a7571966295b54da P 2269ff65530b4f2abcb88d00827ae903: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:05:59.620296 18688 consensus_queue.cc:260] T 0439202d099144a3a225aa308488635c P e3073f1fde454c0d83c50929aa72a0d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:59.620874 18688 ts_tablet_manager.cc:1428] T 0439202d099144a3a225aa308488635c P e3073f1fde454c0d83c50929aa72a0d4: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260812 01:05:59.621446 18690 tablet_bootstrap.cc:492] T 0439202d099144a3a225aa308488635c P 2269ff65530b4f2abcb88d00827ae903: No bootstrap required, opened a new log
I20260812 01:05:59.621635 18690 ts_tablet_manager.cc:1397] T 0439202d099144a3a225aa308488635c P 2269ff65530b4f2abcb88d00827ae903: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.000s
I20260812 01:05:59.622418 18690 raft_consensus.cc:348] T 0439202d099144a3a225aa308488635c P 2269ff65530b4f2abcb88d00827ae903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:59.622695 18690 raft_consensus.cc:374] T 0439202d099144a3a225aa308488635c P 2269ff65530b4f2abcb88d00827ae903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:05:59.622781 18690 raft_consensus.cc:729] T 0439202d099144a3a225aa308488635c P 2269ff65530b4f2abcb88d00827ae903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2269ff65530b4f2abcb88d00827ae903, State: Initialized, Role: FOLLOWER
I20260812 01:05:59.623028 18690 consensus_queue.cc:260] T 0439202d099144a3a225aa308488635c P 2269ff65530b4f2abcb88d00827ae903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:59.623682 18690 ts_tablet_manager.cc:1428] T 0439202d099144a3a225aa308488635c P 2269ff65530b4f2abcb88d00827ae903: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 01:05:59.629091 18710 ts_tablet_manager.cc:1918] T a49edacaafab4a46a7571966295b54da P 2269ff65530b4f2abcb88d00827ae903: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:05:59.629199 18710 log.cc:1196] T a49edacaafab4a46a7571966295b54da P 2269ff65530b4f2abcb88d00827ae903: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-2/wal/wals/a49edacaafab4a46a7571966295b54da
I20260812 01:05:59.629559 18710 ts_tablet_manager.cc:1939] T a49edacaafab4a46a7571966295b54da P 2269ff65530b4f2abcb88d00827ae903: Deleting consensus metadata
I20260812 01:05:59.630311 17616 catalog_manager.cc:4841] TS 2269ff65530b4f2abcb88d00827ae903 (127.4.201.67:38813): tablet a49edacaafab4a46a7571966295b54da (table test-table [id=50f40a4c8e574204989103b7f56e7665]) successfully deleted
I20260812 01:05:59.934803 18657 raft_consensus.cc:482] T 0439202d099144a3a225aa308488635c P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:05:59.935026 18657 raft_consensus.cc:504] T 0439202d099144a3a225aa308488635c P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:59.935658 18657 leader_election.cc:288] T 0439202d099144a3a225aa308488635c P e3073f1fde454c0d83c50929aa72a0d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9955e74d851642efba7f624884009661 (127.4.201.65:42805), 2269ff65530b4f2abcb88d00827ae903 (127.4.201.67:38813)
I20260812 01:05:59.936280 17911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0439202d099144a3a225aa308488635c" candidate_uuid: "e3073f1fde454c0d83c50929aa72a0d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9955e74d851642efba7f624884009661" is_pre_election: true
I20260812 01:05:59.936319 18398 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0439202d099144a3a225aa308488635c" candidate_uuid: "e3073f1fde454c0d83c50929aa72a0d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2269ff65530b4f2abcb88d00827ae903" is_pre_election: true
I20260812 01:05:59.936525 17911 raft_consensus.cc:2454] T 0439202d099144a3a225aa308488635c P 9955e74d851642efba7f624884009661 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3073f1fde454c0d83c50929aa72a0d4 in term 0.
I20260812 01:05:59.936548 18398 raft_consensus.cc:2454] T 0439202d099144a3a225aa308488635c P 2269ff65530b4f2abcb88d00827ae903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3073f1fde454c0d83c50929aa72a0d4 in term 0.
I20260812 01:05:59.936962 18029 leader_election.cc:302] T 0439202d099144a3a225aa308488635c P e3073f1fde454c0d83c50929aa72a0d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2269ff65530b4f2abcb88d00827ae903, e3073f1fde454c0d83c50929aa72a0d4; no voters:
I20260812 01:05:59.937307 18657 raft_consensus.cc:2781] T 0439202d099144a3a225aa308488635c P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:05:59.937420 18657 raft_consensus.cc:482] T 0439202d099144a3a225aa308488635c P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:05:59.937508 18657 raft_consensus.cc:3037] T 0439202d099144a3a225aa308488635c P e3073f1fde454c0d83c50929aa72a0d4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:59.939533 18657 raft_consensus.cc:504] T 0439202d099144a3a225aa308488635c P e3073f1fde454c0d83c50929aa72a0d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:59.940034 18657 leader_election.cc:288] T 0439202d099144a3a225aa308488635c P e3073f1fde454c0d83c50929aa72a0d4 [CANDIDATE]: Term 1 election: Requested vote from peers 9955e74d851642efba7f624884009661 (127.4.201.65:42805), 2269ff65530b4f2abcb88d00827ae903 (127.4.201.67:38813)
I20260812 01:05:59.940541 17911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0439202d099144a3a225aa308488635c" candidate_uuid: "e3073f1fde454c0d83c50929aa72a0d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9955e74d851642efba7f624884009661"
I20260812 01:05:59.940577 18398 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0439202d099144a3a225aa308488635c" candidate_uuid: "e3073f1fde454c0d83c50929aa72a0d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2269ff65530b4f2abcb88d00827ae903"
I20260812 01:05:59.940711 17911 raft_consensus.cc:3037] T 0439202d099144a3a225aa308488635c P 9955e74d851642efba7f624884009661 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:59.940737 18398 raft_consensus.cc:3037] T 0439202d099144a3a225aa308488635c P 2269ff65530b4f2abcb88d00827ae903 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:05:59.943154 17911 raft_consensus.cc:2454] T 0439202d099144a3a225aa308488635c P 9955e74d851642efba7f624884009661 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3073f1fde454c0d83c50929aa72a0d4 in term 1.
I20260812 01:05:59.943325 18398 raft_consensus.cc:2454] T 0439202d099144a3a225aa308488635c P 2269ff65530b4f2abcb88d00827ae903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3073f1fde454c0d83c50929aa72a0d4 in term 1.
I20260812 01:05:59.943499 18029 leader_election.cc:302] T 0439202d099144a3a225aa308488635c P e3073f1fde454c0d83c50929aa72a0d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9955e74d851642efba7f624884009661, e3073f1fde454c0d83c50929aa72a0d4; no voters:
I20260812 01:05:59.943771 18657 raft_consensus.cc:2781] T 0439202d099144a3a225aa308488635c P e3073f1fde454c0d83c50929aa72a0d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:05:59.943924 18657 raft_consensus.cc:686] T 0439202d099144a3a225aa308488635c P e3073f1fde454c0d83c50929aa72a0d4 [term 1 LEADER]: Becoming Leader. State: Replica: e3073f1fde454c0d83c50929aa72a0d4, State: Running, Role: LEADER
I20260812 01:05:59.944181 18657 consensus_queue.cc:237] T 0439202d099144a3a225aa308488635c P e3073f1fde454c0d83c50929aa72a0d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } }
I20260812 01:05:59.946657 17650 catalog_manager.cc:5495] T 0439202d099144a3a225aa308488635c P e3073f1fde454c0d83c50929aa72a0d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3073f1fde454c0d83c50929aa72a0d4 (127.4.201.66). New cstate: current_term: 1 leader_uuid: "e3073f1fde454c0d83c50929aa72a0d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3073f1fde454c0d83c50929aa72a0d4" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 } health_report { overall_health: UNKNOWN } } }
I20260812 01:05:59.971345 18398 raft_consensus.cc:1261] T 0439202d099144a3a225aa308488635c P 2269ff65530b4f2abcb88d00827ae903 [term 1 FOLLOWER]: Refusing update from remote peer e3073f1fde454c0d83c50929aa72a0d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:59.971410 17911 raft_consensus.cc:1261] T 0439202d099144a3a225aa308488635c P 9955e74d851642efba7f624884009661 [term 1 FOLLOWER]: Refusing update from remote peer e3073f1fde454c0d83c50929aa72a0d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:05:59.971854 18694 consensus_queue.cc:1035] T 0439202d099144a3a225aa308488635c P e3073f1fde454c0d83c50929aa72a0d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2269ff65530b4f2abcb88d00827ae903" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:05:59.972093 18657 consensus_queue.cc:1035] T 0439202d099144a3a225aa308488635c P e3073f1fde454c0d83c50929aa72a0d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9955e74d851642efba7f624884009661" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:06:00.016594 17648 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46316:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:06:00.016845 17648 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46316:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:06:00.019544 17648 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4c6e00c48ab34d75bf69a57126ac3d79: Sending DeleteTablet for 3 replicas of tablet 0439202d099144a3a225aa308488635c
I20260812 01:06:00.020327 17876 tablet_service.cc:1514] Processing DeleteTablet for tablet 0439202d099144a3a225aa308488635c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:06:00 UTC) from {username='oryx', principal='oryx/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:54626
I20260812 01:06:00.020404 18117 tablet_service.cc:1514] Processing DeleteTablet for tablet 0439202d099144a3a225aa308488635c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:06:00 UTC) from {username='oryx', principal='oryx/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:59274
I20260812 01:06:00.020551 18357 tablet_service.cc:1514] Processing DeleteTablet for tablet 0439202d099144a3a225aa308488635c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:06:00 UTC) from {username='oryx', principal='oryx/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:38630
I20260812 01:06:00.020627 18713 tablet_replica.cc:330] T 0439202d099144a3a225aa308488635c P 9955e74d851642efba7f624884009661: stopping tablet replica
I20260812 01:06:00.020812 18710 tablet_replica.cc:330] T 0439202d099144a3a225aa308488635c P 2269ff65530b4f2abcb88d00827ae903: stopping tablet replica
I20260812 01:06:00.020839 18711 tablet_replica.cc:330] T 0439202d099144a3a225aa308488635c P e3073f1fde454c0d83c50929aa72a0d4: stopping tablet replica
I20260812 01:06:00.020839 18713 raft_consensus.cc:2229] T 0439202d099144a3a225aa308488635c P 9955e74d851642efba7f624884009661 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:06:00.020992 18711 raft_consensus.cc:2229] T 0439202d099144a3a225aa308488635c P e3073f1fde454c0d83c50929aa72a0d4 [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:06:00.020994 18710 raft_consensus.cc:2229] T 0439202d099144a3a225aa308488635c P 2269ff65530b4f2abcb88d00827ae903 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:06:00.021039 18713 raft_consensus.cc:2258] T 0439202d099144a3a225aa308488635c P 9955e74d851642efba7f624884009661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:06:00.021162 18710 raft_consensus.cc:2258] T 0439202d099144a3a225aa308488635c P 2269ff65530b4f2abcb88d00827ae903 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:06:00.021265 18711 raft_consensus.cc:2258] T 0439202d099144a3a225aa308488635c P e3073f1fde454c0d83c50929aa72a0d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:06:00.022140 18710 ts_tablet_manager.cc:1905] T 0439202d099144a3a225aa308488635c P 2269ff65530b4f2abcb88d00827ae903: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:06:00.022161 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 17767
I20260812 01:06:00.022394 18711 ts_tablet_manager.cc:1905] T 0439202d099144a3a225aa308488635c P e3073f1fde454c0d83c50929aa72a0d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:06:00.024771 18713 ts_tablet_manager.cc:1905] T 0439202d099144a3a225aa308488635c P 9955e74d851642efba7f624884009661: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:06:00.028636 18711 ts_tablet_manager.cc:1918] T 0439202d099144a3a225aa308488635c P e3073f1fde454c0d83c50929aa72a0d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 01:06:00.028826 18711 log.cc:1196] T 0439202d099144a3a225aa308488635c P e3073f1fde454c0d83c50929aa72a0d4: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-1/wal/wals/0439202d099144a3a225aa308488635c
I20260812 01:06:00.028975 18710 ts_tablet_manager.cc:1918] T 0439202d099144a3a225aa308488635c P 2269ff65530b4f2abcb88d00827ae903: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 01:06:00.029184 18710 log.cc:1196] T 0439202d099144a3a225aa308488635c P 2269ff65530b4f2abcb88d00827ae903: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-2/wal/wals/0439202d099144a3a225aa308488635c
I20260812 01:06:00.029332 18711 ts_tablet_manager.cc:1939] T 0439202d099144a3a225aa308488635c P e3073f1fde454c0d83c50929aa72a0d4: Deleting consensus metadata
I20260812 01:06:00.029686 18710 ts_tablet_manager.cc:1939] T 0439202d099144a3a225aa308488635c P 2269ff65530b4f2abcb88d00827ae903: Deleting consensus metadata
I20260812 01:06:00.030373 17619 catalog_manager.cc:4841] TS e3073f1fde454c0d83c50929aa72a0d4 (127.4.201.66:38091): tablet 0439202d099144a3a225aa308488635c (table test-table [id=43e1db4905f44f3ab2b3637716342906]) successfully deleted
I20260812 01:06:00.030733 17616 catalog_manager.cc:4841] TS 2269ff65530b4f2abcb88d00827ae903 (127.4.201.67:38813): tablet 0439202d099144a3a225aa308488635c (table test-table [id=43e1db4905f44f3ab2b3637716342906]) successfully deleted
I20260812 01:06:00.031103 18713 ts_tablet_manager.cc:1918] T 0439202d099144a3a225aa308488635c P 9955e74d851642efba7f624884009661: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 01:06:00.031240 18713 log.cc:1196] T 0439202d099144a3a225aa308488635c P 9955e74d851642efba7f624884009661: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786496689953932-4901-0/minicluster-data/ts-0/wal/wals/0439202d099144a3a225aa308488635c
I20260812 01:06:00.031605 18713 ts_tablet_manager.cc:1939] T 0439202d099144a3a225aa308488635c P 9955e74d851642efba7f624884009661: Deleting consensus metadata
I20260812 01:06:00.032410 17616 catalog_manager.cc:4841] TS 9955e74d851642efba7f624884009661 (127.4.201.65:42805): tablet 0439202d099144a3a225aa308488635c (table test-table [id=43e1db4905f44f3ab2b3637716342906]) successfully deleted
Aug 12 01:06:00 dist-test-slave-bndk krb5kdc[17561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496759, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.4.201.65@KRBTEST.COM
I20260812 01:06:00.045598 18746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:00.023406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54638 (local address 127.4.201.65:42805)
0812 01:06:00.032577 (+ 9171us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:00.032583 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:00.032609 (+ 26us) server_negotiation.cc:407] Connection header received
0812 01:06:00.032654 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:00.032657 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:00.032712 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:00.032796 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:00.034025 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:00.034720 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:00.035828 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:00.036225 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:00.036321 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:00.040104 (+ 3783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:00.040118 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:00.040137 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:06:00.040171 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:00.042934 (+ 2763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:00.043563 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:00.043570 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:00.043573 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:00.043703 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:00.044067 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:00.044071 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:00.044073 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:00.044436 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:00.044731 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:00.045016 (+ 285us) server_negotiation.cc:299] Negotiation successful
0812 01:06:00.045267 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9041,"thread_start_us":8913,"threads_started":1}
I20260812 01:06:00.046211 17988 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:06:00.169977 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 17767
I20260812 01:06:00.201606 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 18008
Aug 12 01:06:00 dist-test-slave-bndk krb5kdc[17561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496759, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.4.201.66@KRBTEST.COM
I20260812 01:06:00.216327 18751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:00.202354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59306 (local address 127.4.201.66:38091)
0812 01:06:00.202840 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:00.202844 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:00.202859 (+ 15us) server_negotiation.cc:407] Connection header received
0812 01:06:00.202913 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:00.202917 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:00.202992 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:00.203090 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:00.204290 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:00.205176 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:00.206556 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:00.206962 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:00.207082 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:00.211071 (+ 3989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:00.211086 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:00.211101 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:06:00.211132 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:00.213707 (+ 2575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:00.214320 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:00.214328 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:00.214330 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:00.214477 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:00.214821 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:00.214825 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:00.214827 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:00.215169 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:00.215468 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:00.215778 (+ 310us) server_negotiation.cc:299] Negotiation successful
0812 01:06:00.216021 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":243,"threads_started":1}
I20260812 01:06:00.216930 18216 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:06:00.340839 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 18008
I20260812 01:06:00.380460 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 18237
Aug 12 01:06:00 dist-test-slave-bndk krb5kdc[17561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496759, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.4.201.67@KRBTEST.COM
I20260812 01:06:00.395701 18758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:00.381250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38654 (local address 127.4.201.67:38813)
0812 01:06:00.381706 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:00.381711 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:00.381729 (+ 18us) server_negotiation.cc:407] Connection header received
0812 01:06:00.381785 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:00.381789 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:00.381857 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:00.381948 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:00.383283 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:00.383999 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:00.385317 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:00.385765 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:00.385859 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:00.390072 (+ 4213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:00.390089 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:00.390107 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:06:00.390150 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:00.393113 (+ 2963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:00.393818 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:00.393826 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:00.393829 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:00.393961 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:00.394252 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:00.394255 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:00.394257 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:00.394626 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:00.394856 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:00.395154 (+ 298us) server_negotiation.cc:299] Negotiation successful
0812 01:06:00.395338 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":254,"threads_started":1}
I20260812 01:06:00.396337 18478 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:06:00.518177 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 18237
I20260812 01:06:00.545584 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 17587
I20260812 01:06:00.546715 17718 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:06:00.661823 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 17587
2026-08-12T01:06:00Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (7612 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:06:00 dist-test-slave-bndk krb5kdc[18767](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:06:00 dist-test-slave-bndk krb5kdc[18767](info): set up 2 sockets
Aug 12 01:06:00 dist-test-slave-bndk krb5kdc[18767](info): commencing operation
krb5kdc: starting...
W20260812 01:06:01.896399 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.183s user 0.000s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:06:02 dist-test-slave-bndk krb5kdc[18767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496762, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:06:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:06:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.201.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
I20260812 01:06:02.134501 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:35997
--webserver_interface=127.4.201.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:33609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:35997
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:06:02.466073 18792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:06:02.466470 18792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:06:02.466622 18792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:06:02.476397 18792 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:06:02.476528 18792 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:06:02.476603 18792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:06:02.476689 18792 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:06:02.476763 18792 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:06:02.490723 18792 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:33609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:35997
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:35997
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:06:02.492592 18792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:06:02.494489 18792 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:06:02.509440 18801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:02.509521 18803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:02.510059 18800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:06:02.511057 18792 server_base.cc:1034] running on GCE node
I20260812 01:06:02.511839 18792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:06:02.513200 18792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:06:02.514474 18792 hybrid_clock.cc:648] HybridClock initialized: now 1786496762514422 us; error 38 us; skew 500 ppm
I20260812 01:06:02.514816 18792 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-12T01:06:02Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1912 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:06:02 dist-test-slave-bndk krb5kdc[18813](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:06:02 dist-test-slave-bndk krb5kdc[18813](info): set up 2 sockets
Aug 12 01:06:02 dist-test-slave-bndk krb5kdc[18813](info): commencing operation
krb5kdc: starting...
W20260812 01:06:03.815438 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.189s user 0.000s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:06:03 dist-test-slave-bndk krb5kdc[18813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496763, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:06:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:06:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.201.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
I20260812 01:06:04.050817 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:37967
--webserver_interface=127.4.201.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:40463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:37967
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:06:04.374229 18829 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:06:04.374518 18829 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:06:04.374632 18829 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:06:04.381699 18829 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:06:04.381803 18829 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:06:04.381877 18829 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:06:04.381950 18829 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:06:04.382014 18829 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:06:04.391641 18829 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:40463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:37967
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:37967
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:06:04.392896 18829 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:06:04.394218 18829 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:06:04.405342 18838 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:04.405393 18842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:04.405426 18837 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:06:04.406229 18829 server_base.cc:1034] running on GCE node
I20260812 01:06:04.406920 18829 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:06:04.408246 18829 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:06:04.409438 18829 hybrid_clock.cc:648] HybridClock initialized: now 1786496764409397 us; error 25 us; skew 500 ppm
I20260812 01:06:04.409749 18829 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:06:04 dist-test-slave-bndk krb5kdc[18813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496764, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:06:04.415953 18829 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:06:04.417378 18829 webserver.cc:460] Webserver started at http://127.4.201.126:40681/ using document root <none> and password file <none>
I20260812 01:06:04.418012 18829 fs_manager.cc:359] Metadata directory not provided
I20260812 01:06:04.418111 18829 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:06:04.418371 18829 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:06:04.421265 18829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "2b3e289dce44422e9d96a2ca0694da0f"
format_stamp: "Formatted at 2026-08-12 01:06:04 on dist-test-slave-bndk"
server_key: "73ceb6128af9d54b406867e635566821"
server_key_iv: "5f7febe08e806f96493124fc4c3da2d8"
server_key_version: "encryptionkey@0"
I20260812 01:06:04.422005 18829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "2b3e289dce44422e9d96a2ca0694da0f"
format_stamp: "Formatted at 2026-08-12 01:06:04 on dist-test-slave-bndk"
server_key: "73ceb6128af9d54b406867e635566821"
server_key_iv: "5f7febe08e806f96493124fc4c3da2d8"
server_key_version: "encryptionkey@0"
I20260812 01:06:04.426923 18829 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 01:06:04.430200 18857 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:04.431425 18829 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 01:06:04.431595 18829 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "2b3e289dce44422e9d96a2ca0694da0f"
format_stamp: "Formatted at 2026-08-12 01:06:04 on dist-test-slave-bndk"
server_key: "73ceb6128af9d54b406867e635566821"
server_key_iv: "5f7febe08e806f96493124fc4c3da2d8"
server_key_version: "encryptionkey@0"
I20260812 01:06:04.431768 18829 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:06:04.443615 18829 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:06:04.447109 18829 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:06:04.447358 18829 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:06:04.464008 18829 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:37967
I20260812 01:06:04.464027 18945 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:37967 every 8 connection(s)
I20260812 01:06:04.465348 18829 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:06:04.469004 18946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:06:04.470503 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 18829
I20260812 01:06:04.470695 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:06:04.471330 4901 external_mini_cluster.cc:1428] Setting key 59e49c38a0d3ff616a424dcc1f7c420b
I20260812 01:06:04.483178 18946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f: Bootstrap starting.
Aug 12 01:06:04 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496763, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:06:04.486254 18946 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f: Neither blocks nor log segments found. Creating new log.
I20260812 01:06:04.487355 18946 log.cc:824] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f: Log is configured to *not* fsync() on all Append() calls
I20260812 01:06:04.490317 18946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f: No bootstrap required, opened a new log
I20260812 01:06:04.493726 18950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:04.473303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42770 (local address 127.4.201.126:37967)
0812 01:06:04.474167 (+ 864us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:04.474183 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:04.474243 (+ 60us) server_negotiation.cc:407] Connection header received
0812 01:06:04.475955 (+ 1712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:04.475988 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:04.476496 (+ 508us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:04.476901 (+ 405us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:04.478245 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:04.480239 (+ 1994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:04.481494 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:04.482516 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:04.482704 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:04.486578 (+ 3874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:04.486586 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:04.486601 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:06:04.486648 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:04.489661 (+ 3013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:04.490327 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:04.490333 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:04.490340 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:04.490540 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:04.490912 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:04.490916 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:04.490918 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:04.491469 (+ 551us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:04.491767 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:04.492300 (+ 533us) server_negotiation.cc:299] Negotiation successful
0812 01:06:04.492692 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":603,"thread_start_us":362,"threads_started":1}
I20260812 01:06:04.498041 18946 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b3e289dce44422e9d96a2ca0694da0f" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 37967 } }
I20260812 01:06:04.498370 18946 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:06:04.498462 18946 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b3e289dce44422e9d96a2ca0694da0f, State: Initialized, Role: FOLLOWER
I20260812 01:06:04.498972 18946 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b3e289dce44422e9d96a2ca0694da0f" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 37967 } }
I20260812 01:06:04.499209 18946 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:06:04.499331 18946 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:06:04.499488 18946 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:06:04.501660 18946 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b3e289dce44422e9d96a2ca0694da0f" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 37967 } }
I20260812 01:06:04.502233 18946 leader_election.cc:302] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2b3e289dce44422e9d96a2ca0694da0f; no voters:
I20260812 01:06:04.502830 18946 leader_election.cc:288] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:06:04.502942 18952 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:06:04.503574 18952 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [term 1 LEADER]: Becoming Leader. State: Replica: 2b3e289dce44422e9d96a2ca0694da0f, State: Running, Role: LEADER
I20260812 01:06:04.504182 18952 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b3e289dce44422e9d96a2ca0694da0f" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 37967 } }
I20260812 01:06:04.505023 18946 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:06:04.507162 18955 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2b3e289dce44422e9d96a2ca0694da0f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b3e289dce44422e9d96a2ca0694da0f" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 37967 } } }
I20260812 01:06:04.507805 18955 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [sys.catalog]: This master's current role is: LEADER
I20260812 01:06:04.507088 18956 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2b3e289dce44422e9d96a2ca0694da0f. Latest consensus state: current_term: 1 leader_uuid: "2b3e289dce44422e9d96a2ca0694da0f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b3e289dce44422e9d96a2ca0694da0f" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 37967 } } }
I20260812 01:06:04.513149 18956 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [sys.catalog]: This master's current role is: LEADER
I20260812 01:06:04.517944 18960 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:06:04.522205 18960 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:06:04.530697 18960 catalog_manager.cc:1347] Generated new cluster ID: 831717abd5344a289c64662ebc3c7f69
I20260812 01:06:04.530797 18960 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:06:04.546748 18960 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:06:04.548146 18960 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:06:04.554967 18960 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f: Generated new TSK 0
I20260812 01:06:04.555687 18960 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.201.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
I20260812 01:06:04.617113 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:0
--local_ip_for_outbound_sockets=127.4.201.65
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:37967
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:40463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:06:04.949683 18992 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:06:04.949957 18992 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:06:04.950089 18992 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:06:04.957264 18992 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:06:04.957372 18992 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:06:04.957531 18992 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:06:04.967126 18992 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:40463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:37967
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:06:04.968353 18992 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:06:04.969683 18992 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:06:04.982237 18998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:04.982175 19001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:04.982270 18999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:06:04.983090 18992 server_base.cc:1034] running on GCE node
I20260812 01:06:04.983677 18992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:06:04.984560 18992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:06:04.985759 18992 hybrid_clock.cc:648] HybridClock initialized: now 1786496764985710 us; error 35 us; skew 500 ppm
I20260812 01:06:04.986055 18992 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:06:04 dist-test-slave-bndk krb5kdc[18813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496764, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:06:04.989110 18992 init.cc:377] Logged in from keytab as kudu/127.4.201.65@KRBTEST.COM (short username kudu)
I20260812 01:06:04.990460 18992 webserver.cc:460] Webserver started at http://127.4.201.65:42463/ using document root <none> and password file <none>
I20260812 01:06:04.991149 18992 fs_manager.cc:359] Metadata directory not provided
I20260812 01:06:04.991252 18992 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:06:04.991531 18992 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:06:04.994403 18992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-0/data/instance:
uuid: "2d205d886ba64dd08482b8aff2d236ce"
format_stamp: "Formatted at 2026-08-12 01:06:04 on dist-test-slave-bndk"
server_key: "e91884de316f40d522f8df06b27bde05"
server_key_iv: "a95ffb06d9b23faa8ad3b4a4882791a1"
server_key_version: "encryptionkey@0"
I20260812 01:06:04.995182 18992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance:
uuid: "2d205d886ba64dd08482b8aff2d236ce"
format_stamp: "Formatted at 2026-08-12 01:06:04 on dist-test-slave-bndk"
server_key: "e91884de316f40d522f8df06b27bde05"
server_key_iv: "a95ffb06d9b23faa8ad3b4a4882791a1"
server_key_version: "encryptionkey@0"
I20260812 01:06:05.000766 18992 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260812 01:06:05.004273 19010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:05.005604 18992 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:06:05.005760 18992 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "2d205d886ba64dd08482b8aff2d236ce"
format_stamp: "Formatted at 2026-08-12 01:06:04 on dist-test-slave-bndk"
server_key: "e91884de316f40d522f8df06b27bde05"
server_key_iv: "a95ffb06d9b23faa8ad3b4a4882791a1"
server_key_version: "encryptionkey@0"
I20260812 01:06:05.005964 18992 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:06:05.018678 18992 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:06:05.022408 18992 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:06:05.022663 18992 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:06:05.023542 18992 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:06:05.024808 18992 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:06:05.024881 18992 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:05.025007 18992 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:06:05.025058 18992 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:05.053133 18992 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:45753
I20260812 01:06:05.053176 19178 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:45753 every 8 connection(s)
I20260812 01:06:05.054359 18992 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:06:05.061966 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 18992
I20260812 01:06:05.062151 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance
I20260812 01:06:05.062781 4901 external_mini_cluster.cc:1428] Setting key c332aef41b456aff08d2f52c9851f42f
Aug 12 01:06:05 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496764, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:06:05.073673 19182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:05.056830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:44563 (local address 127.4.201.126:37967)
0812 01:06:05.057269 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:05.057276 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:05.058164 (+ 888us) server_negotiation.cc:407] Connection header received
0812 01:06:05.060013 (+ 1849us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:05.060019 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:05.060101 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:05.060199 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:05.061718 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:05.062501 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:05.064166 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:05.064657 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:05.064769 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:05.068105 (+ 3336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:05.068111 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:05.068114 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:06:05.068147 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:05.070616 (+ 2469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:05.071334 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:05.071338 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:05.071340 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:05.071474 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:05.071901 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:05.071905 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:05.071907 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:05.072173 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:05.072307 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:05.073038 (+ 731us) server_negotiation.cc:299] Negotiation successful
0812 01:06:05.073301 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":200,"threads_started":1}
I20260812 01:06:05.074584 19183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:05.057295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.65:44563)
0812 01:06:05.058002 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:05.058041 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:05.059747 (+ 1706us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:05.060435 (+ 688us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:05.060443 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:05.060938 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:05.061552 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:05.061570 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:05.062655 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:05.062659 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:05.064026 (+ 1367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:05.064040 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:05.064880 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:05.064888 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:05.065120 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:05.065773 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:05.065796 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:05.067894 (+ 2098us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:06:05.070750 (+ 2856us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:06:05.070760 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:06:05.070776 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:06:05.071199 (+ 423us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:06:05.071589 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:06:05.071594 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:06:05.071598 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:06:05.071782 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:06:05.072301 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:06:05.072309 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:06:05.072646 (+ 337us) client_negotiation.cc:769] Sending connection context
0812 01:06:05.072903 (+ 257us) client_negotiation.cc:240] Negotiation successful
0812 01:06:05.073454 (+ 551us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":261,"threads_started":1}
I20260812 01:06:05.076237 19180 heartbeater.cc:347] Connected to a master server at 127.4.201.126:37967
I20260812 01:06:05.076537 19180 heartbeater.cc:464] Registering TS with master...
I20260812 01:06:05.077260 19180 heartbeater.cc:511] Master 127.4.201.126:37967 requested a full tablet report, sending...
I20260812 01:06:05.079321 18882 ts_manager.cc:194] Registered new tserver with Master: 2d205d886ba64dd08482b8aff2d236ce (127.4.201.65:45753)
I20260812 01:06:05.080767 18882 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.65@KRBTEST.COM'} at 127.4.201.65:44563
WARNING: no policy specified for kudu/127.4.201.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
I20260812 01:06:05.116338 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:0
--local_ip_for_outbound_sockets=127.4.201.66
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:37967
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:40463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:06:05.444661 19188 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:06:05.444919 19188 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:06:05.445019 19188 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:06:05.451928 19188 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:06:05.452023 19188 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:06:05.452137 19188 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:06:05.461370 19188 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:40463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:37967
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:06:05.462498 19188 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:06:05.463703 19188 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:06:05.476367 19197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:05.476820 19196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:05.476948 19201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:06:05.477500 19188 server_base.cc:1034] running on GCE node
I20260812 01:06:05.478076 19188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:06:05.478992 19188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:06:05.480212 19188 hybrid_clock.cc:648] HybridClock initialized: now 1786496765480157 us; error 43 us; skew 500 ppm
I20260812 01:06:05.480513 19188 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:06:05 dist-test-slave-bndk krb5kdc[18813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496765, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:06:05.483632 19188 init.cc:377] Logged in from keytab as kudu/127.4.201.66@KRBTEST.COM (short username kudu)
I20260812 01:06:05.484967 19188 webserver.cc:460] Webserver started at http://127.4.201.66:43879/ using document root <none> and password file <none>
I20260812 01:06:05.485661 19188 fs_manager.cc:359] Metadata directory not provided
I20260812 01:06:05.485778 19188 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:06:05.486074 19188 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:06:05.488847 19188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-1/data/instance:
uuid: "d01d7870fae848feaabf84f03002e519"
format_stamp: "Formatted at 2026-08-12 01:06:05 on dist-test-slave-bndk"
server_key: "214c3a2ffbea74eb81a2caac00af4ab4"
server_key_iv: "80ca4a1ab756bc7d274c552bcc8ffa73"
server_key_version: "encryptionkey@0"
I20260812 01:06:05.489646 19188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance:
uuid: "d01d7870fae848feaabf84f03002e519"
format_stamp: "Formatted at 2026-08-12 01:06:05 on dist-test-slave-bndk"
server_key: "214c3a2ffbea74eb81a2caac00af4ab4"
server_key_iv: "80ca4a1ab756bc7d274c552bcc8ffa73"
server_key_version: "encryptionkey@0"
I20260812 01:06:05.494544 19188 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260812 01:06:05.497933 19210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:05.499191 19188 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 01:06:05.499365 19188 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "d01d7870fae848feaabf84f03002e519"
format_stamp: "Formatted at 2026-08-12 01:06:05 on dist-test-slave-bndk"
server_key: "214c3a2ffbea74eb81a2caac00af4ab4"
server_key_iv: "80ca4a1ab756bc7d274c552bcc8ffa73"
server_key_version: "encryptionkey@0"
I20260812 01:06:05.499536 19188 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:06:05.543412 19188 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:06:05.547120 19188 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:06:05.547369 19188 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:06:05.548243 19188 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:06:05.549576 19188 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:06:05.549650 19188 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:05.549738 19188 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:06:05.549784 19188 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:05.579913 19188 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:43053
I20260812 01:06:05.579949 19404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:43053 every 8 connection(s)
I20260812 01:06:05.581286 19188 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:06:05.590875 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 19188
I20260812 01:06:05.591025 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance
I20260812 01:06:05.591483 4901 external_mini_cluster.cc:1428] Setting key 0b661005d1c05ec1ab88e0862a85609e
Aug 12 01:06:05 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496765, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:06:05.600731 19411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:05.583768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:49109 (local address 127.4.201.126:37967)
0812 01:06:05.584208 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:05.584212 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:05.585056 (+ 844us) server_negotiation.cc:407] Connection header received
0812 01:06:05.586878 (+ 1822us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:05.586883 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:05.586962 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:05.587068 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:05.588522 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:05.589273 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:05.590756 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:05.591260 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:05.591384 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:05.595328 (+ 3944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:05.595333 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:05.595336 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:06:05.595368 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:05.597846 (+ 2478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:05.598511 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:05.598517 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:05.598520 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:05.598657 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:05.599072 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:05.599076 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:05.599078 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:05.599340 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:05.599474 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:05.600135 (+ 661us) server_negotiation.cc:299] Negotiation successful
0812 01:06:05.600359 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":223,"threads_started":1}
I20260812 01:06:05.601675 19415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:05.584255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.66:49109)
0812 01:06:05.584908 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:05.584946 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:05.586611 (+ 1665us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:05.587309 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:05.587316 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:05.587815 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:05.588346 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:05.588363 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:05.589417 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:05.589421 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:05.590615 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:05.590628 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:05.591515 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:05.591524 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:05.591759 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:05.592592 (+ 833us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:05.592618 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:05.595119 (+ 2501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:06:05.597985 (+ 2866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:06:05.597994 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:06:05.598010 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:06:05.598395 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:06:05.598764 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:06:05.598769 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:06:05.598773 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:06:05.598963 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:06:05.599465 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:06:05.599473 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:06:05.599788 (+ 315us) client_negotiation.cc:769] Sending connection context
0812 01:06:05.600014 (+ 226us) client_negotiation.cc:240] Negotiation successful
0812 01:06:05.600510 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":249,"threads_started":1}
I20260812 01:06:05.602988 19406 heartbeater.cc:347] Connected to a master server at 127.4.201.126:37967
I20260812 01:06:05.603259 19406 heartbeater.cc:464] Registering TS with master...
I20260812 01:06:05.604034 19406 heartbeater.cc:511] Master 127.4.201.126:37967 requested a full tablet report, sending...
I20260812 01:06:05.605542 18882 ts_manager.cc:194] Registered new tserver with Master: d01d7870fae848feaabf84f03002e519 (127.4.201.66:43053)
I20260812 01:06:05.606364 18882 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.66@KRBTEST.COM'} at 127.4.201.66:49109
WARNING: no policy specified for kudu/127.4.201.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
I20260812 01:06:05.645407 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:0
--local_ip_for_outbound_sockets=127.4.201.67
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:37967
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:40463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:06:05.969612 19419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:06:05.969878 19419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:06:05.970011 19419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:06:05.977138 19419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:06:05.977278 19419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:06:05.977416 19419 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:06:05.986876 19419 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:40463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:37967
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:06:05.988075 19419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:06:05.989382 19419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:06:06.001796 19430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:06.001860 19426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:06.001828 19427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:06:06.002871 19419 server_base.cc:1034] running on GCE node
I20260812 01:06:06.003530 19419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:06:06.004443 19419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:06:06.005635 19419 hybrid_clock.cc:648] HybridClock initialized: now 1786496766005585 us; error 41 us; skew 500 ppm
I20260812 01:06:06.005936 19419 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:06:06 dist-test-slave-bndk krb5kdc[18813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496766, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:06:06.008951 19419 init.cc:377] Logged in from keytab as kudu/127.4.201.67@KRBTEST.COM (short username kudu)
I20260812 01:06:06.010501 19419 webserver.cc:460] Webserver started at http://127.4.201.67:43625/ using document root <none> and password file <none>
I20260812 01:06:06.011137 19419 fs_manager.cc:359] Metadata directory not provided
I20260812 01:06:06.011240 19419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:06:06.011529 19419 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:06:06.014374 19419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-2/data/instance:
uuid: "8f3f925bfb414b269c1c6c9710fa5124"
format_stamp: "Formatted at 2026-08-12 01:06:06 on dist-test-slave-bndk"
server_key: "07c5f652659647ad1f5901ac644ddd6a"
server_key_iv: "4a77feb86b54f4eb5682374c7a78c5ef"
server_key_version: "encryptionkey@0"
I20260812 01:06:06.015108 19419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance:
uuid: "8f3f925bfb414b269c1c6c9710fa5124"
format_stamp: "Formatted at 2026-08-12 01:06:06 on dist-test-slave-bndk"
server_key: "07c5f652659647ad1f5901ac644ddd6a"
server_key_iv: "4a77feb86b54f4eb5682374c7a78c5ef"
server_key_version: "encryptionkey@0"
I20260812 01:06:06.019994 19419 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260812 01:06:06.023218 19441 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:06.024444 19419 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 01:06:06.024585 19419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "8f3f925bfb414b269c1c6c9710fa5124"
format_stamp: "Formatted at 2026-08-12 01:06:06 on dist-test-slave-bndk"
server_key: "07c5f652659647ad1f5901ac644ddd6a"
server_key_iv: "4a77feb86b54f4eb5682374c7a78c5ef"
server_key_version: "encryptionkey@0"
I20260812 01:06:06.024763 19419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:06:06.036581 19419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:06:06.040095 19419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:06:06.040347 19419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:06:06.041280 19419 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:06:06.042532 19419 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:06:06.042609 19419 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:06.042724 19419 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:06:06.042779 19419 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:06.072728 19419 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:42501
I20260812 01:06:06.072773 19619 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:42501 every 8 connection(s)
I20260812 01:06:06.073997 19419 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:06:06.076222 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 19419
I20260812 01:06:06.076377 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance
I20260812 01:06:06.076896 4901 external_mini_cluster.cc:1428] Setting key 2defdc784fbc6d8735732b864e67f740
I20260812 01:06:06.083621 19180 heartbeater.cc:503] Master 127.4.201.126:37967 was elected leader, sending a full tablet report...
Aug 12 01:06:06 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496766, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:06:06.092757 19411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:06.076521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:40325 (local address 127.4.201.126:37967)
0812 01:06:06.076735 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:06.076742 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:06.077856 (+ 1114us) server_negotiation.cc:407] Connection header received
0812 01:06:06.079641 (+ 1785us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:06.079647 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:06.079745 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:06.079830 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:06.081272 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:06.082011 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:06.083457 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:06.084023 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:06.084142 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:06.087474 (+ 3332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:06.087490 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:06.087493 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:06:06.087525 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:06.089867 (+ 2342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:06.090591 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:06.090595 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:06.090597 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:06.090739 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:06.091158 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:06.091162 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:06.091165 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:06.091523 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:06.091690 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:06.092340 (+ 650us) server_negotiation.cc:299] Negotiation successful
0812 01:06:06.092522 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 01:06:06.093649 19622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:06.076900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.67:40325)
0812 01:06:06.077708 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:06.077762 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:06.079410 (+ 1648us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:06.080054 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:06.080061 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:06.080560 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:06.081096 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:06.081114 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:06.082130 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:06.082134 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:06.083318 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:06.083330 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:06.084229 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:06.084235 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:06.084508 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:06.085201 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:06.085261 (+ 60us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:06.087278 (+ 2017us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:06:06.090014 (+ 2736us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:06:06.090023 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:06:06.090037 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:06:06.090485 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:06:06.090846 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:06:06.090851 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:06:06.090855 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:06:06.091041 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:06:06.091658 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:06:06.091666 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:06:06.092040 (+ 374us) client_negotiation.cc:769] Sending connection context
0812 01:06:06.092253 (+ 213us) client_negotiation.cc:240] Negotiation successful
0812 01:06:06.092610 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":304,"threads_started":1}
I20260812 01:06:06.094903 19620 heartbeater.cc:347] Connected to a master server at 127.4.201.126:37967
I20260812 01:06:06.095187 19620 heartbeater.cc:464] Registering TS with master...
I20260812 01:06:06.095875 19620 heartbeater.cc:511] Master 127.4.201.126:37967 requested a full tablet report, sending...
I20260812 01:06:06.097188 18882 ts_manager.cc:194] Registered new tserver with Master: 8f3f925bfb414b269c1c6c9710fa5124 (127.4.201.67:42501)
I20260812 01:06:06.097996 18882 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.67@KRBTEST.COM'} at 127.4.201.67:40325
I20260812 01:06:06.103925 4901 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.4.201.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.201.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.201.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.65.keytab.
Entry for principal oryx/127.4.201.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.65.keytab.
WARNING: no policy specified for oryx/127.4.201.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.201.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.201.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.66.keytab.
Entry for principal oryx/127.4.201.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.66.keytab.
WARNING: no policy specified for oryx/127.4.201.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.201.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.201.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.67.keytab.
Entry for principal oryx/127.4.201.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.67.keytab.
I20260812 01:06:06.251614 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 18992
Aug 12 01:06:06 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496763, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.65@KRBTEST.COM
I20260812 01:06:06.267489 19640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:06.252775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47810 (local address 127.4.201.65:45753)
0812 01:06:06.253507 (+ 732us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:06.253514 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:06.253544 (+ 30us) server_negotiation.cc:407] Connection header received
0812 01:06:06.253608 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:06.253615 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:06.253831 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:06.253965 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:06.255305 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:06.256291 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:06.257488 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:06.258054 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:06.258144 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:06.261947 (+ 3803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:06.261959 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:06.261975 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:06:06.262018 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:06.264711 (+ 2693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:06.265367 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:06.265376 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:06.265378 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:06.265511 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:06.265869 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:06.265872 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:06.265874 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:06.266249 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:06.266537 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:06.266891 (+ 354us) server_negotiation.cc:299] Negotiation successful
0812 01:06:06.267164 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":577,"thread_start_us":367,"threads_started":1}
I20260812 01:06:06.268728 19172 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:06:06.353524 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 18992
I20260812 01:06:06.379964 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 19188
Aug 12 01:06:06 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496763, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.66@KRBTEST.COM
I20260812 01:06:06.395403 19642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:06.380878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43468 (local address 127.4.201.66:43053)
0812 01:06:06.381427 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:06.381434 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:06.381462 (+ 28us) server_negotiation.cc:407] Connection header received
0812 01:06:06.381526 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:06.381532 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:06.381741 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:06.381877 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:06.383014 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:06.384005 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:06.385202 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:06.385830 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:06.385931 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:06.389907 (+ 3976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:06.389920 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:06.389935 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:06:06.389989 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:06.392853 (+ 2864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:06.393639 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:06.393647 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:06.393649 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:06.393772 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:06.394053 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:06.394055 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:06.394057 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:06.394411 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:06.394657 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:06.394847 (+ 190us) server_negotiation.cc:299] Negotiation successful
0812 01:06:06.395050 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":249,"threads_started":1}
I20260812 01:06:06.396651 19397 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:06:06.483146 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 19188
I20260812 01:06:06.507848 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 19419
Aug 12 01:06:06 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496763, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.67@KRBTEST.COM
I20260812 01:06:06.523633 19648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:06.508815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47006 (local address 127.4.201.67:42501)
0812 01:06:06.509531 (+ 716us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:06.509539 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:06.509570 (+ 31us) server_negotiation.cc:407] Connection header received
0812 01:06:06.509635 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:06.509641 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:06.509848 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:06.510002 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:06.511237 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:06.512283 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:06.513482 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:06.514039 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:06.514134 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:06.518173 (+ 4039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:06.518185 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:06.518200 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:06:06.518232 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:06.520841 (+ 2609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:06.521557 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:06.521565 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:06.521568 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:06.521708 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:06.522082 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:06.522086 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:06.522088 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:06.522462 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:06.522804 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:06.523078 (+ 274us) server_negotiation.cc:299] Negotiation successful
0812 01:06:06.523336 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":393,"threads_started":1}
I20260812 01:06:06.524894 19612 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:06:06.605824 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 19419
I20260812 01:06:06.628345 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 18829
I20260812 01:06:06.629568 18939 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:06:06.731856 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 18829
I20260812 01:06:06.758878 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:37967
--webserver_interface=127.4.201.126
--webserver_port=40681
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:40463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:37967
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:06:07.086458 19652 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:06:07.086723 19652 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:06:07.086851 19652 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:06:07.094198 19652 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:06:07.094306 19652 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:06:07.094394 19652 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:06:07.094468 19652 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:06:07.094527 19652 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:06:07.104115 19652 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:40463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:37967
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:37967
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=40681
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:06:07.105348 19652 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:06:07.106606 19652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:06:07.117697 19657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:07.117722 19660 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:07.117755 19658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:06:07.119138 19652 server_base.cc:1034] running on GCE node
I20260812 01:06:07.119867 19652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:06:07.121241 19652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:06:07.122460 19652 hybrid_clock.cc:648] HybridClock initialized: now 1786496767122413 us; error 33 us; skew 500 ppm
I20260812 01:06:07.122792 19652 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:06:07 dist-test-slave-bndk krb5kdc[18813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496767, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:06:07.125723 19652 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:06:07.127067 19652 webserver.cc:460] Webserver started at http://127.4.201.126:40681/ using document root <none> and password file <none>
I20260812 01:06:07.127681 19652 fs_manager.cc:359] Metadata directory not provided
I20260812 01:06:07.127791 19652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:06:07.132872 19652 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260812 01:06:07.135546 19671 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:07.136746 19652 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 01:06:07.136904 19652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "2b3e289dce44422e9d96a2ca0694da0f"
format_stamp: "Formatted at 2026-08-12 01:06:04 on dist-test-slave-bndk"
server_key: "73ceb6128af9d54b406867e635566821"
server_key_iv: "5f7febe08e806f96493124fc4c3da2d8"
server_key_version: "encryptionkey@0"
I20260812 01:06:07.137861 19652 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:06:07.151721 19652 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:06:07.155308 19652 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:06:07.155550 19652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:06:07.172873 19652 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:37967
I20260812 01:06:07.172879 19751 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:37967 every 8 connection(s)
I20260812 01:06:07.174407 19652 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:06:07.181331 19752 sys_catalog.cc:263] Verifying existing consensus state
I20260812 01:06:07.181406 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 19652
I20260812 01:06:07.182351 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:45753
--local_ip_for_outbound_sockets=127.4.201.65
--tserver_master_addrs=127.4.201.126:37967
--webserver_port=42463
--webserver_interface=127.4.201.65
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:40463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.4.201.65
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:06:07.185767 19752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f: Bootstrap starting.
I20260812 01:06:07.206401 19752 log.cc:824] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f: Log is configured to *not* fsync() on all Append() calls
I20260812 01:06:07.215265 19752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 01:06:07.215756 19752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f: Bootstrap complete.
I20260812 01:06:07.224596 19752 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b3e289dce44422e9d96a2ca0694da0f" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 37967 } }
I20260812 01:06:07.225495 19752 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b3e289dce44422e9d96a2ca0694da0f, State: Initialized, Role: FOLLOWER
I20260812 01:06:07.226115 19752 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b3e289dce44422e9d96a2ca0694da0f" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 37967 } }
I20260812 01:06:07.226346 19752 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:06:07.226454 19752 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:06:07.226614 19752 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [term 1 FOLLOWER]: Advancing to term 2
I20260812 01:06:07.230324 19752 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b3e289dce44422e9d96a2ca0694da0f" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 37967 } }
I20260812 01:06:07.230777 19752 leader_election.cc:302] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2b3e289dce44422e9d96a2ca0694da0f; no voters:
I20260812 01:06:07.231391 19752 leader_election.cc:288] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 01:06:07.231526 19756 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [term 2 FOLLOWER]: Leader election won for term 2
I20260812 01:06:07.232664 19756 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [term 2 LEADER]: Becoming Leader. State: Replica: 2b3e289dce44422e9d96a2ca0694da0f, State: Running, Role: LEADER
I20260812 01:06:07.233361 19756 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b3e289dce44422e9d96a2ca0694da0f" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 37967 } }
I20260812 01:06:07.233560 19752 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:06:07.235880 19759 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2b3e289dce44422e9d96a2ca0694da0f. Latest consensus state: current_term: 2 leader_uuid: "2b3e289dce44422e9d96a2ca0694da0f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b3e289dce44422e9d96a2ca0694da0f" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 37967 } } }
I20260812 01:06:07.236297 19759 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [sys.catalog]: This master's current role is: LEADER
I20260812 01:06:07.236893 19758 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "2b3e289dce44422e9d96a2ca0694da0f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b3e289dce44422e9d96a2ca0694da0f" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 37967 } } }
I20260812 01:06:07.237244 19758 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f [sys.catalog]: This master's current role is: LEADER
I20260812 01:06:07.245868 19769 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:06:07.252388 19769 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:06:07.253803 19769 catalog_manager.cc:1259] Loaded cluster ID: 831717abd5344a289c64662ebc3c7f69
I20260812 01:06:07.253960 19769 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:06:07.257889 19769 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:06:07.259413 19769 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2b3e289dce44422e9d96a2ca0694da0f: Loaded TSK: 0
I20260812 01:06:07.261018 19769 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 01:06:07.524665 19754 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:06:07.524982 19754 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:06:07.525123 19754 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:06:07.532449 19754 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:06:07.532567 19754 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:06:07.532719 19754 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:06:07.542402 19754 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:40463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.65.keytab
--principal=oryx/127.4.201.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:45753
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=42463
--tserver_master_addrs=127.4.201.126:37967
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:06:07.543643 19754 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:06:07.544911 19754 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:06:07.557420 19791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:07.557384 19797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:07.557967 19802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:06:07.558727 19754 server_base.cc:1034] running on GCE node
I20260812 01:06:07.559283 19754 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:06:07.560171 19754 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:06:07.561371 19754 hybrid_clock.cc:648] HybridClock initialized: now 1786496767561319 us; error 48 us; skew 500 ppm
I20260812 01:06:07.561659 19754 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:06:07 dist-test-slave-bndk krb5kdc[18813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496767, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:06:07.564831 19754 init.cc:377] Logged in from keytab as oryx/127.4.201.65@KRBTEST.COM (short username oryx)
I20260812 01:06:07.566262 19754 webserver.cc:460] Webserver started at http://127.4.201.65:42463/ using document root <none> and password file <none>
I20260812 01:06:07.566910 19754 fs_manager.cc:359] Metadata directory not provided
I20260812 01:06:07.567034 19754 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:06:07.572278 19754 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.005s
I20260812 01:06:07.574954 19815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:07.576279 19754 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 01:06:07.576434 19754 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "2d205d886ba64dd08482b8aff2d236ce"
format_stamp: "Formatted at 2026-08-12 01:06:04 on dist-test-slave-bndk"
server_key: "e91884de316f40d522f8df06b27bde05"
server_key_iv: "a95ffb06d9b23faa8ad3b4a4882791a1"
server_key_version: "encryptionkey@0"
I20260812 01:06:07.577473 19754 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:06:07.598788 19754 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:06:07.602582 19754 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:06:07.602829 19754 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:06:07.603765 19754 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:06:07.605077 19754 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:06:07.605171 19754 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:07.605299 19754 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:06:07.605374 19754 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:07.635174 19754 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:45753
I20260812 01:06:07.635236 19994 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:45753 every 8 connection(s)
I20260812 01:06:07.636536 19754 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:06:07.639837 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 19754
I20260812 01:06:07.640676 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:43053
--local_ip_for_outbound_sockets=127.4.201.66
--tserver_master_addrs=127.4.201.126:37967
--webserver_port=43879
--webserver_interface=127.4.201.66
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:40463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.4.201.66
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 01:06:07 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:07 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 01:06:07.989576 20002 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:06:07.989840 20002 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:06:07.989959 20002 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:06:07.996999 20002 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:06:07.997105 20002 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:06:07.997296 20002 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:06:08.006791 20002 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:40463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.66.keytab
--principal=oryx/127.4.201.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:43053
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=43879
--tserver_master_addrs=127.4.201.126:37967
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:06:08.008101 20002 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:06:08.009451 20002 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:06:08.025010 20013 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:08.025106 20011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:08.025692 20009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:06:08.026273 20002 server_base.cc:1034] running on GCE node
I20260812 01:06:08.026854 20002 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:06:08.027789 20002 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:06:08.029009 20002 hybrid_clock.cc:648] HybridClock initialized: now 1786496768028961 us; error 38 us; skew 500 ppm
I20260812 01:06:08.029350 20002 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:06:08 dist-test-slave-bndk krb5kdc[18813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496768, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:06:08.032398 20002 init.cc:377] Logged in from keytab as oryx/127.4.201.66@KRBTEST.COM (short username oryx)
I20260812 01:06:08.033917 20002 webserver.cc:460] Webserver started at http://127.4.201.66:43879/ using document root <none> and password file <none>
I20260812 01:06:08.034616 20002 fs_manager.cc:359] Metadata directory not provided
I20260812 01:06:08.034744 20002 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:06:08.039979 20002 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 01:06:08.042650 20023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:08.043941 20002 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 01:06:08.044085 20002 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "d01d7870fae848feaabf84f03002e519"
format_stamp: "Formatted at 2026-08-12 01:06:05 on dist-test-slave-bndk"
server_key: "214c3a2ffbea74eb81a2caac00af4ab4"
server_key_iv: "80ca4a1ab756bc7d274c552bcc8ffa73"
server_key_version: "encryptionkey@0"
I20260812 01:06:08.044975 20002 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:06:08.057977 20002 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:06:08.061686 20002 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:06:08.061918 20002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:06:08.062863 20002 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:06:08.064234 20002 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:06:08.064318 20002 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:08.064422 20002 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:06:08.064495 20002 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:08.102293 20002 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:43053
I20260812 01:06:08.102334 20194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:43053 every 8 connection(s)
I20260812 01:06:08.103757 20002 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:06:08.108155 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 20002
I20260812 01:06:08.108930 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:42501
--local_ip_for_outbound_sockets=127.4.201.67
--tserver_master_addrs=127.4.201.126:37967
--webserver_port=43625
--webserver_interface=127.4.201.67
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:40463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.4.201.67
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 01:06:08 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:08 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 01:06:08.459252 20202 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:06:08.459527 20202 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:06:08.459681 20202 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:06:08.466861 20202 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:06:08.466974 20202 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:06:08.467150 20202 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:06:08.476580 20202 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:40463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/krb5kdc/oryx_127.4.201.67.keytab
--principal=oryx/127.4.201.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:42501
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=43625
--tserver_master_addrs=127.4.201.126:37967
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:06:08.477905 20202 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:06:08.479231 20202 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:06:08.493788 20211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:08.493971 20212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:08.513759 20214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:06:08.514549 20202 server_base.cc:1034] running on GCE node
I20260812 01:06:08.515286 20202 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:06:08.516381 20202 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:06:08.517659 20202 hybrid_clock.cc:648] HybridClock initialized: now 1786496768517595 us; error 57 us; skew 500 ppm
I20260812 01:06:08.517992 20202 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:06:08 dist-test-slave-bndk krb5kdc[18813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496768, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.201.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:06:08.521049 20202 init.cc:377] Logged in from keytab as oryx/127.4.201.67@KRBTEST.COM (short username oryx)
I20260812 01:06:08.522778 20202 webserver.cc:460] Webserver started at http://127.4.201.67:43625/ using document root <none> and password file <none>
I20260812 01:06:08.523475 20202 fs_manager.cc:359] Metadata directory not provided
I20260812 01:06:08.523612 20202 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:06:08.528904 20202 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260812 01:06:08.531528 20227 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:08.532831 20202 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 01:06:08.532984 20202 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "8f3f925bfb414b269c1c6c9710fa5124"
format_stamp: "Formatted at 2026-08-12 01:06:06 on dist-test-slave-bndk"
server_key: "07c5f652659647ad1f5901ac644ddd6a"
server_key_iv: "4a77feb86b54f4eb5682374c7a78c5ef"
server_key_version: "encryptionkey@0"
I20260812 01:06:08.534199 20202 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:06:08.548107 20202 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:06:08.552134 20202 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:06:08.552392 20202 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:06:08.553445 20202 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:06:08.554771 20202 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:06:08.554869 20202 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:08.554973 20202 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:06:08.555044 20202 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:08.602172 20202 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:42501
I20260812 01:06:08.602221 20410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:42501 every 8 connection(s)
I20260812 01:06:08.603693 20202 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:06:08.604231 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 20202
I20260812 01:06:08.651604 20412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:08.605381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55580 (local address 127.4.201.126:37967)
0812 01:06:08.620724 (+ 15343us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:08.620732 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:08.621673 (+ 941us) server_negotiation.cc:407] Connection header received
0812 01:06:08.621751 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:08.621756 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:08.621836 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:08.621943 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:08.632517 (+ 10574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:08.633840 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:08.636961 (+ 3121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:08.637582 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:08.637707 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:08.642104 (+ 4397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:08.642117 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:08.642140 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:06:08.642200 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:08.646657 (+ 4457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:08.647482 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:08.647493 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:08.647503 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:08.647799 (+ 296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:08.648228 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:08.648233 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:08.648236 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:08.648922 (+ 686us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:08.649332 (+ 410us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:08.649882 (+ 550us) server_negotiation.cc:299] Negotiation successful
0812 01:06:08.650346 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15167,"thread_start_us":15366,"threads_started":1}
Aug 12 01:06:08 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:08 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 01:06:08.872118 20000 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.222s user 0.006s sys 0.007s
W20260812 01:06:08.873543 20001 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:07.639514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:58621 (local address 127.4.201.126:37967)
0812 01:06:07.641376 (+ 1862us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:07.641390 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:07.641442 (+ 52us) server_negotiation.cc:407] Connection header received
0812 01:06:07.642874 (+ 1432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:07.642889 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:07.643185 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:07.643512 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:07.645007 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:07.646326 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:07.647878 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:07.648508 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:07.648674 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:08.873179 (+1224505us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.65:58621: BlockingRecv error: recv got EOF from 127.4.201.65:58621 (error 108)
Metrics: {"server-negotiator.queue_time_us":1585,"thread_start_us":1361,"threads_started":1}
I20260812 01:06:08.874126 20000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:07.639521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.65:58621)
0812 01:06:07.640295 (+ 774us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:07.640349 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:07.642351 (+ 2002us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:07.643689 (+ 1338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:07.643699 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:07.644298 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:07.644806 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:07.644835 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:07.646484 (+ 1649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:07.646489 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:07.647744 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:07.647757 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:07.648738 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:07.648746 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:07.648994 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:07.649639 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:07.649667 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:08.872912 (+1223245us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":376,"threads_started":1}
W20260812 01:06:08.875068 19996 heartbeater.cc:644] Failed to heartbeat to 127.4.201.126:37967 (0 consecutive failures): Not authorized: Failed to ping master at 127.4.201.126:37967: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Aug 12 01:06:08 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:08 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:08.885667 20000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:08.875736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.65:39221)
0812 01:06:08.875919 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:08.875939 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:08.876057 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:08.876400 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:08.876405 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:08.876785 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:08.876948 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:08.876957 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:08.878026 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:08.878031 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:08.878961 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:08.878974 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:08.879725 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:08.879732 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:08.879897 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:08.880465 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:08.880493 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:08.885321 (+ 4828us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":55}
W20260812 01:06:08.885902 20001 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:08.875970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:39221 (local address 127.4.201.126:37967)
0812 01:06:08.876139 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:08.876144 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:08.876160 (+ 16us) server_negotiation.cc:407] Connection header received
0812 01:06:08.876209 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:08.876213 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:08.876269 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:08.876347 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:08.877091 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:08.877879 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:08.879106 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:08.879497 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:08.879736 (+ 239us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:08.885613 (+ 5877us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.65:39221: BlockingRecv error: recv got EOF from 127.4.201.65:39221 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 12 01:06:08 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:08 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:08.898921 20000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:08.886650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.65:55089)
0812 01:06:08.886826 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:08.886849 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:08.886964 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:08.887664 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:08.887671 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:08.888117 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:08.888351 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:08.888365 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:08.889895 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:08.889901 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:08.891560 (+ 1659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:08.891576 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:08.892595 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:08.892601 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:08.892804 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:08.893684 (+ 880us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:08.893711 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:08.898610 (+ 4899us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":60}
W20260812 01:06:08.899135 20001 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:08.887110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:55089 (local address 127.4.201.126:37967)
0812 01:06:08.887319 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:08.887326 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:08.887345 (+ 19us) server_negotiation.cc:407] Connection header received
0812 01:06:08.887397 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:08.887403 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:08.887490 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:08.887590 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:08.888531 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:08.889751 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:08.891716 (+ 1965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:08.892435 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:08.892563 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:08.898851 (+ 6288us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.65:55089: BlockingRecv error: recv got EOF from 127.4.201.65:55089 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260812 01:06:08.899526 19996 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 01:06:09.310835 20199 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.192s user 0.002s sys 0.015s
W20260812 01:06:09.312110 20198 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:08.106570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:50677 (local address 127.4.201.126:37967)
0812 01:06:08.107014 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:08.107019 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:08.108447 (+ 1428us) server_negotiation.cc:407] Connection header received
0812 01:06:08.111022 (+ 2575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:08.111030 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:08.111140 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:08.111301 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:08.113150 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:08.114448 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:08.116708 (+ 2260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:08.117470 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:08.117724 (+ 254us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:09.311808 (+1194084us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.66:50677: BlockingRecv error: recv got EOF from 127.4.201.66:50677 (error 108)
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":224,"threads_started":1}
I20260812 01:06:09.312721 20199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:08.107328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.66:50677)
0812 01:06:08.108276 (+ 948us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:08.108327 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:08.110671 (+ 2344us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:08.111549 (+ 878us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:08.111561 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:08.112235 (+ 674us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:08.112962 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:08.112998 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:08.114630 (+ 1632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:08.114635 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:08.116553 (+ 1918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:08.116570 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:08.117793 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:08.117801 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:08.118086 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:08.118905 (+ 819us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:08.118933 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:09.311612 (+1192679us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":625,"thread_start_us":362,"threads_started":1}
W20260812 01:06:09.313623 20195 heartbeater.cc:644] Failed to heartbeat to 127.4.201.126:37967 (0 consecutive failures): Not authorized: Failed to ping master at 127.4.201.126:37967: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Aug 12 01:06:09 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:09 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:09.323365 20199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:09.314339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.66:37771)
0812 01:06:09.314548 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:09.314569 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:09.314684 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:09.314997 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:09.315001 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:09.315361 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:09.315519 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:09.315529 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:09.316555 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:09.316559 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:09.317575 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:09.317589 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:09.318306 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:09.318312 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:09.318458 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:09.319011 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:09.319030 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:09.323155 (+ 4125us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":70}
W20260812 01:06:09.323710 20198 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:09.314430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:37771 (local address 127.4.201.126:37967)
0812 01:06:09.314587 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:09.314592 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:09.314613 (+ 21us) server_negotiation.cc:407] Connection header received
0812 01:06:09.314796 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:09.314801 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:09.314872 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:09.314955 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:09.315660 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:09.316413 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:09.317711 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:09.318134 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:09.318243 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:09.323442 (+ 5199us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.66:37771: BlockingRecv error: recv got EOF from 127.4.201.66:37771 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 12 01:06:09 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:09 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 01:06:09.334115 20198 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:09.324350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:44273 (local address 127.4.201.126:37967)
0812 01:06:09.324506 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:09.324510 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:09.324525 (+ 15us) server_negotiation.cc:407] Connection header received
0812 01:06:09.324565 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:09.324569 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:09.324630 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:09.324707 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:09.325617 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:09.326358 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:09.328246 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:09.328656 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:09.328746 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:09.333927 (+ 5181us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.66:44273: BlockingRecv error: recv got EOF from 127.4.201.66:44273 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 01:06:09.334458 20199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:09.324141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.66:44273)
0812 01:06:09.324342 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:09.324365 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:09.324475 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:09.324752 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:09.324757 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:09.325187 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:09.325461 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:09.325473 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:09.326497 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:09.326503 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:09.328100 (+ 1597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:09.328115 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:09.328793 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:09.328799 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:09.328990 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:09.329593 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:09.329617 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:09.334282 (+ 4665us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":62}
W20260812 01:06:09.334708 20195 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 01:06:09.715921 20417 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.063s user 0.006s sys 0.015s
W20260812 01:06:09.717310 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:08.625211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:40513 (local address 127.4.201.126:37967)
0812 01:06:08.632311 (+ 7100us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:08.632317 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:08.636829 (+ 4512us) server_negotiation.cc:407] Connection header received
0812 01:06:08.640140 (+ 3311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:08.640145 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:08.640223 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:08.640323 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:08.646308 (+ 5985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:08.647774 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:08.650513 (+ 2739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:08.651273 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:08.651408 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:09.717020 (+1065612us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.67:40513: BlockingRecv error: recv got EOF from 127.4.201.67:40513 (error 108)
Metrics: {"server-negotiator.queue_time_us":6931,"thread_start_us":7078,"threads_started":1}
I20260812 01:06:09.718065 20417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:08.624634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.67:40513)
0812 01:06:08.636343 (+ 11709us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:08.636402 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:08.639740 (+ 3338us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:08.640818 (+ 1078us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:08.640830 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:08.641636 (+ 806us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:08.646029 (+ 4393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:08.646061 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:08.648007 (+ 1946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:08.648013 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:08.650300 (+ 2287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:08.650320 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:08.651847 (+ 1527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:08.651855 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:08.652193 (+ 338us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:08.652985 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:08.653017 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:09.716845 (+1063828us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":11390,"thread_start_us":11148,"threads_started":1}
W20260812 01:06:09.718920 20411 heartbeater.cc:644] Failed to heartbeat to 127.4.201.126:37967 (0 consecutive failures): Not authorized: Failed to ping master at 127.4.201.126:37967: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Aug 12 01:06:09 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:09 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:09.732951 20417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:09.719550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.67:35381)
0812 01:06:09.719760 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:09.719781 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:09.719906 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:09.720220 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:09.720224 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:09.720609 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:09.720775 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:09.720784 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:09.721835 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:09.721841 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:09.722814 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:09.722827 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:09.723551 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:09.723557 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:09.723714 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:09.729282 (+ 5568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:09.729304 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:09.732663 (+ 3359us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":68}
W20260812 01:06:09.733137 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:09.719606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:35381 (local address 127.4.201.126:37967)
0812 01:06:09.719769 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:09.719775 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:09.719832 (+ 57us) server_negotiation.cc:407] Connection header received
0812 01:06:09.720028 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:09.720032 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:09.720093 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:09.720175 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:09.720914 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:09.721688 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:09.722951 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:09.723372 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:09.723480 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:09.732926 (+ 9446us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.67:35381: BlockingRecv error: recv got EOF from 127.4.201.67:35381 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 12 01:06:09 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:09 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:09.741854 20417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:09.733766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.67:48805)
0812 01:06:09.733957 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:09.733976 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:09.734089 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:09.734427 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:09.734432 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:09.734761 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:09.734924 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:09.734933 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:09.735924 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:09.735928 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:09.736854 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:09.736866 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:09.737643 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:09.737649 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:09.737810 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:09.738337 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:09.738354 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:09.741670 (+ 3316us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":50}
W20260812 01:06:09.742090 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:09.733851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:48805 (local address 127.4.201.126:37967)
0812 01:06:09.734130 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:09.734136 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:09.734165 (+ 29us) server_negotiation.cc:407] Connection header received
0812 01:06:09.734212 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:09.734217 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:09.734292 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:09.734372 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:09.735079 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:09.735793 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:09.736999 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:09.737496 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:09.737609 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:09.741845 (+ 4236us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.67:48805: BlockingRecv error: recv got EOF from 127.4.201.67:48805 (error 108)
Metrics: {"server-negotiator.queue_time_us":169}
W20260812 01:06:09.742136 20411 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 12 01:06:09 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:09 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:09.908905 20420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:09.900068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.65:43275)
0812 01:06:09.900568 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:09.900585 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:09.900716 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:09.901065 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:09.901069 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:09.901544 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:09.901693 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:09.901703 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:09.902690 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:09.902694 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:09.903667 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:09.903685 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:09.904544 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:09.904551 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:09.904718 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:09.905340 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:09.905358 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:09.908673 (+ 3315us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":276,"threads_started":1}
W20260812 01:06:09.909049 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:09.900112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:43275 (local address 127.4.201.126:37967)
0812 01:06:09.900293 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:09.900300 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:09.900665 (+ 365us) server_negotiation.cc:407] Connection header received
0812 01:06:09.900828 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:09.900833 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:09.900913 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:09.900997 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:09.901839 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:09.902538 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:09.903809 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:09.904353 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:09.904477 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:09.908841 (+ 4364us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.65:43275: BlockingRecv error: recv got EOF from 127.4.201.65:43275 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 12 01:06:10 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:10 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:10.344033 20421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:10.335324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.66:53463)
0812 01:06:10.335901 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:10.335918 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:10.336051 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:10.336376 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:10.336381 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:10.336847 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:10.337000 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:10.337010 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:10.338090 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:10.338096 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:10.339100 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:10.339113 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:10.339864 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:10.339870 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:10.340026 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:10.340541 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:10.340558 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:10.343714 (+ 3156us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":348,"threads_started":1}
W20260812 01:06:10.344185 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:10.335368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:53463 (local address 127.4.201.126:37967)
0812 01:06:10.335544 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:10.335550 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:10.336009 (+ 459us) server_negotiation.cc:407] Connection header received
0812 01:06:10.336169 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:10.336175 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:10.336245 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:10.336326 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:10.337146 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:10.337937 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:10.339257 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:10.339681 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:10.339803 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:10.343942 (+ 4139us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.66:53463: BlockingRecv error: recv got EOF from 127.4.201.66:53463 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 12 01:06:10 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:10 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:10.751096 20423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:10.742676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.67:43285)
0812 01:06:10.743173 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:10.743189 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:10.743305 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:10.743600 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:10.743602 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:10.744046 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:10.744201 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:10.744210 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:10.745107 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:10.745110 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:10.746106 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:10.746119 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:10.746804 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:10.746808 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:10.746923 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:10.747500 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:10.747518 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:10.750811 (+ 3293us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":269,"threads_started":1}
W20260812 01:06:10.751222 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:10.742723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:43285 (local address 127.4.201.126:37967)
0812 01:06:10.742921 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:10.742927 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:10.743259 (+ 332us) server_negotiation.cc:407] Connection header received
0812 01:06:10.743408 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:10.743412 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:10.743491 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:10.743567 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:10.744306 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:10.745009 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:10.746210 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:10.746666 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:10.746758 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:10.751030 (+ 4272us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.67:43285: BlockingRecv error: recv got EOF from 127.4.201.67:43285 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 12 01:06:10 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:10 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:10.918537 20426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:10.909727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.65:32795)
0812 01:06:10.910302 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:10.910319 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:10.910433 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:10.910703 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:10.910705 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:10.911147 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:10.911347 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:10.911357 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:10.912288 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:10.912291 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:10.913244 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:10.913259 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:10.913878 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:10.913882 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:10.914024 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:10.914577 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:10.914604 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:10.918213 (+ 3609us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":361,"threads_started":1}
W20260812 01:06:10.918695 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:10.909797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:32795 (local address 127.4.201.126:37967)
0812 01:06:10.909967 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:10.909971 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:10.910394 (+ 423us) server_negotiation.cc:407] Connection header received
0812 01:06:10.910529 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:10.910532 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:10.910596 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:10.910677 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:10.911454 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:10.912177 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:10.913364 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:10.913744 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:10.913832 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:10.918441 (+ 4609us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.65:32795: BlockingRecv error: recv got EOF from 127.4.201.65:32795 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 12 01:06:11 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:11 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:11.353475 20427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:11.344969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.66:47921)
0812 01:06:11.345508 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:11.345525 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:11.345641 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:11.345910 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:11.345913 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:11.346370 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:11.346599 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:11.346612 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:11.347639 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:11.347643 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:11.348635 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:11.348650 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:11.349360 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:11.349365 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:11.349503 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:11.350043 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:11.350061 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:11.353194 (+ 3133us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":304,"threads_started":1}
W20260812 01:06:11.353593 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:11.345047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:47921 (local address 127.4.201.126:37967)
0812 01:06:11.345248 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:11.345255 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:11.345588 (+ 333us) server_negotiation.cc:407] Connection header received
0812 01:06:11.345743 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:11.345746 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:11.345809 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:11.345882 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:11.346732 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:11.347514 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:11.348763 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:11.349167 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:11.349330 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:11.353398 (+ 4068us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.66:47921: BlockingRecv error: recv got EOF from 127.4.201.66:47921 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 12 01:06:11 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:11 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:11.760519 20429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:11.752092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.67:42847)
0812 01:06:11.752650 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:11.752667 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:11.752811 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:11.753173 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:11.753178 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:11.753645 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:11.753843 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:11.753853 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:11.754822 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:11.754825 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:11.755727 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:11.755737 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:11.756323 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:11.756328 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:11.756440 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:11.756952 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:11.756969 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:11.760265 (+ 3296us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":320,"threads_started":1}
W20260812 01:06:11.760649 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:11.752231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:42847 (local address 127.4.201.126:37967)
0812 01:06:11.752426 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:11.752434 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:11.752759 (+ 325us) server_negotiation.cc:407] Connection header received
0812 01:06:11.752934 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:11.752940 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:11.753029 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:11.753131 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:11.753960 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:11.754714 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:11.755830 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:11.756213 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:11.756299 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:11.760441 (+ 4142us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.67:42847: BlockingRecv error: recv got EOF from 127.4.201.67:42847 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 12 01:06:11 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:11 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:11.928241 20433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:11.919414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.65:46101)
0812 01:06:11.919878 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:11.919895 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:11.920029 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:11.920399 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:11.920402 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:11.920770 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:11.920945 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:11.920954 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:11.922080 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:11.922084 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:11.923055 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:11.923069 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:11.923766 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:11.923769 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:11.923888 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:11.924457 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:11.924476 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:11.928014 (+ 3538us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":234,"threads_started":1}
W20260812 01:06:11.928421 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:11.919487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:46101 (local address 127.4.201.126:37967)
0812 01:06:11.919691 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:11.919698 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:11.919979 (+ 281us) server_negotiation.cc:407] Connection header received
0812 01:06:11.920178 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:11.920183 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:11.920251 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:11.920373 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:11.921100 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:11.921957 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:11.923197 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:11.923650 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:11.923742 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:11.928216 (+ 4474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.65:46101: BlockingRecv error: recv got EOF from 127.4.201.65:46101 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 12 01:06:12 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:12 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:12.366703 20434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:12.354469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.66:39023)
0812 01:06:12.354962 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:12.354979 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:12.355108 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:12.355378 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:12.355381 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:12.355748 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:12.355916 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:12.355926 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:12.356860 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:12.356864 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:12.357859 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:12.357877 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:12.358818 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:12.358824 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:12.359016 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:12.363176 (+ 4160us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:12.363195 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:12.366375 (+ 3180us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":254,"threads_started":1}
W20260812 01:06:12.366885 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:12.354531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:39023 (local address 127.4.201.126:37967)
0812 01:06:12.354700 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:12.354705 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:12.355046 (+ 341us) server_negotiation.cc:407] Connection header received
0812 01:06:12.355202 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:12.355206 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:12.355267 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:12.355348 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:12.356030 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:12.356740 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:12.358036 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:12.358640 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:12.358765 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:12.366649 (+ 7884us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.66:39023: BlockingRecv error: recv got EOF from 127.4.201.66:39023 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 12 01:06:12 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:12 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:12.769704 20437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:12.761349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.67:56749)
0812 01:06:12.761861 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:12.761877 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:12.761992 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:12.762257 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:12.762260 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:12.762649 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:12.762819 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:12.762829 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:12.763813 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:12.763817 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:12.764722 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:12.764733 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:12.765333 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:12.765337 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:12.765453 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:12.765977 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:12.765993 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:12.769372 (+ 3379us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":260,"threads_started":1}
W20260812 01:06:12.769793 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:12.761436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:56749 (local address 127.4.201.126:37967)
0812 01:06:12.761598 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:12.761602 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:12.761941 (+ 339us) server_negotiation.cc:407] Connection header received
0812 01:06:12.762089 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:12.762092 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:12.762156 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:12.762227 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:12.762933 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:12.763667 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:12.764827 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:12.765233 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:12.765318 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:12.769595 (+ 4277us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.67:56749: BlockingRecv error: recv got EOF from 127.4.201.67:56749 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 12 01:06:12 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:12 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:12.938329 20438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:12.929242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.65:50093)
0812 01:06:12.929780 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:12.929796 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:12.929923 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:12.930253 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:12.930258 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:12.930655 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:12.930826 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:12.930835 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:12.931870 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:12.931874 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:12.932861 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:12.932875 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:12.933842 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:12.933849 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:12.934024 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:12.934669 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:12.934688 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:12.938035 (+ 3347us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":302,"threads_started":1}
W20260812 01:06:12.938561 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:12.929317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:50093 (local address 127.4.201.126:37967)
0812 01:06:12.929539 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:12.929545 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:12.929875 (+ 330us) server_negotiation.cc:407] Connection header received
0812 01:06:12.930039 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:12.930043 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:12.930104 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:12.930184 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:12.930966 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:12.931737 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:12.933029 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:12.933689 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:12.933826 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:12.938249 (+ 4423us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.65:50093: BlockingRecv error: recv got EOF from 127.4.201.65:50093 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 12 01:06:13 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:13 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:13.376672 20439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:13.367799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.66:43435)
0812 01:06:13.368347 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:13.368364 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:13.368494 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:13.368764 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:13.368767 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:13.369151 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:13.369345 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:13.369355 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:13.370281 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:13.370285 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:13.371395 (+ 1110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:13.371411 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:13.372267 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:13.372273 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:13.372449 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:13.373036 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:13.373055 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:13.376412 (+ 3357us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":300,"threads_started":1}
W20260812 01:06:13.376814 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:13.367879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:43435 (local address 127.4.201.126:37967)
0812 01:06:13.368048 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:13.368053 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:13.368431 (+ 378us) server_negotiation.cc:407] Connection header received
0812 01:06:13.368588 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:13.368592 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:13.368652 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:13.368735 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:13.369459 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:13.370175 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:13.371552 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:13.372114 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:13.372242 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:13.376614 (+ 4372us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.66:43435: BlockingRecv error: recv got EOF from 127.4.201.66:43435 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 12 01:06:13 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:13 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:13.779582 20440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:13.770726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.67:43447)
0812 01:06:13.771240 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:13.771256 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:13.771411 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:13.771741 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:13.771745 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:13.772135 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:13.772301 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:13.772310 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:13.773328 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:13.773333 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:13.774379 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:13.774391 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:13.775061 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:13.775068 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:13.775240 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:13.775804 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:13.775823 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:13.779260 (+ 3437us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":270,"threads_started":1}
W20260812 01:06:13.779693 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:13.770780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:43447 (local address 127.4.201.126:37967)
0812 01:06:13.771003 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:13.771009 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:13.771350 (+ 341us) server_negotiation.cc:407] Connection header received
0812 01:06:13.771529 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:13.771535 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:13.771607 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:13.771689 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:13.772445 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:13.773171 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:13.774521 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:13.774926 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:13.775044 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:13.779477 (+ 4433us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.67:43447: BlockingRecv error: recv got EOF from 127.4.201.67:43447 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 12 01:06:13 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:13 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:13.947952 20442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:13.939313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.65:42281)
0812 01:06:13.939865 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:13.939886 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:13.940030 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:13.940375 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:13.940380 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:13.940823 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:13.940993 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:13.941003 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:13.942070 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:13.942077 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:13.943008 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:13.943021 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:13.943700 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:13.943706 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:13.943876 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:13.944398 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:13.944415 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:13.947673 (+ 3258us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":285,"threads_started":1}
W20260812 01:06:13.948158 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:13.939384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:42281 (local address 127.4.201.126:37967)
0812 01:06:13.939571 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:13.939577 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:13.939974 (+ 397us) server_negotiation.cc:407] Connection header received
0812 01:06:13.940145 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:13.940149 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:13.940227 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:13.940321 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:13.941140 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:13.941928 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:13.943148 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:13.943557 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:13.943667 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:13.947896 (+ 4229us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.65:42281: BlockingRecv error: recv got EOF from 127.4.201.65:42281 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 12 01:06:14 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:14 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:14.386538 20443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:14.377629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.66:33681)
0812 01:06:14.378143 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:14.378159 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:14.378281 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:14.378566 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:14.378569 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:14.379012 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:14.379164 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:14.379174 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:14.380289 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:14.380295 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:14.381581 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:14.381595 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:14.382317 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:14.382322 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:14.382442 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:14.383045 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:14.383064 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:14.386312 (+ 3248us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":269,"threads_started":1}
W20260812 01:06:14.386782 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:14.377802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:33681 (local address 127.4.201.126:37967)
0812 01:06:14.378019 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:14.378025 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:14.378240 (+ 215us) server_negotiation.cc:407] Connection header received
0812 01:06:14.378391 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:14.378395 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:14.378458 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:14.378536 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:14.379273 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:14.380159 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:14.381725 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:14.382199 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:14.382303 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:14.386528 (+ 4225us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.66:33681: BlockingRecv error: recv got EOF from 127.4.201.66:33681 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 12 01:06:14 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:14 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:14.792165 20449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:14.780506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.67:58117)
0812 01:06:14.781027 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:14.781043 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:14.781158 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:14.781447 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:14.781450 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:14.781948 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:14.782135 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:14.782146 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:14.783070 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:14.783074 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:14.784017 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:14.784029 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:14.784646 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:14.784650 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:14.784777 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:14.788333 (+ 3556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:14.788359 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:14.791839 (+ 3480us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":270,"threads_started":1}
W20260812 01:06:14.792289 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:14.780575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:58117 (local address 127.4.201.126:37967)
0812 01:06:14.780831 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:14.780838 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:14.781112 (+ 274us) server_negotiation.cc:407] Connection header received
0812 01:06:14.781261 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:14.781265 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:14.781328 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:14.781405 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:14.782263 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:14.782968 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:14.784131 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:14.784533 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:14.784628 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:14.792061 (+ 7433us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.67:58117: BlockingRecv error: recv got EOF from 127.4.201.67:58117 (error 108)
Metrics: {"server-negotiator.queue_time_us":115}
Aug 12 01:06:14 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:14 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:14.957290 20450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:14.948959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.65:35103)
0812 01:06:14.949445 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:14.949463 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:14.949580 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:14.949840 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:14.949843 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:14.950261 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:14.950429 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:14.950439 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:14.951357 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:14.951361 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:14.952276 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:14.952288 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:14.952921 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:14.952925 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:14.953056 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:14.953647 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:14.953665 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:14.956926 (+ 3261us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":252,"threads_started":1}
W20260812 01:06:14.957408 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:14.948990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:35103 (local address 127.4.201.126:37967)
0812 01:06:14.949188 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:14.949193 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:14.949539 (+ 346us) server_negotiation.cc:407] Connection header received
0812 01:06:14.949686 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:14.949691 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:14.949754 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:14.949825 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:14.950544 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:14.951245 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:14.952383 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:14.952806 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:14.952894 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:14.957146 (+ 4252us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.65:35103: BlockingRecv error: recv got EOF from 127.4.201.65:35103 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 12 01:06:15 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:15 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:15.396284 20451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:15.387485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.66:59231)
0812 01:06:15.387998 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:15.388015 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:15.388154 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:15.388525 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:15.388530 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:15.389071 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:15.389304 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:15.389320 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:15.390448 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:15.390452 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:15.391434 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:15.391450 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:15.392132 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:15.392136 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:15.392263 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:15.392795 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:15.392813 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:15.396035 (+ 3222us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":261,"threads_started":1}
W20260812 01:06:15.396407 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:15.387618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:59231 (local address 127.4.201.126:37967)
0812 01:06:15.387816 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:15.387823 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:15.388101 (+ 278us) server_negotiation.cc:407] Connection header received
0812 01:06:15.388275 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:15.388280 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:15.388364 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:15.388455 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:15.389459 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:15.390289 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:15.391575 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:15.392001 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:15.392096 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:15.396234 (+ 4138us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.66:59231: BlockingRecv error: recv got EOF from 127.4.201.66:59231 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 12 01:06:15 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:15 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:15.801981 20453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:15.793022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.67:39233)
0812 01:06:15.793581 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:15.793602 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:15.793725 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:15.794002 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:15.794004 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:15.794419 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:15.794588 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:15.794597 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:15.795785 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:15.795791 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:15.797007 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:15.797021 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:15.797683 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:15.797687 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:15.797807 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:15.798462 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:15.798481 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:15.801747 (+ 3266us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":315,"threads_started":1}
W20260812 01:06:15.802179 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:15.793132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:39233 (local address 127.4.201.126:37967)
0812 01:06:15.793316 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:15.793320 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:15.793668 (+ 348us) server_negotiation.cc:407] Connection header received
0812 01:06:15.793814 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:15.793818 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:15.793880 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:15.793963 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:15.794771 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:15.795638 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:15.797143 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:15.797566 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:15.797658 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:15.801942 (+ 4284us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.67:39233: BlockingRecv error: recv got EOF from 127.4.201.67:39233 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 12 01:06:15 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:15 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:15.966881 20454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:15.958283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.65:35685)
0812 01:06:15.958930 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:15.958946 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:15.959092 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:15.959451 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:15.959455 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:15.959881 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:15.960057 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:15.960067 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:15.961035 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:15.961039 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:15.962012 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:15.962024 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:15.962729 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:15.962735 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:15.962887 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:15.963404 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:15.963422 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:15.966539 (+ 3117us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":320,"threads_started":1}
W20260812 01:06:15.966925 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:15.958343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:35685 (local address 127.4.201.126:37967)
0812 01:06:15.958531 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:15.958537 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:15.959030 (+ 493us) server_negotiation.cc:407] Connection header received
0812 01:06:15.959225 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:15.959230 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:15.959310 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:15.959389 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:15.960205 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:15.960892 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:15.962150 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:15.962583 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:15.962693 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:15.966726 (+ 4033us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.65:35685: BlockingRecv error: recv got EOF from 127.4.201.65:35685 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 12 01:06:16 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:16 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:16.406183 20455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:16.397248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.66:38273)
0812 01:06:16.397826 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:16.397843 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:16.397962 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:16.398255 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:16.398257 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:16.398670 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:16.398898 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:16.398913 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:16.400207 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:16.400211 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:16.401143 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:16.401157 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:16.401841 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:16.401844 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:16.401952 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:16.402511 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:16.402529 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:16.405846 (+ 3317us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":276,"threads_started":1}
W20260812 01:06:16.406332 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:16.397334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:38273 (local address 127.4.201.126:37967)
0812 01:06:16.397579 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:16.397586 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:16.397917 (+ 331us) server_negotiation.cc:407] Connection header received
0812 01:06:16.398069 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:16.398073 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:16.398137 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:16.398211 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:16.399031 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:16.400054 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:16.401285 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:16.401723 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:16.401817 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:16.406086 (+ 4269us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.66:38273: BlockingRecv error: recv got EOF from 127.4.201.66:38273 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 12 01:06:16 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:16 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:16.811829 20457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:16.802927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.67:50409)
0812 01:06:16.803494 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:16.803509 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:16.803655 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:16.803979 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:16.803984 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:16.804412 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:16.804599 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:16.804609 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:16.805929 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:16.805935 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:16.807000 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:16.807015 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:16.807682 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:16.807686 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:16.807788 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:16.808337 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:16.808353 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:16.811583 (+ 3230us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":250,"threads_started":1}
W20260812 01:06:16.811935 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:16.802998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:50409 (local address 127.4.201.126:37967)
0812 01:06:16.803214 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:16.803222 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:16.803594 (+ 372us) server_negotiation.cc:407] Connection header received
0812 01:06:16.803769 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:16.803775 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:16.803845 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:16.803926 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:16.804750 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:16.805753 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:16.807134 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:16.807564 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:16.807661 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:16.811757 (+ 4096us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.67:50409: BlockingRecv error: recv got EOF from 127.4.201.67:50409 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 12 01:06:16 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:16 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:16.976253 20459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:16.967936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.65:45505)
0812 01:06:16.968518 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:16.968535 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:16.968667 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:16.968981 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:16.968985 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:16.969416 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:16.969588 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:16.969597 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:16.970532 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:16.970535 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:16.971481 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:16.971492 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:16.972183 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:16.972188 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:16.972304 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:16.972870 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:16.972888 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:16.976016 (+ 3128us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":266,"threads_started":1}
W20260812 01:06:16.976419 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:16.968068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:45505 (local address 127.4.201.126:37967)
0812 01:06:16.968263 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:16.968269 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:16.968600 (+ 331us) server_negotiation.cc:407] Connection header received
0812 01:06:16.968776 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:16.968780 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:16.968860 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:16.968939 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:16.969700 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:16.970424 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:16.971604 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:16.972018 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:16.972118 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:16.976197 (+ 4079us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.65:45505: BlockingRecv error: recv got EOF from 127.4.201.65:45505 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 12 01:06:17 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:17 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:17.416085 20460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:17.407245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.66:49119)
0812 01:06:17.407784 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:17.407801 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:17.407923 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:17.408203 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:17.408206 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:17.408618 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:17.408789 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:17.408799 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:17.409968 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:17.409974 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:17.411010 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:17.411024 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:17.411844 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:17.411851 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:17.412000 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:17.412567 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:17.412584 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:17.415746 (+ 3162us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":276,"threads_started":1}
W20260812 01:06:17.416250 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:17.407336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:49119 (local address 127.4.201.126:37967)
0812 01:06:17.407530 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:17.407535 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:17.407871 (+ 336us) server_negotiation.cc:407] Connection header received
0812 01:06:17.408021 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:17.408025 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:17.408087 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:17.408171 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:17.408903 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:17.409802 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:17.411157 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:17.411657 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:17.411773 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:17.416019 (+ 4246us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.66:49119: BlockingRecv error: recv got EOF from 127.4.201.66:49119 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 12 01:06:17 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:17 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:17.821731 20462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:17.812759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.67:39935)
0812 01:06:17.813319 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:17.813340 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:17.813492 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:17.813782 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:17.813785 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:17.814205 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:17.814375 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:17.814384 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:17.815343 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:17.815347 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:17.816274 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:17.816286 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:17.816930 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:17.816935 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:17.817049 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:17.817783 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:17.817807 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:17.821480 (+ 3673us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":280,"threads_started":1}
W20260812 01:06:17.821938 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:17.812854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:39935 (local address 127.4.201.126:37967)
0812 01:06:17.813056 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:17.813062 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:17.813432 (+ 370us) server_negotiation.cc:407] Connection header received
0812 01:06:17.813603 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:17.813607 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:17.813672 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:17.813754 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:17.814509 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:17.815247 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:17.816377 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:17.816793 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:17.816880 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:17.821693 (+ 4813us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.67:39935: BlockingRecv error: recv got EOF from 127.4.201.67:39935 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 12 01:06:17 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:17 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:17.986119 20463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:17.977170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.65:57221)
0812 01:06:17.977739 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:17.977756 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:17.977867 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:17.978178 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:17.978181 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:17.978609 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:17.978772 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:17.978786 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:17.979733 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:17.979736 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:17.980686 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:17.980699 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:17.981567 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:17.981572 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:17.981707 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:17.982334 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:17.982358 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:17.985878 (+ 3520us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":289,"threads_started":1}
W20260812 01:06:17.986259 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:17.977245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:57221 (local address 127.4.201.126:37967)
0812 01:06:17.977401 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:17.977405 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:17.977818 (+ 413us) server_negotiation.cc:407] Connection header received
0812 01:06:17.977975 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:17.977985 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:17.978063 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:17.978140 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:17.978891 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:17.979615 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:17.980817 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:17.981425 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:17.981528 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:17.986061 (+ 4533us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.65:57221: BlockingRecv error: recv got EOF from 127.4.201.65:57221 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 12 01:06:18 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:18 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:18.425292 20464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:18.416990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.66:54389)
0812 01:06:18.417483 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:18.417502 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:18.417624 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:18.417893 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:18.417896 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:18.418301 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:18.418449 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:18.418458 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:18.419402 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:18.419405 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:18.420351 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:18.420363 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:18.420962 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:18.420966 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:18.421100 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:18.421660 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:18.421677 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:18.425019 (+ 3342us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":264,"threads_started":1}
W20260812 01:06:18.425483 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:18.417033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:54389 (local address 127.4.201.126:37967)
0812 01:06:18.417292 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:18.417298 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:18.417576 (+ 278us) server_negotiation.cc:407] Connection header received
0812 01:06:18.417719 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:18.417723 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:18.417786 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:18.417866 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:18.418568 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:18.419299 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:18.420458 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:18.420851 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:18.420948 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:18.425262 (+ 4314us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.66:54389: BlockingRecv error: recv got EOF from 127.4.201.66:54389 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 12 01:06:18 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:18 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:18.831197 20465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:18.822700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.67:51821)
0812 01:06:18.823257 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:18.823274 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:18.823386 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:18.823717 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:18.823720 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:18.824111 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:18.824264 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:18.824272 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:18.825296 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:18.825300 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:18.826299 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:18.826313 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:18.826951 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:18.826955 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:18.827075 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:18.827661 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:18.827680 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:18.830960 (+ 3280us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":303,"threads_started":1}
W20260812 01:06:18.831391 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:18.822773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:51821 (local address 127.4.201.126:37967)
0812 01:06:18.822941 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:18.822945 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:18.823355 (+ 410us) server_negotiation.cc:407] Connection header received
0812 01:06:18.823522 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:18.823527 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:18.823591 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:18.823676 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:18.824413 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:18.825157 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:18.826416 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:18.826836 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:18.826927 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:18.831165 (+ 4238us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.67:51821: BlockingRecv error: recv got EOF from 127.4.201.67:51821 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 12 01:06:18 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:18 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:18.995452 20466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:18.986950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.65:58805)
0812 01:06:18.987431 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:18.987448 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:18.987595 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:18.987912 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:18.987917 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:18.988345 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:18.988516 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:18.988528 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:18.989564 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:18.989568 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:18.990563 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:18.990574 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:18.991307 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:18.991313 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:18.991464 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:18.992024 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:18.992043 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:18.995227 (+ 3184us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":248,"threads_started":1}
W20260812 01:06:18.995659 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:18.987014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:58805 (local address 127.4.201.126:37967)
0812 01:06:18.987208 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:18.987214 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:18.987546 (+ 332us) server_negotiation.cc:407] Connection header received
0812 01:06:18.987712 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:18.987716 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:18.987780 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:18.987860 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:18.988669 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:18.989438 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:18.990698 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:18.991141 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:18.991260 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:18.995412 (+ 4152us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.65:58805: BlockingRecv error: recv got EOF from 127.4.201.65:58805 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 12 01:06:19 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:19 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:19.434453 20467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:19.426187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.66:45435)
0812 01:06:19.426746 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:19.426763 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:19.426887 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:19.427182 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:19.427185 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:19.427574 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:19.427744 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:19.427754 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:19.428685 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:19.428688 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:19.429686 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:19.429698 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:19.430270 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:19.430274 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:19.430380 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:19.430907 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:19.430923 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:19.434210 (+ 3287us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":295,"threads_started":1}
W20260812 01:06:19.434667 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:19.426267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:45435 (local address 127.4.201.126:37967)
0812 01:06:19.426461 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:19.426493 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:19.426829 (+ 336us) server_negotiation.cc:407] Connection header received
0812 01:06:19.427004 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:19.427007 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:19.427070 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:19.427148 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:19.427859 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:19.428567 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:19.429785 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:19.430158 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:19.430248 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:19.434433 (+ 4185us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.66:45435: BlockingRecv error: recv got EOF from 127.4.201.66:45435 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 12 01:06:19 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:19 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:19.845041 20468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:19.832051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.67:53733)
0812 01:06:19.832551 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:19.832568 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:19.832685 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:19.832952 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:19.832955 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:19.833370 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:19.833578 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:19.833590 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:19.834549 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:19.834554 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:19.835623 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:19.835639 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:19.836408 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:19.836414 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:19.836588 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:19.841702 (+ 5114us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:19.841721 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:19.844783 (+ 3062us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":252,"threads_started":1}
W20260812 01:06:19.845237 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:19.832213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:53733 (local address 127.4.201.126:37967)
0812 01:06:19.832422 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:19.832427 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:19.832634 (+ 207us) server_negotiation.cc:407] Connection header received
0812 01:06:19.832776 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:19.832779 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:19.832841 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:19.832924 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:19.833696 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:19.834430 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:19.835745 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:19.836214 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:19.836332 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:19.844966 (+ 8634us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.67:53733: BlockingRecv error: recv got EOF from 127.4.201.67:53733 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
Aug 12 01:06:19 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:19 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:20.005640 20470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:19.996302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.65:53391)
0812 01:06:19.996813 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:19.996830 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:19.996969 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:19.997334 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:19.997340 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:19.997807 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:19.997993 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:19.998003 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:19.999010 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:19.999014 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:20.000211 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:20.000225 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:20.001105 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:20.001111 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:20.001326 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:20.001922 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:20.001941 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:20.005329 (+ 3388us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":277,"threads_started":1}
W20260812 01:06:20.005709 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:19.996421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:53391 (local address 127.4.201.126:37967)
0812 01:06:19.996649 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:19.996656 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:19.996915 (+ 259us) server_negotiation.cc:407] Connection header received
0812 01:06:19.997087 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:19.997093 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:19.997162 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:19.997275 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:19.998136 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:19.998870 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:20.000354 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:20.000954 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:20.001067 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:20.005506 (+ 4439us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.65:53391: BlockingRecv error: recv got EOF from 127.4.201.65:53391 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 12 01:06:20 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:20 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:20.444012 20471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:20.435350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.66:35369)
0812 01:06:20.435799 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:20.435816 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:20.435931 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:20.436210 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:20.436213 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:20.436632 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:20.436817 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:20.436827 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:20.437854 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:20.437858 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:20.438849 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:20.438863 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:20.439455 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:20.439459 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:20.439574 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:20.440103 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:20.440118 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:20.443786 (+ 3668us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":242,"threads_started":1}
W20260812 01:06:20.444175 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:20.435425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:35369 (local address 127.4.201.126:37967)
0812 01:06:20.435655 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:20.435662 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:20.435888 (+ 226us) server_negotiation.cc:407] Connection header received
0812 01:06:20.436043 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:20.436047 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:20.436111 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:20.436184 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:20.436924 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:20.437741 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:20.438965 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:20.439346 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:20.439437 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:20.443972 (+ 4535us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.66:35369: BlockingRecv error: recv got EOF from 127.4.201.66:35369 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 12 01:06:20 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:20 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:20.855116 20474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:20.846015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.67:32943)
0812 01:06:20.846516 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:20.846535 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:20.846651 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:20.847164 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:20.847169 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:20.847750 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:20.848029 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:20.848046 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:20.849249 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:20.849256 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:20.850210 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:20.850224 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:20.850905 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:20.850909 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:20.851035 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:20.851618 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:20.851636 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:20.854887 (+ 3251us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":259,"threads_started":1}
W20260812 01:06:20.855263 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:20.846045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:32943 (local address 127.4.201.126:37967)
0812 01:06:20.846226 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:20.846232 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:20.846599 (+ 367us) server_negotiation.cc:407] Connection header received
0812 01:06:20.846736 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:20.846740 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:20.846824 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:20.846923 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:20.848213 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:20.849092 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:20.850366 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:20.850782 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:20.850883 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:20.855057 (+ 4174us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.67:32943: BlockingRecv error: recv got EOF from 127.4.201.67:32943 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 12 01:06:21 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:21 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:21.015405 20475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:21.006633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.65:46395)
0812 01:06:21.007198 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:21.007215 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:21.007338 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:21.007621 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:21.007624 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:21.008035 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:21.008210 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:21.008220 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:21.009294 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:21.009300 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:21.010430 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:21.010447 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:21.011222 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:21.011226 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:21.011370 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:21.011905 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:21.011921 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:21.015077 (+ 3156us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":282,"threads_started":1}
W20260812 01:06:21.015543 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:21.006698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:46395 (local address 127.4.201.126:37967)
0812 01:06:21.006874 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:21.006879 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:21.007280 (+ 401us) server_negotiation.cc:407] Connection header received
0812 01:06:21.007433 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:21.007437 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:21.007509 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:21.007595 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:21.008319 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:21.009109 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:21.010627 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:21.011079 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:21.011175 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:21.015292 (+ 4117us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.65:46395: BlockingRecv error: recv got EOF from 127.4.201.65:46395 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 12 01:06:21 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:21 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:21.453657 20476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:21.444927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.66:60291)
0812 01:06:21.445495 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:21.445511 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:21.445647 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:21.446007 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:21.446011 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:21.446464 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:21.446642 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:21.446652 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:21.447683 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:21.447688 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:21.448674 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:21.448688 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:21.449426 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:21.449433 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:21.449610 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:21.450188 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:21.450206 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:21.453340 (+ 3134us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":306,"threads_started":1}
W20260812 01:06:21.453806 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:21.445004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:60291 (local address 127.4.201.126:37967)
0812 01:06:21.445195 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:21.445202 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:21.445594 (+ 392us) server_negotiation.cc:407] Connection header received
0812 01:06:21.445760 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:21.445765 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:21.445829 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:21.445910 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:21.446785 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:21.447544 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:21.448809 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:21.449249 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:21.449384 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:21.453573 (+ 4189us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.66:60291: BlockingRecv error: recv got EOF from 127.4.201.66:60291 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 12 01:06:21 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:21 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:21.864650 20477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:21.855930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.67:52295)
0812 01:06:21.856423 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:21.856439 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:21.856571 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:21.856842 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:21.856845 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:21.857317 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:21.857498 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:21.857508 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:21.858458 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:21.858461 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:21.859376 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:21.859387 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:21.860034 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:21.860038 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:21.860168 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:21.860725 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:21.860742 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:21.864402 (+ 3660us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":255,"threads_started":1}
W20260812 01:06:21.864841 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:21.855993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:52295 (local address 127.4.201.126:37967)
0812 01:06:21.856205 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:21.856211 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:21.856515 (+ 304us) server_negotiation.cc:407] Connection header received
0812 01:06:21.856670 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:21.856674 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:21.856738 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:21.856816 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:21.857620 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:21.858350 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:21.859483 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:21.859878 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:21.859978 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:21.864615 (+ 4637us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.67:52295: BlockingRecv error: recv got EOF from 127.4.201.67:52295 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 12 01:06:22 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:22 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:22.024724 20479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:22.016585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.65:56555)
0812 01:06:22.017068 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:22.017085 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:22.017198 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:22.017524 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:22.017527 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:22.017942 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:22.018107 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:22.018117 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:22.019032 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:22.019036 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:22.019923 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:22.019934 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:22.020566 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:22.020570 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:22.020689 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:22.021203 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:22.021248 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:22.024412 (+ 3164us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":258,"threads_started":1}
W20260812 01:06:22.024864 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:22.016618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:56555 (local address 127.4.201.126:37967)
0812 01:06:22.016782 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:22.016787 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:22.017149 (+ 362us) server_negotiation.cc:407] Connection header received
0812 01:06:22.017346 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:22.017350 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:22.017411 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:22.017502 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:22.018218 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:22.018922 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:22.020038 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:22.020457 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:22.020552 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:22.024648 (+ 4096us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.65:56555: BlockingRecv error: recv got EOF from 127.4.201.65:56555 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 12 01:06:22 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:22 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:22.463126 20481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:22.454633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.66:38903)
0812 01:06:22.455108 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:22.455124 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:22.455237 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:22.455486 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:22.455489 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:22.455886 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:22.456059 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:22.456069 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:22.456979 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:22.456983 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:22.457884 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:22.457896 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:22.458542 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:22.458546 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:22.458664 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:22.459254 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:22.459271 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:22.462879 (+ 3608us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":249,"threads_started":1}
W20260812 01:06:22.463304 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:22.454788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:38903 (local address 127.4.201.126:37967)
0812 01:06:22.455012 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:22.455018 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:22.455178 (+ 160us) server_negotiation.cc:407] Connection header received
0812 01:06:22.455319 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:22.455323 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:22.455385 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:22.455460 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:22.456170 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:22.456869 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:22.458006 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:22.458437 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:22.458526 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:22.463087 (+ 4561us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.66:38903: BlockingRecv error: recv got EOF from 127.4.201.66:38903 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 12 01:06:22 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:22 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.67@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:22.874511 20485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:22.865595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.67:44667)
0812 01:06:22.866066 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:22.866082 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:22.866215 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:22.866555 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:22.866559 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:22.866996 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:22.867147 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:22.867157 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:22.868173 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:22.868179 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:22.869096 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:22.869108 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:22.869866 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:22.869872 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:22.870045 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:22.870590 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:22.870608 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:22.874175 (+ 3567us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":247,"threads_started":1}
W20260812 01:06:22.874619 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:22.865657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:44667 (local address 127.4.201.126:37967)
0812 01:06:22.865834 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:22.865840 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:22.866159 (+ 319us) server_negotiation.cc:407] Connection header received
0812 01:06:22.866341 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:22.866345 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:22.866407 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:22.866486 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:22.867290 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:22.868030 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:22.869264 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:22.869718 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:22.869832 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:22.874401 (+ 4569us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.67:44667: BlockingRecv error: recv got EOF from 127.4.201.67:44667 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 12 01:06:23 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:23 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.65@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:23.034121 20486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:23.026004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.65:41955)
0812 01:06:23.026526 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:23.026544 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:23.026659 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:23.026918 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:23.026921 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:23.027283 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:23.027475 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:23.027496 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:23.028414 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:23.028418 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:23.029374 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:23.029386 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:23.029990 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:23.029994 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:23.030111 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:23.030657 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:23.030674 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:23.033814 (+ 3140us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":270,"threads_started":1}
W20260812 01:06:23.034274 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:23.026113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:41955 (local address 127.4.201.126:37967)
0812 01:06:23.026408 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:23.026414 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:23.026612 (+ 198us) server_negotiation.cc:407] Connection header received
0812 01:06:23.026747 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:23.026751 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:23.026811 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:23.026890 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:23.027594 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:23.028300 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:23.029475 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:23.029888 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:23.029987 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:23.034040 (+ 4053us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.65:41955: BlockingRecv error: recv got EOF from 127.4.201.65:41955 (error 108)
Metrics: {"server-negotiator.queue_time_us":165}
Aug 12 01:06:23 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 01:06:23 dist-test-slave-bndk krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.201.66@KRBTEST.COM for oryx/127.4.201.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 01:06:23.473027 20487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:23.464289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:37967 (local address 127.4.201.66:50737)
0812 01:06:23.464797 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:23.464813 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:23.464941 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:23.465306 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:23.465311 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:23.465707 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:23.465898 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:23.465908 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:23.466916 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:23.466921 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:23.467834 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:23.467847 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:23.468550 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:23.468556 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:23.468726 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:23.469301 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:23.469319 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:23.472744 (+ 3425us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.201.126:37967: Server oryx/127.4.201.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":242,"threads_started":1}
W20260812 01:06:23.473135 20418 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:23.464406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:50737 (local address 127.4.201.126:37967)
0812 01:06:23.464647 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:23.464652 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:23.464890 (+ 238us) server_negotiation.cc:407] Connection header received
0812 01:06:23.465070 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:23.465076 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:23.465148 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:23.465263 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:23.466042 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:23.466766 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:23.467976 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:23.468405 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:23.468527 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:23.472923 (+ 4396us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.201.66:50737: BlockingRecv error: recv got EOF from 127.4.201.66:50737 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 01:06:23.609709 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 19754
I20260812 01:06:23.621315 20489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:23.610667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43322 (local address 127.4.201.65:45753)
0812 01:06:23.611270 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:23.611277 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:23.611317 (+ 40us) server_negotiation.cc:407] Connection header received
0812 01:06:23.611381 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:23.611388 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:23.611621 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:23.611778 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:23.613154 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:23.614277 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:23.615430 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:23.615966 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:23.616070 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:23.618359 (+ 2289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:23.618368 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:23.618382 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:06:23.618424 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:23.620802 (+ 2378us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.4.201.65@KRBTEST.COM not found in keytab (ticket kvno 2)
0812 01:06:23.621071 (+ 269us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:43322: Request ticket server kudu/127.4.201.65@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":310,"threads_started":1}
W20260812 01:06:23.621414 20489 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:43322: Request ticket server kudu/127.4.201.65@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260812 01:06:23.621441 4901 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 19754: Not authorized: Client connection negotiation failed: client connection to 127.4.201.65:45753: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.4.201.65@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260812 01:06:23.621709 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 19754
I20260812 01:06:23.645309 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 20002
I20260812 01:06:23.658147 20490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:23.646481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57326 (local address 127.4.201.66:43053)
0812 01:06:23.647363 (+ 882us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:23.647371 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:23.647402 (+ 31us) server_negotiation.cc:407] Connection header received
0812 01:06:23.647473 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:23.647488 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:23.647820 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:23.648005 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:23.649655 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:23.650731 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:23.651931 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:23.652497 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:23.652592 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:23.654939 (+ 2347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:23.654948 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:23.654962 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:06:23.655004 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:23.657589 (+ 2585us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.4.201.66@KRBTEST.COM not found in keytab (ticket kvno 2)
0812 01:06:23.657870 (+ 281us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57326: Request ticket server kudu/127.4.201.66@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":686,"thread_start_us":523,"threads_started":1}
W20260812 01:06:23.658215 4901 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 20002: Not authorized: Client connection negotiation failed: client connection to 127.4.201.66:43053: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.4.201.66@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260812 01:06:23.658247 20490 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57326: Request ticket server kudu/127.4.201.66@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260812 01:06:23.658365 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 20002
I20260812 01:06:23.680889 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 20202
I20260812 01:06:23.695068 20492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:23.682148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53732 (local address 127.4.201.67:42501)
0812 01:06:23.682812 (+ 664us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:23.682819 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:23.682847 (+ 28us) server_negotiation.cc:407] Connection header received
0812 01:06:23.682915 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:23.682922 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:23.683177 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:23.683341 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:23.685171 (+ 1830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:23.686351 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:23.687585 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:23.688141 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:23.688243 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:23.691126 (+ 2883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:23.691138 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:23.691157 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:06:23.691225 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:23.694368 (+ 3143us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.4.201.67@KRBTEST.COM not found in keytab (ticket kvno 2)
0812 01:06:23.694732 (+ 364us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53732: Request ticket server kudu/127.4.201.67@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":477,"thread_start_us":348,"threads_started":1}
W20260812 01:06:23.695072 4901 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 20202: Not authorized: Client connection negotiation failed: client connection to 127.4.201.67:42501: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.4.201.67@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260812 01:06:23.695173 20492 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53732: Request ticket server kudu/127.4.201.67@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260812 01:06:23.695232 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 20202
I20260812 01:06:23.717378 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 19652
I20260812 01:06:23.718659 19745 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:06:23.838943 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 19652
2026-08-12T01:06:23Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (21264 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-12T01:06:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:06:23Z Disabled control of system clock
I20260812 01:06:23.926553 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:41643
--webserver_interface=127.4.201.126
--webserver_port=0
--builtin_ntp_servers=127.4.201.84:36521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:41643
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 01:06:24.256002 20499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:06:24.256276 20499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:06:24.256353 20499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:06:24.263340 20499 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:06:24.263433 20499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:06:24.263474 20499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:06:24.263554 20499 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:06:24.263602 20499 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:06:24.272377 20499 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:36521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:41643
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:41643
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:06:24.273602 20499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:06:24.275326 20499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:06:24.286484 20508 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:24.286525 20512 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:24.286557 20509 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:06:24.287388 20499 server_base.cc:1034] running on GCE node
I20260812 01:06:24.288134 20499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:06:24.289458 20499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:06:24.290671 20499 hybrid_clock.cc:648] HybridClock initialized: now 1786496784290623 us; error 38 us; skew 500 ppm
I20260812 01:06:24.291000 20499 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:06:24.293308 20499 webserver.cc:460] Webserver started at http://127.4.201.126:39033/ using document root <none> and password file <none>
I20260812 01:06:24.293977 20499 fs_manager.cc:359] Metadata directory not provided
I20260812 01:06:24.294083 20499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:06:24.294405 20499 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:06:24.297262 20499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "37cb4ece2f894a46b0226215ba9f3d1f"
format_stamp: "Formatted at 2026-08-12 01:06:24 on dist-test-slave-bndk"
server_key: "5a8fcd13bdd389d228b2d23cbaa8c16f"
server_key_iv: "fcc7250598664a56c52097a1736f0742"
server_key_version: "encryptionkey@0"
I20260812 01:06:24.298055 20499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "37cb4ece2f894a46b0226215ba9f3d1f"
format_stamp: "Formatted at 2026-08-12 01:06:24 on dist-test-slave-bndk"
server_key: "5a8fcd13bdd389d228b2d23cbaa8c16f"
server_key_iv: "fcc7250598664a56c52097a1736f0742"
server_key_version: "encryptionkey@0"
I20260812 01:06:24.303023 20499 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 01:06:24.306360 20521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:24.307613 20499 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 01:06:24.307770 20499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "37cb4ece2f894a46b0226215ba9f3d1f"
format_stamp: "Formatted at 2026-08-12 01:06:24 on dist-test-slave-bndk"
server_key: "5a8fcd13bdd389d228b2d23cbaa8c16f"
server_key_iv: "fcc7250598664a56c52097a1736f0742"
server_key_version: "encryptionkey@0"
I20260812 01:06:24.307960 20499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:06:24.319134 20499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:06:24.319865 20499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:06:24.320132 20499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:06:24.337488 20499 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:41643
I20260812 01:06:24.337505 20608 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:41643 every 8 connection(s)
I20260812 01:06:24.338768 20499 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:06:24.342414 20609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:06:24.348742 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 20499
I20260812 01:06:24.348944 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:06:24.349805 4901 external_mini_cluster.cc:1428] Setting key 70a5e73997f9a3f80298f8169082eb45
I20260812 01:06:24.353245 20609 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37cb4ece2f894a46b0226215ba9f3d1f: Bootstrap starting.
I20260812 01:06:24.356226 20609 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 37cb4ece2f894a46b0226215ba9f3d1f: Neither blocks nor log segments found. Creating new log.
I20260812 01:06:24.357335 20609 log.cc:824] T 00000000000000000000000000000000 P 37cb4ece2f894a46b0226215ba9f3d1f: Log is configured to *not* fsync() on all Append() calls
I20260812 01:06:24.360013 20609 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37cb4ece2f894a46b0226215ba9f3d1f: No bootstrap required, opened a new log
I20260812 01:06:24.363158 20613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:24.351994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46636 (local address 127.4.201.126:41643)
0812 01:06:24.352993 (+ 999us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:24.353003 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:24.353044 (+ 41us) server_negotiation.cc:407] Connection header received
0812 01:06:24.354733 (+ 1689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:24.354760 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:24.355192 (+ 432us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:24.355533 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:24.356100 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:24.357521 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:24.358831 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:24.359503 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:24.359692 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:24.360838 (+ 1146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:24.360846 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:24.360860 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:06:24.361430 (+ 570us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:24.361517 (+ 87us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:06:24.361542 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:24.361650 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:24.361893 (+ 243us) server_negotiation.cc:299] Negotiation successful
0812 01:06:24.362190 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":603,"thread_start_us":370,"threads_started":1}
I20260812 01:06:24.367890 20609 raft_consensus.cc:348] T 00000000000000000000000000000000 P 37cb4ece2f894a46b0226215ba9f3d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37cb4ece2f894a46b0226215ba9f3d1f" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 41643 } }
I20260812 01:06:24.368247 20609 raft_consensus.cc:374] T 00000000000000000000000000000000 P 37cb4ece2f894a46b0226215ba9f3d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:06:24.368351 20609 raft_consensus.cc:729] T 00000000000000000000000000000000 P 37cb4ece2f894a46b0226215ba9f3d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37cb4ece2f894a46b0226215ba9f3d1f, State: Initialized, Role: FOLLOWER
I20260812 01:06:24.368955 20609 consensus_queue.cc:260] T 00000000000000000000000000000000 P 37cb4ece2f894a46b0226215ba9f3d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37cb4ece2f894a46b0226215ba9f3d1f" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 41643 } }
I20260812 01:06:24.369256 20609 raft_consensus.cc:388] T 00000000000000000000000000000000 P 37cb4ece2f894a46b0226215ba9f3d1f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:06:24.369400 20609 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37cb4ece2f894a46b0226215ba9f3d1f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:06:24.369537 20609 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 37cb4ece2f894a46b0226215ba9f3d1f [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:06:24.372008 20609 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37cb4ece2f894a46b0226215ba9f3d1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37cb4ece2f894a46b0226215ba9f3d1f" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 41643 } }
I20260812 01:06:24.372454 20609 leader_election.cc:302] T 00000000000000000000000000000000 P 37cb4ece2f894a46b0226215ba9f3d1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 37cb4ece2f894a46b0226215ba9f3d1f; no voters:
I20260812 01:06:24.372956 20609 leader_election.cc:288] T 00000000000000000000000000000000 P 37cb4ece2f894a46b0226215ba9f3d1f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:06:24.373086 20615 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 37cb4ece2f894a46b0226215ba9f3d1f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:06:24.373752 20615 raft_consensus.cc:686] T 00000000000000000000000000000000 P 37cb4ece2f894a46b0226215ba9f3d1f [term 1 LEADER]: Becoming Leader. State: Replica: 37cb4ece2f894a46b0226215ba9f3d1f, State: Running, Role: LEADER
I20260812 01:06:24.374280 20615 consensus_queue.cc:237] T 00000000000000000000000000000000 P 37cb4ece2f894a46b0226215ba9f3d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37cb4ece2f894a46b0226215ba9f3d1f" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 41643 } }
I20260812 01:06:24.375005 20609 sys_catalog.cc:564] T 00000000000000000000000000000000 P 37cb4ece2f894a46b0226215ba9f3d1f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:06:24.376827 20616 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37cb4ece2f894a46b0226215ba9f3d1f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "37cb4ece2f894a46b0226215ba9f3d1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37cb4ece2f894a46b0226215ba9f3d1f" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 41643 } } }
I20260812 01:06:24.377281 20616 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37cb4ece2f894a46b0226215ba9f3d1f [sys.catalog]: This master's current role is: LEADER
I20260812 01:06:24.380959 20617 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37cb4ece2f894a46b0226215ba9f3d1f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 37cb4ece2f894a46b0226215ba9f3d1f. Latest consensus state: current_term: 1 leader_uuid: "37cb4ece2f894a46b0226215ba9f3d1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37cb4ece2f894a46b0226215ba9f3d1f" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 41643 } } }
I20260812 01:06:24.382222 20617 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37cb4ece2f894a46b0226215ba9f3d1f [sys.catalog]: This master's current role is: LEADER
I20260812 01:06:24.383050 20626 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:06:24.388091 20626 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:06:24.396487 20626 catalog_manager.cc:1347] Generated new cluster ID: 8796da4488814fb088a70cddb025fde5
I20260812 01:06:24.396602 20626 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:06:24.404552 20626 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:06:24.406291 20626 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:06:24.415192 20626 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 37cb4ece2f894a46b0226215ba9f3d1f: Generated new TSK 0
I20260812 01:06:24.416138 20626 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:06:24.423100 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:0
--local_ip_for_outbound_sockets=127.4.201.65
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:41643
--builtin_ntp_servers=127.4.201.84:36521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260812 01:06:24.811836 20644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:06:24.812094 20644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:06:24.812227 20644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:06:24.819222 20644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:06:24.819326 20644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:06:24.819463 20644 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:06:24.828104 20644 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:36521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:41643
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:06:24.829358 20644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:06:24.831130 20644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:06:24.846717 20654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:24.846686 20655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:24.847070 20657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:06:24.847896 20644 server_base.cc:1034] running on GCE node
I20260812 01:06:24.848521 20644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:06:24.849462 20644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:06:24.850683 20644 hybrid_clock.cc:648] HybridClock initialized: now 1786496784850640 us; error 31 us; skew 500 ppm
I20260812 01:06:24.850987 20644 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:06:24.856559 20644 webserver.cc:460] Webserver started at http://127.4.201.65:42323/ using document root <none> and password file <none>
I20260812 01:06:24.857263 20644 fs_manager.cc:359] Metadata directory not provided
I20260812 01:06:24.857378 20644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:06:24.857697 20644 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:06:24.860600 20644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/data/instance:
uuid: "60b4e07232144de387fbe716548d53cf"
format_stamp: "Formatted at 2026-08-12 01:06:24 on dist-test-slave-bndk"
server_key: "f07bcb57233077877c88f608e0327f99"
server_key_iv: "9ba511564d2735bddb80298ca44845ad"
server_key_version: "encryptionkey@0"
I20260812 01:06:24.861415 20644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance:
uuid: "60b4e07232144de387fbe716548d53cf"
format_stamp: "Formatted at 2026-08-12 01:06:24 on dist-test-slave-bndk"
server_key: "f07bcb57233077877c88f608e0327f99"
server_key_iv: "9ba511564d2735bddb80298ca44845ad"
server_key_version: "encryptionkey@0"
I20260812 01:06:24.866302 20644 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260812 01:06:24.869665 20670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:24.871028 20644 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 01:06:24.871181 20644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "60b4e07232144de387fbe716548d53cf"
format_stamp: "Formatted at 2026-08-12 01:06:24 on dist-test-slave-bndk"
server_key: "f07bcb57233077877c88f608e0327f99"
server_key_iv: "9ba511564d2735bddb80298ca44845ad"
server_key_version: "encryptionkey@0"
I20260812 01:06:24.871394 20644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:06:24.899195 20644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:06:24.899973 20644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:06:24.900238 20644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:06:24.901190 20644 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:06:24.902683 20644 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:06:24.902781 20644 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:24.902889 20644 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:06:24.902961 20644 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:24.939942 20644 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:34181
I20260812 01:06:24.940003 20844 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:34181 every 8 connection(s)
I20260812 01:06:24.941155 20644 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:06:24.951457 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 20644
I20260812 01:06:24.951654 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance
I20260812 01:06:24.952488 4901 external_mini_cluster.cc:1428] Setting key da51e17d091a5dad56a2dc22ca1855b3
I20260812 01:06:24.952953 20847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:24.943533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:39493 (local address 127.4.201.126:41643)
0812 01:06:24.943998 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:24.944006 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:24.945120 (+ 1114us) server_negotiation.cc:407] Connection header received
0812 01:06:24.946879 (+ 1759us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:24.946884 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:24.946953 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:24.947048 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:24.948014 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:24.948740 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:24.950241 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:24.950652 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:24.950750 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:24.952201 (+ 1451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:24.952206 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:24.952210 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:06:24.952227 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:24.952266 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:06:24.952279 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:24.952355 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:24.952615 (+ 260us) server_negotiation.cc:299] Negotiation successful
0812 01:06:24.952703 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":211,"threads_started":1}
I20260812 01:06:24.954182 20848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:24.944106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:41643 (local address 127.4.201.65:39493)
0812 01:06:24.944969 (+ 863us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:24.945017 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:24.946625 (+ 1608us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:24.947221 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:24.947228 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:24.947315 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:24.947877 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:24.947894 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:24.948859 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:24.948863 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:24.950117 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:24.950129 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:24.950822 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:24.950826 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:24.951090 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:24.951824 (+ 734us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:06:24.951828 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:24.951888 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:06:24.951985 (+ 97us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:06:24.952378 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:06:24.952389 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:06:24.952397 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 01:06:24.952611 (+ 214us) client_negotiation.cc:240] Negotiation successful
0812 01:06:24.952980 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":262,"threads_started":1}
I20260812 01:06:24.955405 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:0
--local_ip_for_outbound_sockets=127.4.201.66
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:41643
--builtin_ntp_servers=127.4.201.84:36521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 01:06:24.955874 20845 heartbeater.cc:347] Connected to a master server at 127.4.201.126:41643
I20260812 01:06:24.956176 20845 heartbeater.cc:464] Registering TS with master...
I20260812 01:06:24.957089 20845 heartbeater.cc:511] Master 127.4.201.126:41643 requested a full tablet report, sending...
I20260812 01:06:24.959157 20545 ts_manager.cc:194] Registered new tserver with Master: 60b4e07232144de387fbe716548d53cf (127.4.201.65:34181)
I20260812 01:06:24.960630 20545 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.201.65:39493
W20260812 01:06:25.288973 20849 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:06:25.289279 20849 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:06:25.289386 20849 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:06:25.296737 20849 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:06:25.296831 20849 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:06:25.296943 20849 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:06:25.305855 20849 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:36521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:41643
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:06:25.307093 20849 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:06:25.308876 20849 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:06:25.322180 20860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:25.322213 20863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:25.322258 20861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:06:25.323014 20849 server_base.cc:1034] running on GCE node
I20260812 01:06:25.323648 20849 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:06:25.324705 20849 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:06:25.325902 20849 hybrid_clock.cc:648] HybridClock initialized: now 1786496785325832 us; error 59 us; skew 500 ppm
I20260812 01:06:25.326210 20849 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:06:25.328413 20849 webserver.cc:460] Webserver started at http://127.4.201.66:41069/ using document root <none> and password file <none>
I20260812 01:06:25.329113 20849 fs_manager.cc:359] Metadata directory not provided
I20260812 01:06:25.329228 20849 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:06:25.329556 20849 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:06:25.332387 20849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/data/instance:
uuid: "a64094a3bcf14901a1323bf5e747ed11"
format_stamp: "Formatted at 2026-08-12 01:06:25 on dist-test-slave-bndk"
server_key: "b33521339d1de0a4fb397bec0a796ccc"
server_key_iv: "10bbb371f43de867522833422314c270"
server_key_version: "encryptionkey@0"
I20260812 01:06:25.333269 20849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance:
uuid: "a64094a3bcf14901a1323bf5e747ed11"
format_stamp: "Formatted at 2026-08-12 01:06:25 on dist-test-slave-bndk"
server_key: "b33521339d1de0a4fb397bec0a796ccc"
server_key_iv: "10bbb371f43de867522833422314c270"
server_key_version: "encryptionkey@0"
I20260812 01:06:25.338619 20849 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260812 01:06:25.342805 20874 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:25.344303 20849 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 01:06:25.344465 20849 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "a64094a3bcf14901a1323bf5e747ed11"
format_stamp: "Formatted at 2026-08-12 01:06:25 on dist-test-slave-bndk"
server_key: "b33521339d1de0a4fb397bec0a796ccc"
server_key_iv: "10bbb371f43de867522833422314c270"
server_key_version: "encryptionkey@0"
I20260812 01:06:25.344694 20849 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:06:25.363520 20849 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:06:25.364281 20849 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:06:25.364562 20849 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:06:25.365429 20849 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:06:25.366814 20849 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:06:25.366899 20849 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:25.366981 20849 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:06:25.367034 20849 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:25.396157 20849 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:37201
I20260812 01:06:25.396203 21052 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:37201 every 8 connection(s)
I20260812 01:06:25.397495 20849 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:06:25.401904 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 20849
I20260812 01:06:25.402048 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance
I20260812 01:06:25.402469 4901 external_mini_cluster.cc:1428] Setting key 991f0b19b737ca8ed11351c6205346e6
I20260812 01:06:25.405203 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:0
--local_ip_for_outbound_sockets=127.4.201.67
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:41643
--builtin_ntp_servers=127.4.201.84:36521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 01:06:25.409624 20847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:25.399959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:39383 (local address 127.4.201.126:41643)
0812 01:06:25.400158 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:25.400163 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:25.401536 (+ 1373us) server_negotiation.cc:407] Connection header received
0812 01:06:25.403398 (+ 1862us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:25.403404 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:25.403495 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:25.403584 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:25.404738 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:25.405538 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:25.407041 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:25.407437 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:25.407558 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:25.408817 (+ 1259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:25.408822 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:25.408825 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:06:25.408842 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:25.408873 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:06:25.408884 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:25.408958 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:25.409175 (+ 217us) server_negotiation.cc:299] Negotiation successful
0812 01:06:25.409294 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 01:06:25.410597 21057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:25.400489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:41643 (local address 127.4.201.66:39383)
0812 01:06:25.401384 (+ 895us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:25.401423 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:25.403126 (+ 1703us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:25.403820 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:25.403828 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:25.403911 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:25.404575 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:25.404595 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:25.405691 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:25.405695 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:25.406887 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:25.406900 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:25.407659 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:25.407668 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:25.407871 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:25.408517 (+ 646us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:06:25.408519 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:25.408559 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:06:25.408631 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:06:25.408979 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:06:25.408990 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:06:25.408996 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 01:06:25.409148 (+ 152us) client_negotiation.cc:240] Negotiation successful
0812 01:06:25.409542 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":256,"threads_started":1}
I20260812 01:06:25.411937 21055 heartbeater.cc:347] Connected to a master server at 127.4.201.126:41643
I20260812 01:06:25.412221 21055 heartbeater.cc:464] Registering TS with master...
I20260812 01:06:25.413043 21055 heartbeater.cc:511] Master 127.4.201.126:41643 requested a full tablet report, sending...
I20260812 01:06:25.414496 20545 ts_manager.cc:194] Registered new tserver with Master: a64094a3bcf14901a1323bf5e747ed11 (127.4.201.66:37201)
I20260812 01:06:25.415511 20545 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.201.66:39383
W20260812 01:06:25.734963 21061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:06:25.735221 21061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:06:25.735311 21061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:06:25.742200 21061 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:06:25.742287 21061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:06:25.742400 21061 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:06:25.751066 21061 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:36521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:41643
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:06:25.752252 21061 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:06:25.753947 21061 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:06:25.768285 21069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:25.768326 21070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:25.768240 21072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:06:25.769158 21061 server_base.cc:1034] running on GCE node
I20260812 01:06:25.769752 21061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:06:25.770625 21061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:06:25.771826 21061 hybrid_clock.cc:648] HybridClock initialized: now 1786496785771780 us; error 39 us; skew 500 ppm
I20260812 01:06:25.772117 21061 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:06:25.774245 21061 webserver.cc:460] Webserver started at http://127.4.201.67:45901/ using document root <none> and password file <none>
I20260812 01:06:25.774940 21061 fs_manager.cc:359] Metadata directory not provided
I20260812 01:06:25.775033 21061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:06:25.775359 21061 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:06:25.778162 21061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/data/instance:
uuid: "80cc994d37ed456082f67e249bd502b0"
format_stamp: "Formatted at 2026-08-12 01:06:25 on dist-test-slave-bndk"
server_key: "0fb2f1b4d5b8a8fa936038ba6b0d41e4"
server_key_iv: "5363336995dffc1c450cdbe17dc80053"
server_key_version: "encryptionkey@0"
I20260812 01:06:25.778905 21061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance:
uuid: "80cc994d37ed456082f67e249bd502b0"
format_stamp: "Formatted at 2026-08-12 01:06:25 on dist-test-slave-bndk"
server_key: "0fb2f1b4d5b8a8fa936038ba6b0d41e4"
server_key_iv: "5363336995dffc1c450cdbe17dc80053"
server_key_version: "encryptionkey@0"
I20260812 01:06:25.783993 21061 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260812 01:06:25.787263 21083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:25.788545 21061 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 01:06:25.788702 21061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "80cc994d37ed456082f67e249bd502b0"
format_stamp: "Formatted at 2026-08-12 01:06:25 on dist-test-slave-bndk"
server_key: "0fb2f1b4d5b8a8fa936038ba6b0d41e4"
server_key_iv: "5363336995dffc1c450cdbe17dc80053"
server_key_version: "encryptionkey@0"
I20260812 01:06:25.788899 21061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:06:25.813289 21061 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:06:25.814124 21061 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:06:25.814404 21061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:06:25.815338 21061 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:06:25.816768 21061 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:06:25.816857 21061 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:25.816965 21061 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:06:25.817034 21061 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:25.846820 21061 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:43197
I20260812 01:06:25.846887 21257 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:43197 every 8 connection(s)
I20260812 01:06:25.848071 21061 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:06:25.853798 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 21061
I20260812 01:06:25.853976 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance
I20260812 01:06:25.854555 4901 external_mini_cluster.cc:1428] Setting key 2598db9eff9282d0b94a129041276bce
I20260812 01:06:25.861477 20847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:25.850611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:39093 (local address 127.4.201.126:41643)
0812 01:06:25.850781 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:25.850786 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:25.852109 (+ 1323us) server_negotiation.cc:407] Connection header received
0812 01:06:25.853977 (+ 1868us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:25.853983 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:25.854069 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:25.854159 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:25.855554 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:25.856679 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:25.859177 (+ 2498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:25.859571 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:25.859667 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:25.860821 (+ 1154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:25.860827 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:25.860830 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:06:25.860847 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:25.860878 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:06:25.860889 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:25.860957 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:25.861131 (+ 174us) server_negotiation.cc:299] Negotiation successful
0812 01:06:25.861208 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 01:06:25.862447 21263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:25.851071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:41643 (local address 127.4.201.67:39093)
0812 01:06:25.851952 (+ 881us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:25.851994 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:25.853688 (+ 1694us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:25.854407 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:25.854418 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:25.854540 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:25.855316 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:25.855343 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:25.857697 (+ 2354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:25.857709 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:25.859044 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:25.859058 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:25.859747 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:25.859752 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:25.859939 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:25.860532 (+ 593us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:06:25.860534 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:25.860578 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:06:25.860655 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:06:25.860963 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:06:25.860983 (+ 20us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:06:25.860988 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 01:06:25.861117 (+ 129us) client_negotiation.cc:240] Negotiation successful
0812 01:06:25.861442 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":283,"threads_started":1}
I20260812 01:06:25.863632 21260 heartbeater.cc:347] Connected to a master server at 127.4.201.126:41643
I20260812 01:06:25.863890 21260 heartbeater.cc:464] Registering TS with master...
I20260812 01:06:25.864586 21260 heartbeater.cc:511] Master 127.4.201.126:41643 requested a full tablet report, sending...
I20260812 01:06:25.865909 20545 ts_manager.cc:194] Registered new tserver with Master: 80cc994d37ed456082f67e249bd502b0 (127.4.201.67:43197)
I20260812 01:06:25.866683 20545 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.201.67:39093
I20260812 01:06:25.870067 4901 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 01:06:25.876062 20847 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:25.874417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46646 (local address 127.4.201.126:41643)
0812 01:06:25.874593 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:25.874600 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:25.875122 (+ 522us) server_negotiation.cc:407] Connection header received
0812 01:06:25.875257 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:25.875261 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:25.875331 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:25.875403 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:25.875793 (+ 390us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46646: BlockingRecv error: recv got EOF from 127.0.0.1:46646 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 01:06:25.876235 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 20644
I20260812 01:06:25.883698 21276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:25.877052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45378 (local address 127.4.201.65:34181)
0812 01:06:25.878042 (+ 990us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:25.878049 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:25.878073 (+ 24us) server_negotiation.cc:407] Connection header received
0812 01:06:25.878124 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:25.878130 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:25.878305 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:25.878421 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:25.878767 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:25.879706 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:25.880928 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:25.881521 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:25.881617 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:25.882517 (+ 900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:25.882526 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:25.882538 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:06:25.883064 (+ 526us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:25.883109 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:06:25.883130 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:25.883232 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:25.883300 (+ 68us) server_negotiation.cc:299] Negotiation successful
0812 01:06:25.883409 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":860,"thread_start_us":736,"threads_started":1}
I20260812 01:06:25.884800 20838 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:06:25.965054 20845 heartbeater.cc:503] Master 127.4.201.126:41643 was elected leader, sending a full tablet report...
I20260812 01:06:25.966055 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 20644
W20260812 01:06:25.989327 20524 connection.cc:535] server connection from 127.4.201.65:39493 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 01:06:25.989674 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 20849
I20260812 01:06:25.997188 21280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:25.990510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54238 (local address 127.4.201.66:37201)
0812 01:06:25.991058 (+ 548us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:25.991065 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:25.991094 (+ 29us) server_negotiation.cc:407] Connection header received
0812 01:06:25.991163 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:25.991170 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:25.991409 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:25.991555 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:25.991900 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:25.992967 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:25.994288 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:25.994862 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:25.994993 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:25.995878 (+ 885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:25.995887 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:25.995901 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:06:25.996501 (+ 600us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:25.996554 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:06:25.996575 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:25.996664 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:25.996756 (+ 92us) server_negotiation.cc:299] Negotiation successful
0812 01:06:25.996883 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":267,"threads_started":1}
I20260812 01:06:25.998541 21045 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:06:26.078554 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 20849
I20260812 01:06:26.098274 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 21061
I20260812 01:06:26.106623 21282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:26.099347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37660 (local address 127.4.201.67:43197)
0812 01:06:26.100047 (+ 700us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:26.100054 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:26.100086 (+ 32us) server_negotiation.cc:407] Connection header received
0812 01:06:26.100156 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:26.100162 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:26.100424 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:26.100551 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:26.100969 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:26.102138 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:26.103385 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:26.103953 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:26.104057 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:26.105076 (+ 1019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:26.105086 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:26.105100 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:06:26.105853 (+ 753us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:26.105901 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:06:26.105922 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:26.106016 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:26.106131 (+ 115us) server_negotiation.cc:299] Negotiation successful
0812 01:06:26.106244 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":548,"thread_start_us":374,"threads_started":1}
I20260812 01:06:26.107884 21250 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:06:26.188308 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 21061
I20260812 01:06:26.210078 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 20499
I20260812 01:06:26.211369 20604 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:06:26.313341 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 20499
2026-08-12T01:06:26Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2469 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-12T01:06:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:06:26Z Disabled control of system clock
I20260812 01:06:26.399644 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:46485
--webserver_interface=127.4.201.126
--webserver_port=0
--builtin_ntp_servers=127.4.201.84:35373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:46485
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 01:06:26.728581 21290 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:06:26.728861 21290 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:06:26.728956 21290 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:06:26.736114 21290 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:06:26.736219 21290 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:06:26.736265 21290 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:06:26.736317 21290 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:06:26.736361 21290 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:06:26.745281 21290 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:35373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:46485
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:46485
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:06:26.746479 21290 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:06:26.748225 21290 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:06:26.759451 21298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:26.759404 21303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:26.759701 21297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:06:26.760336 21290 server_base.cc:1034] running on GCE node
I20260812 01:06:26.761040 21290 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:06:26.762449 21290 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:06:26.763728 21290 hybrid_clock.cc:648] HybridClock initialized: now 1786496786763587 us; error 50 us; skew 500 ppm
I20260812 01:06:26.764091 21290 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:06:26.766258 21290 webserver.cc:460] Webserver started at http://127.4.201.126:33271/ using document root <none> and password file <none>
I20260812 01:06:26.766929 21290 fs_manager.cc:359] Metadata directory not provided
I20260812 01:06:26.767032 21290 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:06:26.767338 21290 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:06:26.770201 21290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "bdb25b83a06d4b28bea5e031395162e6"
format_stamp: "Formatted at 2026-08-12 01:06:26 on dist-test-slave-bndk"
server_key: "a5dab31c5e033bf567c2d1075be46933"
server_key_iv: "37f1b13930d49e11be52a2d8f297d55f"
server_key_version: "encryptionkey@0"
I20260812 01:06:26.770970 21290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "bdb25b83a06d4b28bea5e031395162e6"
format_stamp: "Formatted at 2026-08-12 01:06:26 on dist-test-slave-bndk"
server_key: "a5dab31c5e033bf567c2d1075be46933"
server_key_iv: "37f1b13930d49e11be52a2d8f297d55f"
server_key_version: "encryptionkey@0"
I20260812 01:06:26.775836 21290 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260812 01:06:26.779083 21313 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:26.780354 21290 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 01:06:26.780532 21290 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "bdb25b83a06d4b28bea5e031395162e6"
format_stamp: "Formatted at 2026-08-12 01:06:26 on dist-test-slave-bndk"
server_key: "a5dab31c5e033bf567c2d1075be46933"
server_key_iv: "37f1b13930d49e11be52a2d8f297d55f"
server_key_version: "encryptionkey@0"
I20260812 01:06:26.780736 21290 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:06:26.786413 21290 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:06:26.787146 21290 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:06:26.787415 21290 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:06:26.804462 21290 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:46485
I20260812 01:06:26.804495 21400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:46485 every 8 connection(s)
I20260812 01:06:26.805862 21290 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:06:26.809501 21401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:06:26.813032 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 21290
I20260812 01:06:26.813247 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:06:26.813879 4901 external_mini_cluster.cc:1428] Setting key 8ff09936742911df4de8fb2d71ce4319
I20260812 01:06:26.820410 21401 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdb25b83a06d4b28bea5e031395162e6: Bootstrap starting.
I20260812 01:06:26.822219 21404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:26.815758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38362 (local address 127.4.201.126:46485)
0812 01:06:26.816762 (+ 1004us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:26.816773 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:26.816813 (+ 40us) server_negotiation.cc:407] Connection header received
0812 01:06:26.818873 (+ 2060us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:26.818896 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:26.819268 (+ 372us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:26.819584 (+ 316us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:26.820677 (+ 1093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:26.820683 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:26.820696 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:06:26.820710 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:26.820776 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:06:26.820793 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:26.820967 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:26.821087 (+ 120us) server_negotiation.cc:299] Negotiation successful
0812 01:06:26.821351 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":606,"thread_start_us":364,"threads_started":1}
I20260812 01:06:26.823648 21401 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bdb25b83a06d4b28bea5e031395162e6: Neither blocks nor log segments found. Creating new log.
I20260812 01:06:26.824680 21401 log.cc:824] T 00000000000000000000000000000000 P bdb25b83a06d4b28bea5e031395162e6: Log is configured to *not* fsync() on all Append() calls
I20260812 01:06:26.827508 21401 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdb25b83a06d4b28bea5e031395162e6: No bootstrap required, opened a new log
I20260812 01:06:26.834619 21401 raft_consensus.cc:348] T 00000000000000000000000000000000 P bdb25b83a06d4b28bea5e031395162e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdb25b83a06d4b28bea5e031395162e6" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 46485 } }
I20260812 01:06:26.834946 21401 raft_consensus.cc:374] T 00000000000000000000000000000000 P bdb25b83a06d4b28bea5e031395162e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:06:26.835022 21401 raft_consensus.cc:729] T 00000000000000000000000000000000 P bdb25b83a06d4b28bea5e031395162e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb25b83a06d4b28bea5e031395162e6, State: Initialized, Role: FOLLOWER
I20260812 01:06:26.835512 21401 consensus_queue.cc:260] T 00000000000000000000000000000000 P bdb25b83a06d4b28bea5e031395162e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdb25b83a06d4b28bea5e031395162e6" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 46485 } }
I20260812 01:06:26.835709 21401 raft_consensus.cc:388] T 00000000000000000000000000000000 P bdb25b83a06d4b28bea5e031395162e6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:06:26.835803 21401 raft_consensus.cc:482] T 00000000000000000000000000000000 P bdb25b83a06d4b28bea5e031395162e6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:06:26.835918 21401 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bdb25b83a06d4b28bea5e031395162e6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:06:26.837970 21401 raft_consensus.cc:504] T 00000000000000000000000000000000 P bdb25b83a06d4b28bea5e031395162e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdb25b83a06d4b28bea5e031395162e6" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 46485 } }
I20260812 01:06:26.838397 21401 leader_election.cc:302] T 00000000000000000000000000000000 P bdb25b83a06d4b28bea5e031395162e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bdb25b83a06d4b28bea5e031395162e6; no voters:
I20260812 01:06:26.838922 21401 leader_election.cc:288] T 00000000000000000000000000000000 P bdb25b83a06d4b28bea5e031395162e6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:06:26.839063 21406 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bdb25b83a06d4b28bea5e031395162e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:06:26.839716 21406 raft_consensus.cc:686] T 00000000000000000000000000000000 P bdb25b83a06d4b28bea5e031395162e6 [term 1 LEADER]: Becoming Leader. State: Replica: bdb25b83a06d4b28bea5e031395162e6, State: Running, Role: LEADER
I20260812 01:06:26.840284 21406 consensus_queue.cc:237] T 00000000000000000000000000000000 P bdb25b83a06d4b28bea5e031395162e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdb25b83a06d4b28bea5e031395162e6" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 46485 } }
I20260812 01:06:26.840926 21401 sys_catalog.cc:564] T 00000000000000000000000000000000 P bdb25b83a06d4b28bea5e031395162e6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:06:26.843201 21407 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdb25b83a06d4b28bea5e031395162e6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bdb25b83a06d4b28bea5e031395162e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdb25b83a06d4b28bea5e031395162e6" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 46485 } } }
I20260812 01:06:26.843230 21408 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdb25b83a06d4b28bea5e031395162e6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bdb25b83a06d4b28bea5e031395162e6. Latest consensus state: current_term: 1 leader_uuid: "bdb25b83a06d4b28bea5e031395162e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdb25b83a06d4b28bea5e031395162e6" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 46485 } } }
I20260812 01:06:26.843659 21407 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdb25b83a06d4b28bea5e031395162e6 [sys.catalog]: This master's current role is: LEADER
I20260812 01:06:26.843662 21408 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdb25b83a06d4b28bea5e031395162e6 [sys.catalog]: This master's current role is: LEADER
I20260812 01:06:26.845108 21415 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:06:26.849298 21415 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:06:26.858549 21415 catalog_manager.cc:1347] Generated new cluster ID: 83ed7bcbf5cd4ccbbfef8227247b44dc
I20260812 01:06:26.858924 21415 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:06:26.875429 21415 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:06:26.875912 21415 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:06:26.886677 21415 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bdb25b83a06d4b28bea5e031395162e6: Generated new TSK 0
I20260812 01:06:26.887630 21415 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:06:26.893920 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:0
--local_ip_for_outbound_sockets=127.4.201.65
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:46485
--builtin_ntp_servers=127.4.201.84:35373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 01:06:27.227519 21437 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:06:27.227828 21437 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:06:27.227953 21437 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:06:27.235229 21437 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:06:27.235345 21437 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:06:27.235504 21437 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:06:27.244460 21437 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:35373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:46485
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:06:27.245739 21437 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:06:27.247560 21437 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:06:27.260571 21446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:27.260489 21447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:27.260449 21450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:06:27.261549 21437 server_base.cc:1034] running on GCE node
I20260812 01:06:27.262156 21437 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:06:27.263080 21437 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:06:27.264274 21437 hybrid_clock.cc:648] HybridClock initialized: now 1786496787264220 us; error 43 us; skew 500 ppm
I20260812 01:06:27.264595 21437 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:06:27.266754 21437 webserver.cc:460] Webserver started at http://127.4.201.65:34975/ using document root <none> and password file <none>
I20260812 01:06:27.267419 21437 fs_manager.cc:359] Metadata directory not provided
I20260812 01:06:27.267534 21437 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:06:27.267855 21437 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:06:27.273164 21437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/data/instance:
uuid: "5156e94af9534def82aacc13cee6525d"
format_stamp: "Formatted at 2026-08-12 01:06:27 on dist-test-slave-bndk"
server_key: "4a27aa9eafe0652aeb74ff69cb326dcd"
server_key_iv: "80deb733958d52f2bb8f015cf4c23a0d"
server_key_version: "encryptionkey@0"
I20260812 01:06:27.273985 21437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance:
uuid: "5156e94af9534def82aacc13cee6525d"
format_stamp: "Formatted at 2026-08-12 01:06:27 on dist-test-slave-bndk"
server_key: "4a27aa9eafe0652aeb74ff69cb326dcd"
server_key_iv: "80deb733958d52f2bb8f015cf4c23a0d"
server_key_version: "encryptionkey@0"
I20260812 01:06:27.279073 21437 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 01:06:27.282373 21459 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:27.283615 21437 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 01:06:27.283780 21437 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "5156e94af9534def82aacc13cee6525d"
format_stamp: "Formatted at 2026-08-12 01:06:27 on dist-test-slave-bndk"
server_key: "4a27aa9eafe0652aeb74ff69cb326dcd"
server_key_iv: "80deb733958d52f2bb8f015cf4c23a0d"
server_key_version: "encryptionkey@0"
I20260812 01:06:27.283979 21437 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:06:27.289592 21437 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:06:27.290403 21437 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:06:27.290659 21437 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:06:27.291594 21437 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:06:27.292958 21437 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:06:27.293057 21437 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:27.293166 21437 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:06:27.293255 21437 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:27.322301 21437 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:33819
I20260812 01:06:27.322345 21622 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:33819 every 8 connection(s)
I20260812 01:06:27.323597 21437 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:06:27.331279 21627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:27.326133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:42711 (local address 127.4.201.126:46485)
0812 01:06:27.326542 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:27.326546 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:27.327724 (+ 1178us) server_negotiation.cc:407] Connection header received
0812 01:06:27.329371 (+ 1647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:27.329376 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:27.329432 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:27.329526 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:27.330718 (+ 1192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:27.330722 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:27.330725 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:06:27.330740 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:27.330779 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:06:27.330791 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:27.330893 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:27.331026 (+ 133us) server_negotiation.cc:299] Negotiation successful
0812 01:06:27.331071 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":186,"threads_started":1}
I20260812 01:06:27.332175 21629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:27.326703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:46485 (local address 127.4.201.65:42711)
0812 01:06:27.327577 (+ 874us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:27.327612 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:27.329096 (+ 1484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:27.329718 (+ 622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:27.329726 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:27.329811 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:27.330422 (+ 611us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:06:27.330425 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:27.330466 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:06:27.330566 (+ 100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:06:27.330875 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:06:27.330880 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:06:27.330885 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 01:06:27.331087 (+ 202us) client_negotiation.cc:240] Negotiation successful
0812 01:06:27.331272 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":261,"threads_started":1}
I20260812 01:06:27.332257 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 21437
I20260812 01:06:27.332451 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance
I20260812 01:06:27.333189 4901 external_mini_cluster.cc:1428] Setting key 600d80b485ca4f00c15ed543e11847e7
I20260812 01:06:27.333664 21624 heartbeater.cc:347] Connected to a master server at 127.4.201.126:46485
I20260812 01:06:27.333956 21624 heartbeater.cc:464] Registering TS with master...
I20260812 01:06:27.334647 21624 heartbeater.cc:511] Master 127.4.201.126:46485 requested a full tablet report, sending...
I20260812 01:06:27.336050 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:0
--local_ip_for_outbound_sockets=127.4.201.66
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:46485
--builtin_ntp_servers=127.4.201.84:35373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260812 01:06:27.336712 21347 ts_manager.cc:194] Registered new tserver with Master: 5156e94af9534def82aacc13cee6525d (127.4.201.65:33819)
W20260812 01:06:27.664781 21632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:06:27.665063 21632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:06:27.665159 21632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:06:27.672205 21632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:06:27.672304 21632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:06:27.672425 21632 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:06:27.681452 21632 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:35373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:46485
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:06:27.682672 21632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:06:27.684454 21632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:06:27.698743 21640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:27.699357 21644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:27.699512 21642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:06:27.700142 21632 server_base.cc:1034] running on GCE node
I20260812 01:06:27.700745 21632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:06:27.701717 21632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:06:27.702913 21632 hybrid_clock.cc:648] HybridClock initialized: now 1786496787702869 us; error 40 us; skew 500 ppm
I20260812 01:06:27.703223 21632 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:06:27.705425 21632 webserver.cc:460] Webserver started at http://127.4.201.66:42797/ using document root <none> and password file <none>
I20260812 01:06:27.706100 21632 fs_manager.cc:359] Metadata directory not provided
I20260812 01:06:27.706202 21632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:06:27.706535 21632 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:06:27.709353 21632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/data/instance:
uuid: "ce406e3311c6487ca0d496818d91d59e"
format_stamp: "Formatted at 2026-08-12 01:06:27 on dist-test-slave-bndk"
server_key: "ea046dfebea3e9599e6e28ebe83594a1"
server_key_iv: "592bfaf9179b481ac5fb2b0013648ba8"
server_key_version: "encryptionkey@0"
I20260812 01:06:27.710129 21632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance:
uuid: "ce406e3311c6487ca0d496818d91d59e"
format_stamp: "Formatted at 2026-08-12 01:06:27 on dist-test-slave-bndk"
server_key: "ea046dfebea3e9599e6e28ebe83594a1"
server_key_iv: "592bfaf9179b481ac5fb2b0013648ba8"
server_key_version: "encryptionkey@0"
I20260812 01:06:27.715138 21632 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 01:06:27.718386 21657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:27.719646 21632 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 01:06:27.719810 21632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "ce406e3311c6487ca0d496818d91d59e"
format_stamp: "Formatted at 2026-08-12 01:06:27 on dist-test-slave-bndk"
server_key: "ea046dfebea3e9599e6e28ebe83594a1"
server_key_iv: "592bfaf9179b481ac5fb2b0013648ba8"
server_key_version: "encryptionkey@0"
I20260812 01:06:27.720019 21632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:06:27.725960 21632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:06:27.726737 21632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:06:27.726992 21632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:06:27.727888 21632 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:06:27.729322 21632 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:06:27.729421 21632 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:27.729529 21632 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:06:27.729604 21632 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:27.759461 21632 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:42499
I20260812 01:06:27.759492 21841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:42499 every 8 connection(s)
I20260812 01:06:27.760823 21632 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:06:27.762176 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 21632
I20260812 01:06:27.762370 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance
I20260812 01:06:27.762895 4901 external_mini_cluster.cc:1428] Setting key c02e47d49489c373b44402c1c21fbe8b
I20260812 01:06:27.765777 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:0
--local_ip_for_outbound_sockets=127.4.201.67
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:46485
--builtin_ntp_servers=127.4.201.84:35373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260812 01:06:27.771169 21627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:27.763626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:51953 (local address 127.4.201.126:46485)
0812 01:06:27.763863 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:27.763870 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:27.767186 (+ 3316us) server_negotiation.cc:407] Connection header received
0812 01:06:27.768898 (+ 1712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:27.768904 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:27.768988 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:27.769080 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:27.770431 (+ 1351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:27.770438 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:27.770442 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:06:27.770459 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:27.770501 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:06:27.770513 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:27.770619 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:27.770804 (+ 185us) server_negotiation.cc:299] Negotiation successful
0812 01:06:27.770875 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 01:06:27.772123 21845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:27.764252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:46485 (local address 127.4.201.66:51953)
0812 01:06:27.767032 (+ 2780us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:27.767069 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:27.768630 (+ 1561us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:27.769365 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:27.769374 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:27.769487 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:27.770133 (+ 646us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:06:27.770135 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:27.770176 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:06:27.770265 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:06:27.770601 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:06:27.770613 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:06:27.770621 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 01:06:27.770881 (+ 260us) client_negotiation.cc:240] Negotiation successful
0812 01:06:27.771158 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2307,"thread_start_us":2130,"threads_started":1}
I20260812 01:06:27.773545 21842 heartbeater.cc:347] Connected to a master server at 127.4.201.126:46485
I20260812 01:06:27.773830 21842 heartbeater.cc:464] Registering TS with master...
I20260812 01:06:27.774402 21842 heartbeater.cc:511] Master 127.4.201.126:46485 requested a full tablet report, sending...
I20260812 01:06:27.775777 21347 ts_manager.cc:194] Registered new tserver with Master: ce406e3311c6487ca0d496818d91d59e (127.4.201.66:42499)
W20260812 01:06:28.102511 21849 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:06:28.102772 21849 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:06:28.102866 21849 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:06:28.109928 21849 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:06:28.110023 21849 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:06:28.110138 21849 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:06:28.118992 21849 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:35373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:46485
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:06:28.120252 21849 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:06:28.122012 21849 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:06:28.134338 21860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:28.134384 21862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:28.134408 21864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:06:28.135603 21849 server_base.cc:1034] running on GCE node
I20260812 01:06:28.136133 21849 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:06:28.136984 21849 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:06:28.138175 21849 hybrid_clock.cc:648] HybridClock initialized: now 1786496788138107 us; error 60 us; skew 500 ppm
I20260812 01:06:28.138451 21849 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:06:28.140552 21849 webserver.cc:460] Webserver started at http://127.4.201.67:36021/ using document root <none> and password file <none>
I20260812 01:06:28.141191 21849 fs_manager.cc:359] Metadata directory not provided
I20260812 01:06:28.141319 21849 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:06:28.141637 21849 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:06:28.144399 21849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/data/instance:
uuid: "9b11657c6524427a8dbbd7557372eba1"
format_stamp: "Formatted at 2026-08-12 01:06:28 on dist-test-slave-bndk"
server_key: "d055406541dfb38328d9d65c70aee8d7"
server_key_iv: "ef95f8b12eea01076f179836ae05b595"
server_key_version: "encryptionkey@0"
I20260812 01:06:28.145149 21849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance:
uuid: "9b11657c6524427a8dbbd7557372eba1"
format_stamp: "Formatted at 2026-08-12 01:06:28 on dist-test-slave-bndk"
server_key: "d055406541dfb38328d9d65c70aee8d7"
server_key_iv: "ef95f8b12eea01076f179836ae05b595"
server_key_version: "encryptionkey@0"
I20260812 01:06:28.150121 21849 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260812 01:06:28.153604 21875 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:28.154865 21849 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 01:06:28.155023 21849 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "9b11657c6524427a8dbbd7557372eba1"
format_stamp: "Formatted at 2026-08-12 01:06:28 on dist-test-slave-bndk"
server_key: "d055406541dfb38328d9d65c70aee8d7"
server_key_iv: "ef95f8b12eea01076f179836ae05b595"
server_key_version: "encryptionkey@0"
I20260812 01:06:28.155223 21849 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:06:28.160631 21849 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:06:28.161454 21849 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:06:28.161708 21849 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:06:28.162626 21849 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:06:28.164003 21849 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:06:28.164098 21849 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:28.164204 21849 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:06:28.164275 21849 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:28.199504 21849 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:38233
I20260812 01:06:28.199554 22050 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:38233 every 8 connection(s)
I20260812 01:06:28.200877 21849 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:06:28.203336 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 21849
I20260812 01:06:28.203532 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance
I20260812 01:06:28.204054 4901 external_mini_cluster.cc:1428] Setting key fa7f6a4f6bf599a902f3fc765a84c2fd
I20260812 01:06:28.209518 21627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:28.203493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:38855 (local address 127.4.201.126:46485)
0812 01:06:28.203651 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:28.203656 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:28.205460 (+ 1804us) server_negotiation.cc:407] Connection header received
0812 01:06:28.207386 (+ 1926us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:28.207391 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:28.207459 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:28.207551 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:28.208788 (+ 1237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:28.208795 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:28.208799 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:06:28.208817 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:28.208848 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:06:28.208860 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:28.208964 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:28.209144 (+ 180us) server_negotiation.cc:299] Negotiation successful
0812 01:06:28.209209 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 01:06:28.210388 22059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:28.204192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:46485 (local address 127.4.201.67:38855)
0812 01:06:28.205307 (+ 1115us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:28.205358 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:28.207140 (+ 1782us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:28.207786 (+ 646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:28.207793 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:28.207881 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:28.208503 (+ 622us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:06:28.208505 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:28.208543 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:06:28.208630 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:06:28.208945 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:06:28.208956 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:06:28.208963 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 01:06:28.209243 (+ 280us) client_negotiation.cc:240] Negotiation successful
0812 01:06:28.209506 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":342,"threads_started":1}
I20260812 01:06:28.211575 22052 heartbeater.cc:347] Connected to a master server at 127.4.201.126:46485
I20260812 01:06:28.211890 22052 heartbeater.cc:464] Registering TS with master...
I20260812 01:06:28.212478 22052 heartbeater.cc:511] Master 127.4.201.126:46485 requested a full tablet report, sending...
I20260812 01:06:28.213872 21347 ts_manager.cc:194] Registered new tserver with Master: 9b11657c6524427a8dbbd7557372eba1 (127.4.201.67:38233)
I20260812 01:06:28.219280 4901 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 01:06:28.225245 21627 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:06:28.223786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38366 (local address 127.4.201.126:46485)
0812 01:06:28.223935 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:28.223939 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:28.224435 (+ 496us) server_negotiation.cc:407] Connection header received
0812 01:06:28.224585 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:28.224589 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:28.224641 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:28.224720 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:28.225019 (+ 299us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38366: BlockingRecv error: recv got EOF from 127.0.0.1:38366 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 01:06:28.225904 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 21437
I20260812 01:06:28.229128 22071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:28.226872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39552 (local address 127.4.201.65:33819)
0812 01:06:28.227380 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:28.227395 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:28.227421 (+ 26us) server_negotiation.cc:407] Connection header received
0812 01:06:28.227477 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:28.227491 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:28.227685 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:28.227805 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:28.228560 (+ 755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:28.228567 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:28.228578 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:06:28.228595 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:28.228635 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:06:28.228649 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:28.228752 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:28.228808 (+ 56us) server_negotiation.cc:299] Negotiation successful
0812 01:06:28.228885 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":233,"threads_started":1}
I20260812 01:06:28.230320 21611 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:06:28.310824 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 21437
I20260812 01:06:28.336992 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 21632
I20260812 01:06:28.340422 22074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:28.337917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34770 (local address 127.4.201.66:42499)
0812 01:06:28.338468 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:28.338486 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:28.338516 (+ 30us) server_negotiation.cc:407] Connection header received
0812 01:06:28.338595 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:28.338601 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:28.338824 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:28.338954 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:28.339841 (+ 887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:28.339847 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:28.339859 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:06:28.339878 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:28.339918 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:06:28.339931 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:28.340039 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:28.340091 (+ 52us) server_negotiation.cc:299] Negotiation successful
0812 01:06:28.340177 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":254,"threads_started":1}
I20260812 01:06:28.341770 21836 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:06:28.420787 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 21632
I20260812 01:06:28.441659 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 21849
I20260812 01:06:28.445163 22077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:28.442593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38702 (local address 127.4.201.67:38233)
0812 01:06:28.443213 (+ 620us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:28.443219 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:28.443252 (+ 33us) server_negotiation.cc:407] Connection header received
0812 01:06:28.443317 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:28.443323 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:28.443541 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:28.443671 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:28.444538 (+ 867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:28.444546 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:28.444558 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:06:28.444569 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:28.444611 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:06:28.444627 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:28.444757 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:28.444805 (+ 48us) server_negotiation.cc:299] Negotiation successful
0812 01:06:28.444900 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":287,"threads_started":1}
I20260812 01:06:28.446383 22045 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:06:28.525614 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 21849
I20260812 01:06:28.549093 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 21290
I20260812 01:06:28.550348 21394 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:06:28.652966 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 21290
2026-08-12T01:06:28Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2339 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:06:28 dist-test-slave-bndk krb5kdc[22083](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:06:28 dist-test-slave-bndk krb5kdc[22083](info): set up 2 sockets
Aug 12 01:06:28 dist-test-slave-bndk krb5kdc[22083](info): commencing operation
krb5kdc: starting...
W20260812 01:06:29.890050 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.190s user 0.000s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:06:30 dist-test-slave-bndk krb5kdc[22083](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496790, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:06:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:06:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.201.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
I20260812 01:06:30.154721 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:44525
--webserver_interface=127.4.201.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:40561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:44525
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:06:30.486438 22108 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:06:30.486706 22108 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:06:30.486840 22108 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:06:30.493880 22108 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:06:30.493981 22108 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:06:30.494053 22108 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:06:30.494124 22108 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:06:30.494184 22108 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:06:30.503643 22108 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:40561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:44525
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:44525
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:06:30.504999 22108 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:06:30.506354 22108 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:06:30.517498 22115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:30.517475 22116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:30.517428 22118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:06:30.518399 22108 server_base.cc:1034] running on GCE node
I20260812 01:06:30.519150 22108 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:06:30.520525 22108 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:06:30.521718 22108 hybrid_clock.cc:648] HybridClock initialized: now 1786496790521670 us; error 34 us; skew 500 ppm
I20260812 01:06:30.522056 22108 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:06:30 dist-test-slave-bndk krb5kdc[22083](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496790, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:06:30.529338 22108 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:06:30.530802 22108 webserver.cc:460] Webserver started at http://127.4.201.126:35413/ using document root <none> and password file <none>
I20260812 01:06:30.531499 22108 fs_manager.cc:359] Metadata directory not provided
I20260812 01:06:30.531623 22108 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:06:30.531929 22108 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:06:30.535079 22108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "3b58ac4e6f9c46cb97bc497bbb07ed6d"
format_stamp: "Formatted at 2026-08-12 01:06:30 on dist-test-slave-bndk"
server_key: "53ffbcfb285d5fff788c7ec65588c783"
server_key_iv: "8199dd7d88e7187fa41920417127973a"
server_key_version: "encryptionkey@0"
I20260812 01:06:30.535936 22108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "3b58ac4e6f9c46cb97bc497bbb07ed6d"
format_stamp: "Formatted at 2026-08-12 01:06:30 on dist-test-slave-bndk"
server_key: "53ffbcfb285d5fff788c7ec65588c783"
server_key_iv: "8199dd7d88e7187fa41920417127973a"
server_key_version: "encryptionkey@0"
I20260812 01:06:30.541108 22108 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260812 01:06:30.544359 22129 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:30.545641 22108 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:06:30.545805 22108 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "3b58ac4e6f9c46cb97bc497bbb07ed6d"
format_stamp: "Formatted at 2026-08-12 01:06:30 on dist-test-slave-bndk"
server_key: "53ffbcfb285d5fff788c7ec65588c783"
server_key_iv: "8199dd7d88e7187fa41920417127973a"
server_key_version: "encryptionkey@0"
I20260812 01:06:30.545986 22108 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:06:30.562819 22108 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:06:30.566524 22108 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:06:30.566781 22108 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:06:30.583762 22108 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:44525
I20260812 01:06:30.583799 22217 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:44525 every 8 connection(s)
I20260812 01:06:30.585085 22108 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:06:30.588773 22220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:06:30.589051 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 22108
I20260812 01:06:30.589309 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:06:30.590135 4901 external_mini_cluster.cc:1428] Setting key 79d596d1027775d552a654ec7fa2eda9
I20260812 01:06:30.601751 22220 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b58ac4e6f9c46cb97bc497bbb07ed6d: Bootstrap starting.
Aug 12 01:06:30 dist-test-slave-bndk krb5kdc[22083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496790, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:06:30.604929 22220 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b58ac4e6f9c46cb97bc497bbb07ed6d: Neither blocks nor log segments found. Creating new log.
I20260812 01:06:30.606253 22220 log.cc:824] T 00000000000000000000000000000000 P 3b58ac4e6f9c46cb97bc497bbb07ed6d: Log is configured to *not* fsync() on all Append() calls
I20260812 01:06:30.609588 22220 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b58ac4e6f9c46cb97bc497bbb07ed6d: No bootstrap required, opened a new log
I20260812 01:06:30.613457 22226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:30.592312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41492 (local address 127.4.201.126:44525)
0812 01:06:30.593073 (+ 761us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:30.593084 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:30.593124 (+ 40us) server_negotiation.cc:407] Connection header received
0812 01:06:30.595095 (+ 1971us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:30.595119 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:30.595500 (+ 381us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:30.595868 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:30.597633 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:30.598998 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:30.600327 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:30.601001 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:30.601165 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:30.605234 (+ 4069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:30.605248 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:30.605274 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:06:30.605325 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:30.609027 (+ 3702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:30.609717 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:30.609725 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:30.609733 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:30.609932 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:30.610308 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:30.610314 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:30.610317 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:30.611026 (+ 709us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:30.611348 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:30.611650 (+ 302us) server_negotiation.cc:299] Negotiation successful
0812 01:06:30.612104 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":548,"thread_start_us":320,"threads_started":1}
I20260812 01:06:30.618366 22220 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b58ac4e6f9c46cb97bc497bbb07ed6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b58ac4e6f9c46cb97bc497bbb07ed6d" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44525 } }
I20260812 01:06:30.618790 22220 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3b58ac4e6f9c46cb97bc497bbb07ed6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:06:30.618914 22220 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b58ac4e6f9c46cb97bc497bbb07ed6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b58ac4e6f9c46cb97bc497bbb07ed6d, State: Initialized, Role: FOLLOWER
I20260812 01:06:30.619552 22220 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b58ac4e6f9c46cb97bc497bbb07ed6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b58ac4e6f9c46cb97bc497bbb07ed6d" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44525 } }
I20260812 01:06:30.619796 22220 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3b58ac4e6f9c46cb97bc497bbb07ed6d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:06:30.619925 22220 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3b58ac4e6f9c46cb97bc497bbb07ed6d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:06:30.620112 22220 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b58ac4e6f9c46cb97bc497bbb07ed6d [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:06:30.622278 22220 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3b58ac4e6f9c46cb97bc497bbb07ed6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b58ac4e6f9c46cb97bc497bbb07ed6d" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44525 } }
I20260812 01:06:30.622737 22220 leader_election.cc:302] T 00000000000000000000000000000000 P 3b58ac4e6f9c46cb97bc497bbb07ed6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3b58ac4e6f9c46cb97bc497bbb07ed6d; no voters:
I20260812 01:06:30.623268 22220 leader_election.cc:288] T 00000000000000000000000000000000 P 3b58ac4e6f9c46cb97bc497bbb07ed6d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:06:30.623376 22230 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3b58ac4e6f9c46cb97bc497bbb07ed6d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:06:30.624004 22230 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3b58ac4e6f9c46cb97bc497bbb07ed6d [term 1 LEADER]: Becoming Leader. State: Replica: 3b58ac4e6f9c46cb97bc497bbb07ed6d, State: Running, Role: LEADER
I20260812 01:06:30.624516 22230 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3b58ac4e6f9c46cb97bc497bbb07ed6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b58ac4e6f9c46cb97bc497bbb07ed6d" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44525 } }
I20260812 01:06:30.625357 22220 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b58ac4e6f9c46cb97bc497bbb07ed6d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:06:30.627357 22233 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b58ac4e6f9c46cb97bc497bbb07ed6d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b58ac4e6f9c46cb97bc497bbb07ed6d. Latest consensus state: current_term: 1 leader_uuid: "3b58ac4e6f9c46cb97bc497bbb07ed6d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b58ac4e6f9c46cb97bc497bbb07ed6d" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44525 } } }
I20260812 01:06:30.627388 22232 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b58ac4e6f9c46cb97bc497bbb07ed6d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3b58ac4e6f9c46cb97bc497bbb07ed6d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b58ac4e6f9c46cb97bc497bbb07ed6d" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44525 } } }
I20260812 01:06:30.627662 22233 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b58ac4e6f9c46cb97bc497bbb07ed6d [sys.catalog]: This master's current role is: LEADER
I20260812 01:06:30.627737 22232 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b58ac4e6f9c46cb97bc497bbb07ed6d [sys.catalog]: This master's current role is: LEADER
I20260812 01:06:30.634109 22239 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:06:30.639065 22239 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:06:30.648106 22239 catalog_manager.cc:1347] Generated new cluster ID: 3e59e1f25f4841f5a454811ef0430b81
I20260812 01:06:30.648224 22239 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:06:30.667034 22239 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:06:30.668318 22239 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:06:30.675865 22239 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3b58ac4e6f9c46cb97bc497bbb07ed6d: Generated new TSK 0
I20260812 01:06:30.676627 22239 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.201.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
I20260812 01:06:30.748292 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:0
--local_ip_for_outbound_sockets=127.4.201.65
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:44525
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:40561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:06:31.080621 22256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:06:31.080889 22256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:06:31.081027 22256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:06:31.088037 22256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:06:31.088141 22256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:06:31.088303 22256 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:06:31.097724 22256 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:40561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:44525
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:06:31.098954 22256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:06:31.100288 22256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:06:31.114257 22270 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:31.114493 22273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:31.114259 22271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:06:31.115254 22256 server_base.cc:1034] running on GCE node
I20260812 01:06:31.115799 22256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:06:31.116688 22256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:06:31.117888 22256 hybrid_clock.cc:648] HybridClock initialized: now 1786496791117838 us; error 36 us; skew 500 ppm
I20260812 01:06:31.118216 22256 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:06:31 dist-test-slave-bndk krb5kdc[22083](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496791, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:06:31.121320 22256 init.cc:377] Logged in from keytab as kudu/127.4.201.65@KRBTEST.COM (short username kudu)
I20260812 01:06:31.122675 22256 webserver.cc:460] Webserver started at http://127.4.201.65:40869/ using document root <none> and password file <none>
I20260812 01:06:31.123384 22256 fs_manager.cc:359] Metadata directory not provided
I20260812 01:06:31.123486 22256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:06:31.123739 22256 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:06:31.126686 22256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/data/instance:
uuid: "061ab660aa44422cb65269a13432fb64"
format_stamp: "Formatted at 2026-08-12 01:06:31 on dist-test-slave-bndk"
server_key: "419e32cd00015e8f8ab3b01be15cee2f"
server_key_iv: "d6e1e0e231eb425bea77221161305761"
server_key_version: "encryptionkey@0"
I20260812 01:06:31.127422 22256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance:
uuid: "061ab660aa44422cb65269a13432fb64"
format_stamp: "Formatted at 2026-08-12 01:06:31 on dist-test-slave-bndk"
server_key: "419e32cd00015e8f8ab3b01be15cee2f"
server_key_iv: "d6e1e0e231eb425bea77221161305761"
server_key_version: "encryptionkey@0"
I20260812 01:06:31.132728 22256 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260812 01:06:31.136101 22280 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:31.137482 22256 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:06:31.137632 22256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "061ab660aa44422cb65269a13432fb64"
format_stamp: "Formatted at 2026-08-12 01:06:31 on dist-test-slave-bndk"
server_key: "419e32cd00015e8f8ab3b01be15cee2f"
server_key_iv: "d6e1e0e231eb425bea77221161305761"
server_key_version: "encryptionkey@0"
I20260812 01:06:31.137806 22256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:06:31.159416 22256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:06:31.163215 22256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:06:31.163486 22256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:06:31.164407 22256 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:06:31.165761 22256 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:06:31.165851 22256 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:31.165978 22256 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:06:31.166031 22256 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:31.195982 22256 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:34547
I20260812 01:06:31.196030 22465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:34547 every 8 connection(s)
I20260812 01:06:31.197304 22256 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:06:31.204658 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 22256
I20260812 01:06:31.204883 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance
I20260812 01:06:31.205689 4901 external_mini_cluster.cc:1428] Setting key 6bb418e72a2b74a5a0999a31cb76c405
Aug 12 01:06:31 dist-test-slave-bndk krb5kdc[22083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496791, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:06:31.217512 22468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:31.200048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:54843 (local address 127.4.201.126:44525)
0812 01:06:31.200530 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:31.200537 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:31.201517 (+ 980us) server_negotiation.cc:407] Connection header received
0812 01:06:31.203308 (+ 1791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:31.203312 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:31.203390 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:31.203497 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:31.205365 (+ 1868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:31.206212 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:31.207790 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:31.208188 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:31.208282 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:31.212024 (+ 3742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:31.212029 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:31.212032 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:06:31.212063 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:31.214513 (+ 2450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:31.215216 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:31.215220 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:31.215222 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:31.215347 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:31.215764 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:31.215768 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:31.215770 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:31.216049 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:31.216183 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:31.216887 (+ 704us) server_negotiation.cc:299] Negotiation successful
0812 01:06:31.217118 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":212,"threads_started":1}
I20260812 01:06:31.218418 22470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:31.200594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:44525 (local address 127.4.201.65:54843)
0812 01:06:31.201367 (+ 773us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:31.201407 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:31.203054 (+ 1647us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:31.203695 (+ 641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:31.203703 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:31.204319 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:31.205151 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:31.205188 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:31.206372 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:31.206376 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:31.207624 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:31.207640 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:31.208410 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:31.208417 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:31.208683 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:31.209372 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:31.209400 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:31.211810 (+ 2410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:06:31.214645 (+ 2835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:06:31.214653 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:06:31.214669 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:06:31.215092 (+ 423us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:06:31.215451 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:06:31.215456 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:06:31.215460 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:06:31.215647 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:06:31.216174 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:06:31.216182 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:06:31.216507 (+ 325us) client_negotiation.cc:769] Sending connection context
0812 01:06:31.216744 (+ 237us) client_negotiation.cc:240] Negotiation successful
0812 01:06:31.217300 (+ 556us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":266,"threads_started":1}
I20260812 01:06:31.220010 22466 heartbeater.cc:347] Connected to a master server at 127.4.201.126:44525
I20260812 01:06:31.220310 22466 heartbeater.cc:464] Registering TS with master...
I20260812 01:06:31.221030 22466 heartbeater.cc:511] Master 127.4.201.126:44525 requested a full tablet report, sending...
I20260812 01:06:31.223449 22149 ts_manager.cc:194] Registered new tserver with Master: 061ab660aa44422cb65269a13432fb64 (127.4.201.65:34547)
I20260812 01:06:31.225409 22149 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.65@KRBTEST.COM'} at 127.4.201.65:54843
WARNING: no policy specified for kudu/127.4.201.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
I20260812 01:06:31.266542 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:0
--local_ip_for_outbound_sockets=127.4.201.66
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:44525
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:40561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:06:31.603350 22476 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:06:31.603698 22476 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:06:31.603845 22476 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:06:31.611812 22476 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:06:31.611912 22476 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:06:31.612028 22476 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:06:31.621387 22476 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:40561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:44525
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:06:31.622612 22476 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:06:31.623834 22476 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:06:31.636307 22491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:31.636334 22487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:31.636410 22486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:06:31.637296 22476 server_base.cc:1034] running on GCE node
I20260812 01:06:31.637877 22476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:06:31.638713 22476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:06:31.639896 22476 hybrid_clock.cc:648] HybridClock initialized: now 1786496791639846 us; error 44 us; skew 500 ppm
I20260812 01:06:31.640193 22476 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:06:31 dist-test-slave-bndk krb5kdc[22083](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496791, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:06:31.643446 22476 init.cc:377] Logged in from keytab as kudu/127.4.201.66@KRBTEST.COM (short username kudu)
I20260812 01:06:31.644701 22476 webserver.cc:460] Webserver started at http://127.4.201.66:39475/ using document root <none> and password file <none>
I20260812 01:06:31.645375 22476 fs_manager.cc:359] Metadata directory not provided
I20260812 01:06:31.645483 22476 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:06:31.645743 22476 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:06:31.648545 22476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/data/instance:
uuid: "8fe82a6ceff141e0917ed09e2cafe332"
format_stamp: "Formatted at 2026-08-12 01:06:31 on dist-test-slave-bndk"
server_key: "eb58af26e445528140318ca1f6629517"
server_key_iv: "be0ee97c119b061fc16fcf7f5c460a58"
server_key_version: "encryptionkey@0"
I20260812 01:06:31.649379 22476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance:
uuid: "8fe82a6ceff141e0917ed09e2cafe332"
format_stamp: "Formatted at 2026-08-12 01:06:31 on dist-test-slave-bndk"
server_key: "eb58af26e445528140318ca1f6629517"
server_key_iv: "be0ee97c119b061fc16fcf7f5c460a58"
server_key_version: "encryptionkey@0"
I20260812 01:06:31.654415 22476 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 01:06:31.657752 22501 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:31.659008 22476 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 01:06:31.659152 22476 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "8fe82a6ceff141e0917ed09e2cafe332"
format_stamp: "Formatted at 2026-08-12 01:06:31 on dist-test-slave-bndk"
server_key: "eb58af26e445528140318ca1f6629517"
server_key_iv: "be0ee97c119b061fc16fcf7f5c460a58"
server_key_version: "encryptionkey@0"
I20260812 01:06:31.659327 22476 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:06:31.688390 22476 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:06:31.693361 22476 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:06:31.693668 22476 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:06:31.694844 22476 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:06:31.696524 22476 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:06:31.696620 22476 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:31.696744 22476 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:06:31.696815 22476 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:31.726686 22476 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:38809
I20260812 01:06:31.726747 22673 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:38809 every 8 connection(s)
I20260812 01:06:31.727953 22476 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:06:31.732054 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 22476
I20260812 01:06:31.732249 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance
I20260812 01:06:31.732681 4901 external_mini_cluster.cc:1428] Setting key c172850cce6f78ab6a1ba68bdc48bf3d
Aug 12 01:06:31 dist-test-slave-bndk krb5kdc[22083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496791, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:06:31.747231 22678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:31.730441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:35039 (local address 127.4.201.126:44525)
0812 01:06:31.730867 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:31.730872 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:31.731860 (+ 988us) server_negotiation.cc:407] Connection header received
0812 01:06:31.733825 (+ 1965us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:31.733829 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:31.733900 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:31.733993 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:31.735590 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:31.736288 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:31.737862 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:31.738276 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:31.738387 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:31.741770 (+ 3383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:31.741775 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:31.741779 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:06:31.741809 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:31.744293 (+ 2484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:31.744980 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:31.744984 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:31.744987 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:31.745116 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:31.745562 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:31.745566 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:31.745568 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:31.745823 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:31.745958 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:31.746649 (+ 691us) server_negotiation.cc:299] Negotiation successful
0812 01:06:31.746873 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":199,"threads_started":1}
I20260812 01:06:31.748345 22680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:31.731002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:44525 (local address 127.4.201.66:35039)
0812 01:06:31.731684 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:31.731728 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:31.733551 (+ 1823us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:31.734275 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:31.734286 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:31.734842 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:31.735413 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:31.735432 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:31.736444 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:31.736448 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:31.737720 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:31.737733 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:31.738497 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:31.738505 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:31.738726 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:31.739343 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:31.739365 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:31.741557 (+ 2192us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:06:31.744434 (+ 2877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:06:31.744443 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:06:31.744460 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:06:31.744855 (+ 395us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:06:31.745242 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:06:31.745248 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:06:31.745252 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:06:31.745442 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:06:31.745950 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:06:31.745957 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:06:31.746279 (+ 322us) client_negotiation.cc:769] Sending connection context
0812 01:06:31.746510 (+ 231us) client_negotiation.cc:240] Negotiation successful
0812 01:06:31.747029 (+ 519us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":271,"threads_started":1}
I20260812 01:06:31.749791 22674 heartbeater.cc:347] Connected to a master server at 127.4.201.126:44525
I20260812 01:06:31.750164 22674 heartbeater.cc:464] Registering TS with master...
I20260812 01:06:31.751044 22674 heartbeater.cc:511] Master 127.4.201.126:44525 requested a full tablet report, sending...
I20260812 01:06:31.752592 22149 ts_manager.cc:194] Registered new tserver with Master: 8fe82a6ceff141e0917ed09e2cafe332 (127.4.201.66:38809)
I20260812 01:06:31.753454 22149 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.66@KRBTEST.COM'} at 127.4.201.66:35039
WARNING: no policy specified for kudu/127.4.201.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
I20260812 01:06:31.795800 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:0
--local_ip_for_outbound_sockets=127.4.201.67
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:44525
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:40561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:06:32.122859 22684 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:06:32.123128 22684 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:06:32.123272 22684 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:06:32.130508 22684 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:06:32.130609 22684 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:06:32.130761 22684 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:06:32.139997 22684 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:40561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:44525
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:06:32.141268 22684 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:06:32.142619 22684 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:06:32.155843 22690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:32.155869 22689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:06:32.155803 22693 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:06:32.156562 22684 server_base.cc:1034] running on GCE node
I20260812 01:06:32.157155 22684 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:06:32.158079 22684 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:06:32.159269 22684 hybrid_clock.cc:648] HybridClock initialized: now 1786496792159212 us; error 47 us; skew 500 ppm
I20260812 01:06:32.159579 22684 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:06:32 dist-test-slave-bndk krb5kdc[22083](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496792, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:06:32.162674 22684 init.cc:377] Logged in from keytab as kudu/127.4.201.67@KRBTEST.COM (short username kudu)
I20260812 01:06:32.164059 22684 webserver.cc:460] Webserver started at http://127.4.201.67:38617/ using document root <none> and password file <none>
I20260812 01:06:32.164711 22684 fs_manager.cc:359] Metadata directory not provided
I20260812 01:06:32.164812 22684 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:06:32.165066 22684 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:06:32.167997 22684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/data/instance:
uuid: "0afa0d1b12f34c06b09490c735ee2740"
format_stamp: "Formatted at 2026-08-12 01:06:32 on dist-test-slave-bndk"
server_key: "e28f19c32c899007b87872fdb9ab8cdc"
server_key_iv: "799f94673bb212bfaa1fb63f31f5ccfd"
server_key_version: "encryptionkey@0"
I20260812 01:06:32.168763 22684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance:
uuid: "0afa0d1b12f34c06b09490c735ee2740"
format_stamp: "Formatted at 2026-08-12 01:06:32 on dist-test-slave-bndk"
server_key: "e28f19c32c899007b87872fdb9ab8cdc"
server_key_iv: "799f94673bb212bfaa1fb63f31f5ccfd"
server_key_version: "encryptionkey@0"
I20260812 01:06:32.173913 22684 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260812 01:06:32.177253 22706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:32.178681 22684 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 01:06:32.178850 22684 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "0afa0d1b12f34c06b09490c735ee2740"
format_stamp: "Formatted at 2026-08-12 01:06:32 on dist-test-slave-bndk"
server_key: "e28f19c32c899007b87872fdb9ab8cdc"
server_key_iv: "799f94673bb212bfaa1fb63f31f5ccfd"
server_key_version: "encryptionkey@0"
I20260812 01:06:32.179040 22684 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:06:32.189749 22684 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:06:32.193435 22684 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:06:32.193692 22684 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:06:32.194577 22684 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:06:32.196034 22684 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:06:32.196125 22684 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:32.196240 22684 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:06:32.196300 22684 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:06:32.227561 22684 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:35491
I20260812 01:06:32.227617 22887 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:35491 every 8 connection(s)
I20260812 01:06:32.228434 22466 heartbeater.cc:503] Master 127.4.201.126:44525 was elected leader, sending a full tablet report...
I20260812 01:06:32.228976 22684 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:06:32.229763 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 22684
I20260812 01:06:32.230003 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance
I20260812 01:06:32.230576 4901 external_mini_cluster.cc:1428] Setting key c8a533e906a3ba2d925258d79381a6f6
Aug 12 01:06:32 dist-test-slave-bndk krb5kdc[22083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496792, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:06:32.248258 22678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:32.231872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:53829 (local address 127.4.201.126:44525)
0812 01:06:32.232074 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:32.232079 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:32.233370 (+ 1291us) server_negotiation.cc:407] Connection header received
0812 01:06:32.235160 (+ 1790us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:32.235164 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:32.235240 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:32.235319 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:32.236747 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.237585 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.239032 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.239408 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.239509 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:32.242779 (+ 3270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:32.242784 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:32.242787 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:06:32.242819 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:32.245677 (+ 2858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:32.246419 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:32.246423 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:32.246425 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:32.246556 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:32.246895 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:32.246897 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:32.246899 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:32.247167 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:32.247284 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:32.247868 (+ 584us) server_negotiation.cc:299] Negotiation successful
0812 01:06:32.248037 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 01:06:32.249333 22891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:32.232393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:44525 (local address 127.4.201.67:53829)
0812 01:06:32.233200 (+ 807us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:32.233275 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:32.234905 (+ 1630us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:32.235509 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:32.235516 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:32.236022 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:06:32.236570 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:32.236587 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.237713 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.237717 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:32.238908 (+ 1191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:32.238920 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.239569 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.239574 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:32.239762 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:32.240341 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:06:32.240363 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:06:32.242583 (+ 2220us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:06:32.245823 (+ 3240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:06:32.245832 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:06:32.245847 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:06:32.246317 (+ 470us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:06:32.246637 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:06:32.246640 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:06:32.246642 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:06:32.246818 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:06:32.247263 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:06:32.247269 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:06:32.247575 (+ 306us) client_negotiation.cc:769] Sending connection context
0812 01:06:32.247793 (+ 218us) client_negotiation.cc:240] Negotiation successful
0812 01:06:32.248158 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":324,"threads_started":1}
I20260812 01:06:32.250586 22889 heartbeater.cc:347] Connected to a master server at 127.4.201.126:44525
I20260812 01:06:32.250885 22889 heartbeater.cc:464] Registering TS with master...
I20260812 01:06:32.251603 22889 heartbeater.cc:511] Master 127.4.201.126:44525 requested a full tablet report, sending...
I20260812 01:06:32.252948 22149 ts_manager.cc:194] Registered new tserver with Master: 0afa0d1b12f34c06b09490c735ee2740 (127.4.201.67:35491)
I20260812 01:06:32.253748 22149 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.67@KRBTEST.COM'} at 127.4.201.67:53829
I20260812 01:06:32.258037 4901 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:06:32.274454 22678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:32.262342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41502 (local address 127.4.201.126:44525)
0812 01:06:32.262551 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:32.262555 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:32.262971 (+ 416us) server_negotiation.cc:407] Connection header received
0812 01:06:32.263127 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:32.263131 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:32.263200 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:32.263269 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:32.264731 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.265514 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.266671 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.267084 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.267173 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:32.269290 (+ 2117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:32.269295 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:32.269299 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:06:32.269329 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:32.271783 (+ 2454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:32.272435 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:32.272441 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:32.272443 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:32.272610 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:32.273087 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:32.273094 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:32.273097 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:32.273545 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:32.273754 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:32.274027 (+ 273us) server_negotiation.cc:299] Negotiation successful
0812 01:06:32.274208 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 01:06:32.278475 22149 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41502:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:06:32.285332 22149 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:06:32.324200 22920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:32.298241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60764 (local address 127.4.201.67:35491)
0812 01:06:32.316523 (+ 18282us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:32.316532 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:32.316568 (+ 36us) server_negotiation.cc:407] Connection header received
0812 01:06:32.316666 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:32.316674 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:32.316892 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:32.317838 (+ 946us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:06:32.318140 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.319415 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.321521 (+ 2106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.322758 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.322873 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:32.323131 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:32.323678 (+ 547us) server_negotiation.cc:299] Negotiation successful
0812 01:06:32.323872 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18102,"thread_start_us":17937,"threads_started":1}
I20260812 01:06:32.324352 22911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:32.297672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:35491 (local address 127.0.0.1:60764)
0812 01:06:32.314492 (+ 16820us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:32.314512 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:32.314630 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:32.317132 (+ 2502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:32.317137 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:32.317164 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:06:32.317638 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:32.317651 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.319558 (+ 1907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.319562 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:32.321306 (+ 1744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:32.321323 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.322944 (+ 1621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.322950 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:32.323389 (+ 439us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:32.323452 (+ 63us) client_negotiation.cc:769] Sending connection context
0812 01:06:32.323587 (+ 135us) client_negotiation.cc:240] Negotiation successful
0812 01:06:32.323857 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16674,"mutex_wait_us":42,"thread_start_us":16533,"threads_started":1}
I20260812 01:06:32.324462 22910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:32.297680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36982 (local address 127.4.201.66:38809)
0812 01:06:32.315125 (+ 17445us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:32.315134 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:32.315166 (+ 32us) server_negotiation.cc:407] Connection header received
0812 01:06:32.315720 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:32.315730 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:32.316015 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:32.317037 (+ 1022us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:06:32.317317 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.318874 (+ 1557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.321647 (+ 2773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.323137 (+ 1490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.323274 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:32.323462 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:32.323973 (+ 511us) server_negotiation.cc:299] Negotiation successful
0812 01:06:32.324149 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17277,"thread_start_us":17160,"threads_started":1}
I20260812 01:06:32.324956 22909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:32.297356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:38809 (local address 127.0.0.1:36982)
0812 01:06:32.312882 (+ 15526us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:32.312945 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:32.313162 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:32.316299 (+ 3137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:32.316306 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:32.316339 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:06:32.316810 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:32.316825 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.319017 (+ 2192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.319021 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:32.321467 (+ 2446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:32.321481 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.323379 (+ 1898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.323386 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:32.323559 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:32.323589 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 01:06:32.323660 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 01:06:32.323857 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15204,"mutex_wait_us":130,"thread_start_us":16037,"threads_started":1}
I20260812 01:06:32.325562 22921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:32.298720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35568 (local address 127.4.201.65:34547)
0812 01:06:32.316136 (+ 17416us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:32.316146 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:32.316177 (+ 31us) server_negotiation.cc:407] Connection header received
0812 01:06:32.316283 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:32.316290 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:32.316501 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:32.316702 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:06:32.317531 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.318753 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.322441 (+ 3688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.323843 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.323973 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:32.324194 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:32.325058 (+ 864us) server_negotiation.cc:299] Negotiation successful
0812 01:06:32.325240 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17231,"thread_start_us":17051,"threads_started":1}
I20260812 01:06:32.326164 22917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:32.298046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:34547 (local address 127.0.0.1:35568)
0812 01:06:32.315367 (+ 17321us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:32.315392 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:32.315523 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:32.316698 (+ 1175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:32.316703 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:32.316731 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:06:32.317167 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:32.317183 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.318888 (+ 1705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.318894 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:32.322263 (+ 3369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:32.322279 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.324377 (+ 2098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.324383 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:32.324545 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:32.324577 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 01:06:32.324659 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 01:06:32.324787 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17172,"mutex_wait_us":152,"thread_start_us":16998,"threads_started":1}
I20260812 01:06:32.329470 22788 tablet_service.cc:1467] Processing CreateTablet for tablet 7de1875b3cdf4f439d64cdaf9b6c94ed (DEFAULT_TABLE table=test-table [id=fd442b89d09b468d97fa8bd5caa739ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:06:32.329722 22358 tablet_service.cc:1467] Processing CreateTablet for tablet 7de1875b3cdf4f439d64cdaf9b6c94ed (DEFAULT_TABLE table=test-table [id=fd442b89d09b468d97fa8bd5caa739ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:06:32.331183 22788 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7de1875b3cdf4f439d64cdaf9b6c94ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:06:32.330753 22572 tablet_service.cc:1467] Processing CreateTablet for tablet 7de1875b3cdf4f439d64cdaf9b6c94ed (DEFAULT_TABLE table=test-table [id=fd442b89d09b468d97fa8bd5caa739ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:06:32.331503 22358 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7de1875b3cdf4f439d64cdaf9b6c94ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:06:32.331943 22572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7de1875b3cdf4f439d64cdaf9b6c94ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:06:32.342933 22922 tablet_bootstrap.cc:492] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 8fe82a6ceff141e0917ed09e2cafe332: Bootstrap starting.
I20260812 01:06:32.345530 22923 tablet_bootstrap.cc:492] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740: Bootstrap starting.
I20260812 01:06:32.346909 22924 tablet_bootstrap.cc:492] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 061ab660aa44422cb65269a13432fb64: Bootstrap starting.
I20260812 01:06:32.347640 22922 tablet_bootstrap.cc:654] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 8fe82a6ceff141e0917ed09e2cafe332: Neither blocks nor log segments found. Creating new log.
I20260812 01:06:32.349009 22922 log.cc:824] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 8fe82a6ceff141e0917ed09e2cafe332: Log is configured to *not* fsync() on all Append() calls
I20260812 01:06:32.349524 22923 tablet_bootstrap.cc:654] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740: Neither blocks nor log segments found. Creating new log.
I20260812 01:06:32.349738 22924 tablet_bootstrap.cc:654] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 061ab660aa44422cb65269a13432fb64: Neither blocks nor log segments found. Creating new log.
I20260812 01:06:32.350979 22924 log.cc:824] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 061ab660aa44422cb65269a13432fb64: Log is configured to *not* fsync() on all Append() calls
I20260812 01:06:32.351356 22923 log.cc:824] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740: Log is configured to *not* fsync() on all Append() calls
I20260812 01:06:32.352785 22922 tablet_bootstrap.cc:492] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 8fe82a6ceff141e0917ed09e2cafe332: No bootstrap required, opened a new log
I20260812 01:06:32.353091 22922 ts_tablet_manager.cc:1397] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 8fe82a6ceff141e0917ed09e2cafe332: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.004s
I20260812 01:06:32.353808 22924 tablet_bootstrap.cc:492] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 061ab660aa44422cb65269a13432fb64: No bootstrap required, opened a new log
I20260812 01:06:32.354041 22924 ts_tablet_manager.cc:1397] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 061ab660aa44422cb65269a13432fb64: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260812 01:06:32.354992 22923 tablet_bootstrap.cc:492] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740: No bootstrap required, opened a new log
I20260812 01:06:32.355245 22923 ts_tablet_manager.cc:1397] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260812 01:06:32.361058 22924 raft_consensus.cc:348] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 061ab660aa44422cb65269a13432fb64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe82a6ceff141e0917ed09e2cafe332" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38809 } } peers { permanent_uuid: "0afa0d1b12f34c06b09490c735ee2740" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 35491 } } peers { permanent_uuid: "061ab660aa44422cb65269a13432fb64" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34547 } }
I20260812 01:06:32.361471 22924 raft_consensus.cc:374] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 061ab660aa44422cb65269a13432fb64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:06:32.361578 22924 raft_consensus.cc:729] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 061ab660aa44422cb65269a13432fb64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 061ab660aa44422cb65269a13432fb64, State: Initialized, Role: FOLLOWER
I20260812 01:06:32.362157 22924 consensus_queue.cc:260] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 061ab660aa44422cb65269a13432fb64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe82a6ceff141e0917ed09e2cafe332" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38809 } } peers { permanent_uuid: "0afa0d1b12f34c06b09490c735ee2740" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 35491 } } peers { permanent_uuid: "061ab660aa44422cb65269a13432fb64" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34547 } }
I20260812 01:06:32.363456 22922 raft_consensus.cc:348] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 8fe82a6ceff141e0917ed09e2cafe332 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe82a6ceff141e0917ed09e2cafe332" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38809 } } peers { permanent_uuid: "0afa0d1b12f34c06b09490c735ee2740" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 35491 } } peers { permanent_uuid: "061ab660aa44422cb65269a13432fb64" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34547 } }
I20260812 01:06:32.363906 22922 raft_consensus.cc:374] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 8fe82a6ceff141e0917ed09e2cafe332 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:06:32.364010 22922 raft_consensus.cc:729] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 8fe82a6ceff141e0917ed09e2cafe332 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fe82a6ceff141e0917ed09e2cafe332, State: Initialized, Role: FOLLOWER
I20260812 01:06:32.364068 22924 ts_tablet_manager.cc:1428] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 061ab660aa44422cb65269a13432fb64: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20260812 01:06:32.364586 22922 consensus_queue.cc:260] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 8fe82a6ceff141e0917ed09e2cafe332 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe82a6ceff141e0917ed09e2cafe332" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38809 } } peers { permanent_uuid: "0afa0d1b12f34c06b09490c735ee2740" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 35491 } } peers { permanent_uuid: "061ab660aa44422cb65269a13432fb64" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34547 } }
I20260812 01:06:32.365731 22674 heartbeater.cc:503] Master 127.4.201.126:44525 was elected leader, sending a full tablet report...
I20260812 01:06:32.365618 22923 raft_consensus.cc:348] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe82a6ceff141e0917ed09e2cafe332" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38809 } } peers { permanent_uuid: "0afa0d1b12f34c06b09490c735ee2740" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 35491 } } peers { permanent_uuid: "061ab660aa44422cb65269a13432fb64" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34547 } }
I20260812 01:06:32.366036 22923 raft_consensus.cc:374] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:06:32.366133 22923 raft_consensus.cc:729] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afa0d1b12f34c06b09490c735ee2740, State: Initialized, Role: FOLLOWER
I20260812 01:06:32.366433 22922 ts_tablet_manager.cc:1428] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 8fe82a6ceff141e0917ed09e2cafe332: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20260812 01:06:32.366716 22923 consensus_queue.cc:260] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe82a6ceff141e0917ed09e2cafe332" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38809 } } peers { permanent_uuid: "0afa0d1b12f34c06b09490c735ee2740" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 35491 } } peers { permanent_uuid: "061ab660aa44422cb65269a13432fb64" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34547 } }
I20260812 01:06:32.367779 22889 heartbeater.cc:503] Master 127.4.201.126:44525 was elected leader, sending a full tablet report...
I20260812 01:06:32.368490 22923 ts_tablet_manager.cc:1428] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740: Time spent starting tablet: real 0.013s user 0.010s sys 0.004s
I20260812 01:06:32.374080 22933 raft_consensus.cc:482] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:06:32.374303 22933 raft_consensus.cc:504] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe82a6ceff141e0917ed09e2cafe332" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38809 } } peers { permanent_uuid: "0afa0d1b12f34c06b09490c735ee2740" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 35491 } } peers { permanent_uuid: "061ab660aa44422cb65269a13432fb64" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34547 } }
I20260812 01:06:32.375842 22933 leader_election.cc:288] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fe82a6ceff141e0917ed09e2cafe332 (127.4.201.66:38809), 061ab660aa44422cb65269a13432fb64 (127.4.201.65:34547)
I20260812 01:06:32.382361 22921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:32.376384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:45855 (local address 127.4.201.65:34547)
0812 01:06:32.376569 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:32.376575 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:32.376593 (+ 18us) server_negotiation.cc:407] Connection header received
0812 01:06:32.376657 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:32.376660 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:32.376714 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:32.376786 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:06:32.377260 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.378184 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.380224 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.381471 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.381647 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:32.381704 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:32.382053 (+ 349us) server_negotiation.cc:299] Negotiation successful
0812 01:06:32.382151 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 01:06:32.382468 22891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:32.376127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:34547 (local address 127.4.201.67:45855)
0812 01:06:32.376363 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:32.376383 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:32.376509 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:32.376830 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:32.376835 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:32.376859 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:06:32.377054 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:32.377071 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.378321 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.378327 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:32.380063 (+ 1736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:32.380078 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.381666 (+ 1588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.381671 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:32.381863 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:32.381899 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 01:06:32.382030 (+ 131us) client_negotiation.cc:240] Negotiation successful
0812 01:06:32.382163 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":86,"mutex_wait_us":1}
I20260812 01:06:32.383486 22389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7de1875b3cdf4f439d64cdaf9b6c94ed" candidate_uuid: "0afa0d1b12f34c06b09490c735ee2740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "061ab660aa44422cb65269a13432fb64" is_pre_election: true
I20260812 01:06:32.383874 22934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:32.376232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:38809 (local address 127.4.201.67:59829)
0812 01:06:32.376918 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0812 01:06:32.376935 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:06:32.377120 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:06:32.377829 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:06:32.377834 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:06:32.377860 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:06:32.378208 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:32.378218 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.379588 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.379591 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:32.381489 (+ 1898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:06:32.381503 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.383229 (+ 1726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.383233 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:06:32.383357 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:32.383388 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 01:06:32.383462 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 01:06:32.383557 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"mutex_wait_us":19,"thread_start_us":734,"threads_started":1}
I20260812 01:06:32.383904 22910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:32.376192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:59829 (local address 127.4.201.66:38809)
0812 01:06:32.376433 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:32.376439 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:32.377008 (+ 569us) server_negotiation.cc:407] Connection header received
0812 01:06:32.377628 (+ 620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:32.377633 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:32.377703 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:32.377804 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:06:32.378390 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.379452 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.381664 (+ 2212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.382898 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.383050 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:32.383112 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:32.383534 (+ 422us) server_negotiation.cc:299] Negotiation successful
0812 01:06:32.383669 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 01:06:32.384104 22389 raft_consensus.cc:2454] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 061ab660aa44422cb65269a13432fb64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afa0d1b12f34c06b09490c735ee2740 in term 0.
I20260812 01:06:32.384796 22710 leader_election.cc:302] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 061ab660aa44422cb65269a13432fb64, 0afa0d1b12f34c06b09490c735ee2740; no voters:
I20260812 01:06:32.384763 22613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7de1875b3cdf4f439d64cdaf9b6c94ed" candidate_uuid: "0afa0d1b12f34c06b09490c735ee2740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fe82a6ceff141e0917ed09e2cafe332" is_pre_election: true
I20260812 01:06:32.385190 22933 raft_consensus.cc:2781] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:06:32.385357 22933 raft_consensus.cc:482] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:06:32.385291 22613 raft_consensus.cc:2454] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 8fe82a6ceff141e0917ed09e2cafe332 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afa0d1b12f34c06b09490c735ee2740 in term 0.
I20260812 01:06:32.385454 22933 raft_consensus.cc:3037] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:06:32.387665 22933 raft_consensus.cc:504] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe82a6ceff141e0917ed09e2cafe332" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38809 } } peers { permanent_uuid: "0afa0d1b12f34c06b09490c735ee2740" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 35491 } } peers { permanent_uuid: "061ab660aa44422cb65269a13432fb64" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34547 } }
I20260812 01:06:32.388229 22933 leader_election.cc:288] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740 [CANDIDATE]: Term 1 election: Requested vote from peers 8fe82a6ceff141e0917ed09e2cafe332 (127.4.201.66:38809), 061ab660aa44422cb65269a13432fb64 (127.4.201.65:34547)
I20260812 01:06:32.388703 22389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7de1875b3cdf4f439d64cdaf9b6c94ed" candidate_uuid: "0afa0d1b12f34c06b09490c735ee2740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "061ab660aa44422cb65269a13432fb64"
I20260812 01:06:32.388703 22613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7de1875b3cdf4f439d64cdaf9b6c94ed" candidate_uuid: "0afa0d1b12f34c06b09490c735ee2740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fe82a6ceff141e0917ed09e2cafe332"
I20260812 01:06:32.388906 22389 raft_consensus.cc:3037] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 061ab660aa44422cb65269a13432fb64 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:06:32.388906 22613 raft_consensus.cc:3037] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 8fe82a6ceff141e0917ed09e2cafe332 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:06:32.392063 22389 raft_consensus.cc:2454] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 061ab660aa44422cb65269a13432fb64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afa0d1b12f34c06b09490c735ee2740 in term 1.
I20260812 01:06:32.392071 22613 raft_consensus.cc:2454] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 8fe82a6ceff141e0917ed09e2cafe332 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afa0d1b12f34c06b09490c735ee2740 in term 1.
I20260812 01:06:32.392462 22710 leader_election.cc:302] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 061ab660aa44422cb65269a13432fb64, 0afa0d1b12f34c06b09490c735ee2740; no voters:
I20260812 01:06:32.392777 22933 raft_consensus.cc:2781] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:06:32.393270 22933 raft_consensus.cc:686] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740 [term 1 LEADER]: Becoming Leader. State: Replica: 0afa0d1b12f34c06b09490c735ee2740, State: Running, Role: LEADER
I20260812 01:06:32.393821 22933 consensus_queue.cc:237] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe82a6ceff141e0917ed09e2cafe332" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38809 } } peers { permanent_uuid: "0afa0d1b12f34c06b09490c735ee2740" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 35491 } } peers { permanent_uuid: "061ab660aa44422cb65269a13432fb64" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34547 } }
I20260812 01:06:32.398162 22149 catalog_manager.cc:5495] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0afa0d1b12f34c06b09490c735ee2740 (127.4.201.67). New cstate: current_term: 1 leader_uuid: "0afa0d1b12f34c06b09490c735ee2740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe82a6ceff141e0917ed09e2cafe332" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afa0d1b12f34c06b09490c735ee2740" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 35491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "061ab660aa44422cb65269a13432fb64" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260812 01:06:32.424528 22920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:32.419528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60768 (local address 127.4.201.67:35491)
0812 01:06:32.419725 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:32.419730 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:32.419749 (+ 19us) server_negotiation.cc:407] Connection header received
0812 01:06:32.419938 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:32.419941 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:32.420027 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:32.420150 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:06:32.420443 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.421160 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.422557 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.422957 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.423049 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:32.423534 (+ 485us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:06:32.424039 (+ 505us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:06:32.424147 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:32.424221 (+ 74us) server_negotiation.cc:299] Negotiation successful
0812 01:06:32.424284 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 01:06:32.432552 22389 raft_consensus.cc:1261] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 061ab660aa44422cb65269a13432fb64 [term 1 FOLLOWER]: Refusing update from remote peer 0afa0d1b12f34c06b09490c735ee2740: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:06:32.432555 22613 raft_consensus.cc:1261] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 8fe82a6ceff141e0917ed09e2cafe332 [term 1 FOLLOWER]: Refusing update from remote peer 0afa0d1b12f34c06b09490c735ee2740: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:06:32.433609 22936 consensus_queue.cc:1035] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "061ab660aa44422cb65269a13432fb64" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:06:32.433938 22933 consensus_queue.cc:1035] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fe82a6ceff141e0917ed09e2cafe332" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:06:32.460453 22149 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41502:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:06:32.460747 22149 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41502:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:06:32.464577 22149 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3b58ac4e6f9c46cb97bc497bbb07ed6d: Sending DeleteTablet for 3 replicas of tablet 7de1875b3cdf4f439d64cdaf9b6c94ed
I20260812 01:06:32.465768 22788 tablet_service.cc:1514] Processing DeleteTablet for tablet 7de1875b3cdf4f439d64cdaf9b6c94ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:06:32 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:60764
I20260812 01:06:32.465755 22572 tablet_service.cc:1514] Processing DeleteTablet for tablet 7de1875b3cdf4f439d64cdaf9b6c94ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:06:32 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:36982
I20260812 01:06:32.466459 22358 tablet_service.cc:1514] Processing DeleteTablet for tablet 7de1875b3cdf4f439d64cdaf9b6c94ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:06:32 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:35568
I20260812 01:06:32.467669 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 22256
I20260812 01:06:32.469614 22954 tablet_replica.cc:330] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 8fe82a6ceff141e0917ed09e2cafe332: stopping tablet replica
I20260812 01:06:32.470095 22954 raft_consensus.cc:2229] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 8fe82a6ceff141e0917ed09e2cafe332 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:06:32.470625 22954 raft_consensus.cc:2258] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 8fe82a6ceff141e0917ed09e2cafe332 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:06:32.471469 22955 tablet_replica.cc:330] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740: stopping tablet replica
I20260812 01:06:32.471880 22955 raft_consensus.cc:2229] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740 [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:06:32.472543 22955 raft_consensus.cc:2258] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:06:32.473094 22954 ts_tablet_manager.cc:1905] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 8fe82a6ceff141e0917ed09e2cafe332: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:06:32.480472 22954 ts_tablet_manager.cc:1918] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 8fe82a6ceff141e0917ed09e2cafe332: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:06:32.480628 22954 log.cc:1196] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 8fe82a6ceff141e0917ed09e2cafe332: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-1/wal/wals/7de1875b3cdf4f439d64cdaf9b6c94ed
I20260812 01:06:32.481168 22954 ts_tablet_manager.cc:1939] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 8fe82a6ceff141e0917ed09e2cafe332: Deleting consensus metadata
I20260812 01:06:32.482905 22956 tablet_replica.cc:330] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 061ab660aa44422cb65269a13432fb64: stopping tablet replica
I20260812 01:06:32.482985 22131 catalog_manager.cc:4841] TS 8fe82a6ceff141e0917ed09e2cafe332 (127.4.201.66:38809): tablet 7de1875b3cdf4f439d64cdaf9b6c94ed (table test-table [id=fd442b89d09b468d97fa8bd5caa739ec]) successfully deleted
I20260812 01:06:32.483541 22956 raft_consensus.cc:2229] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 061ab660aa44422cb65269a13432fb64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:06:32.484122 22956 raft_consensus.cc:2258] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 061ab660aa44422cb65269a13432fb64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:06:32.484894 22955 ts_tablet_manager.cc:1905] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:06:32.486230 22956 ts_tablet_manager.cc:1905] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 061ab660aa44422cb65269a13432fb64: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 12 01:06:32 dist-test-slave-bndk krb5kdc[22083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496790, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.65@KRBTEST.COM
I20260812 01:06:32.492311 22955 ts_tablet_manager.cc:1918] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:06:32.492488 22955 log.cc:1196] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-2/wal/wals/7de1875b3cdf4f439d64cdaf9b6c94ed
I20260812 01:06:32.493083 22955 ts_tablet_manager.cc:1939] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 0afa0d1b12f34c06b09490c735ee2740: Deleting consensus metadata
I20260812 01:06:32.494635 22956 ts_tablet_manager.cc:1918] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 061ab660aa44422cb65269a13432fb64: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:06:32.494869 22956 log.cc:1196] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 061ab660aa44422cb65269a13432fb64: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786496689953932-4901-0/minicluster-data/ts-0/wal/wals/7de1875b3cdf4f439d64cdaf9b6c94ed
I20260812 01:06:32.494982 22130 catalog_manager.cc:4841] TS 0afa0d1b12f34c06b09490c735ee2740 (127.4.201.67:35491): tablet 7de1875b3cdf4f439d64cdaf9b6c94ed (table test-table [id=fd442b89d09b468d97fa8bd5caa739ec]) successfully deleted
I20260812 01:06:32.495530 22956 ts_tablet_manager.cc:1939] T 7de1875b3cdf4f439d64cdaf9b6c94ed P 061ab660aa44422cb65269a13432fb64: Deleting consensus metadata
I20260812 01:06:32.497298 22132 catalog_manager.cc:4841] TS 061ab660aa44422cb65269a13432fb64 (127.4.201.65:34547): tablet 7de1875b3cdf4f439d64cdaf9b6c94ed (table test-table [id=fd442b89d09b468d97fa8bd5caa739ec]) successfully deleted
I20260812 01:06:32.498740 22921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:32.468947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35576 (local address 127.4.201.65:34547)
0812 01:06:32.469127 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:32.469134 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:32.479640 (+ 10506us) server_negotiation.cc:407] Connection header received
0812 01:06:32.479819 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:32.479824 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:32.479905 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:32.480004 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:32.482130 (+ 2126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.483305 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.486054 (+ 2749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.486687 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.486786 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:32.492048 (+ 5262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:32.492065 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:32.492088 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:06:32.492135 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:32.495881 (+ 3746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:32.496565 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:32.496573 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:32.496575 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:32.496703 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:32.497085 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:32.497089 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:32.497091 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:32.497594 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:32.497889 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:32.498199 (+ 310us) server_negotiation.cc:299] Negotiation successful
0812 01:06:32.498403 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 01:06:32.499423 22460 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:06:32.590580 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 22256
I20260812 01:06:32.623569 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 22476
Aug 12 01:06:32 dist-test-slave-bndk krb5kdc[22083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496790, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.66@KRBTEST.COM
I20260812 01:06:32.646157 22910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:32.624994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36998 (local address 127.4.201.66:38809)
0812 01:06:32.625249 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:32.625256 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:32.625278 (+ 22us) server_negotiation.cc:407] Connection header received
0812 01:06:32.625345 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:32.625349 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:32.625440 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:32.625552 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:32.627257 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.628441 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.630522 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.631174 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.631329 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:32.636500 (+ 5171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:32.636522 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:32.636545 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:06:32.636590 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:32.640382 (+ 3792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:32.642818 (+ 2436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:32.642829 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:32.642833 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:32.643009 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:32.643461 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:32.643467 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:32.643471 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:32.643970 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:32.644266 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:32.645533 (+ 1267us) server_negotiation.cc:299] Negotiation successful
0812 01:06:32.645767 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 01:06:32.646919 22666 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:06:32.750530 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 22476
I20260812 01:06:32.780616 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 22684
Aug 12 01:06:32 dist-test-slave-bndk krb5kdc[22083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496790, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.67@KRBTEST.COM
I20260812 01:06:32.796060 22920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:06:32.781510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60782 (local address 127.4.201.67:35491)
0812 01:06:32.781720 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0812 01:06:32.781726 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:06:32.781746 (+ 20us) server_negotiation.cc:407] Connection header received
0812 01:06:32.781815 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:06:32.781821 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:06:32.781920 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:06:32.782025 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:06:32.783370 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.784188 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.785493 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:06:32.785958 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:06:32.786084 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:06:32.790131 (+ 4047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:06:32.790144 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:06:32.790162 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:06:32.790206 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:06:32.793257 (+ 3051us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:32.793905 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:32.793913 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:32.793915 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:32.794095 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:06:32.794464 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:06:32.794468 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:06:32.794470 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:06:32.794849 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:06:32.795177 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0812 01:06:32.795466 (+ 289us) server_negotiation.cc:299] Negotiation successful
0812 01:06:32.795679 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 01:06:32.796744 22879 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:06:32.921306 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 22684
I20260812 01:06:32.948668 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 22108
I20260812 01:06:32.949915 22208 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:06:33.057665 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 22108
2026-08-12T01:06:33Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4405 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:06:33 dist-test-slave-bndk krb5kdc[22966](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:06:33 dist-test-slave-bndk krb5kdc[22966](info): set up 2 sockets
Aug 12 01:06:33 dist-test-slave-bndk krb5kdc[22966](info): commencing operation
krb5kdc: starting...
W20260812 01:06:34.291739 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.186s user 0.004s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:06:34 dist-test-slave-bndk krb5kdc[22966](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496794, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:06:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:06:34Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.4.201.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.4.201.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.4.201.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/rangeradmin_127.4.201.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.4.201.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/rangeradmin_127.4.201.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.4.201.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.4.201.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.4.201.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/rangerlookup_127.4.201.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.4.201.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/rangerlookup_127.4.201.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.4.201.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.4.201.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.4.201.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/HTTP_127.4.201.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.4.201.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/HTTP_127.4.201.84@KRBTEST.COM.keytab.
I20260812 01:06:34.666262 4901 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskuEa_sO/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/postgres -l logfile start
2026-08-12 01:06:36.955 UTC [23014] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 01:06:36.956 UTC [23014] LOG: listening on IPv4 address "127.4.201.84", port 42973
2026-08-12 01:06:36.959 UTC [23014] LOG: listening on Unix socket "/tmp/.s.PGSQL.42973"
2026-08-12 01:06:36.979 UTC [23025] LOG: database system was shut down at 2026-08-12 01:06:35 UTC
2026-08-12 01:06:36.982 UTC [23014] LOG: database system is ready to accept connections
I20260812 01:06:38.076515 4901 mini_postgres.cc:96] Postgres bound to 42973
2026-08-12 01:06:38.100 UTC [23038] FATAL: database "slave" does not exist
127.4.201.84:42973 - accepting connections
I20260812 01:06:38.101585 4901 mini_ranger.cc:161] Starting Ranger...
I20260812 01:06:38.130650 4901 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 01:06:38.555673 4901 mini_ranger.cc:87] Created ranger Postgres database
I20260812 01:06:38.555791 4901 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ranger-admin
2026-08-12 01:06:38,931 [I] DB FLAVOR :POSTGRES
2026-08-12 01:06:38,931 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 01:06:38,931 [I] Checking connection..
2026-08-12 01:06:38,931 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:42973/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 01:06:39,187 [I] Checking connection passed.
2026-08-12 01:06:39,187 [I] --------- Verifying version history table ---------
2026-08-12 01:06:39,188 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:42973/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 01:06:39,424 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 01:06:39,424 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:42973/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 01:06:39,667 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 01:06:39,667 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 01:06:39,667 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:42973/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 01:06:39.918 UTC [23131] WARNING: there is no transaction in progress
2026-08-12 01:06:39,927 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 01:06:39,927 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:42973/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 01:06:40,182 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 01:06:40,182 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 01:06:40,183 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:42973/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 01:06:40,429 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:42973/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 01:06:40,680 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:42973/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-bndk.c.gcp-upstream.internal','N') ;"
2026-08-12 01:06:40,915 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:42973/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 01:06:41,172 [I] Table x_portal_user does not exist in database ranger
2026-08-12 01:06:41,172 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:42973/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 01:06:41,432 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 01:06:41,433 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:42973/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 01:06:41,684 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:42973/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 01:06:41,910 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 01:06:41,910 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:42973/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 01:06:42.817 UTC [23290] WARNING: there is no transaction in progress
2026-08-12 01:06:42.833 UTC [23290] WARNING: there is no transaction in progress
2026-08-12 01:06:42.848 UTC [23290] WARNING: there is no transaction in progress
2026-08-12 01:06:42.863 UTC [23290] WARNING: there is no transaction in progress
2026-08-12 01:06:42.877 UTC [23290] WARNING: there is no transaction in progress
2026-08-12 01:06:42.896 UTC [23290] WARNING: there is no transaction in progress
2026-08-12 01:06:42.957 UTC [23290] WARNING: there is no transaction in progress
2026-08-12 01:06:42.963 UTC [23290] WARNING: there is no transaction in progress
2026-08-12 01:06:42.976 UTC [23290] WARNING: there is no transaction in progress
2026-08-12 01:06:42.986 UTC [23290] WARNING: there is no transaction in progress
2026-08-12 01:06:42.995 UTC [23290] WARNING: there is no transaction in progress
2026-08-12 01:06:43.009 UTC [23290] WARNING: there is no transaction in progress
2026-08-12 01:06:43.018 UTC [23290] WARNING: there is no transaction in progress
2026-08-12 01:06:43.024 UTC [23290] WARNING: there is no transaction in progress
2026-08-12 01:06:43.029 UTC [23290] WARNING: there is no transaction in progress
2026-08-12 01:06:43.035 UTC [23290] WARNING: there is no transaction in progress
2026-08-12 01:06:43,612 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 01:06:43,613 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:42973/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 01:06:43,855 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 01:06:43,856 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:42973/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 01:06:44,100 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 01:06:44,100 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:42973/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 01:06:44,359 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 01:06:44,360 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:42973/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 01:06:44,614 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:42973/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 01:06:44,868 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:42973/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-bndk.c.gcp-upstream.internal';"
2026-08-12 01:06:45,096 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 01:06:45,097 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:42973/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 01:06:45,327 [I] DB_PATCHES have already been applied
I20260812 01:06:45.333179 4901 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ranger-admin:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskuEa_sO/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 01:06:45.333292 4901 mini_ranger.cc:193] Using host: 127.4.201.84
I20260812 01:06:45.354964 4901 mini_ranger.cc:227] Ranger admin URL: http://127.4.201.84:44085
Aug 12, 2026 1:06:45 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 1:06:45 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 1:06:45 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 1:06:45 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 1:06:45 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 1:06:46 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 1:06:46 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 01:06:46.665148 4901 mini_ranger.cc:160] Time spent starting Ranger: real 8.564s user 0.009s sys 0.056s
Aug 12, 2026 1:07:06 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 1:07:07 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 12, 2026 1:07:07 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 1:07:07 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 1:07:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 1:07:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 1:07:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 1:07:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 1:07:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 1:07:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 1:07:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 1:07:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 1:07:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 1:07:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 1:07:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 1:07:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 1:07:07 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 1:07:07 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 01:07:08.583707 4901 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.4.201.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.4.201.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.4.201.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/rangerkms_127.4.201.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.4.201.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/rangerkms_127.4.201.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.4.201.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.4.201.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.4.201.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/HTTP_127.4.201.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.4.201.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/HTTP_127.4.201.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 01:07:08 dist-test-slave-bndk krb5kdc[22966](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496828, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 01:07:08.788695 4901 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 01:07:08.814466 4901 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 01:07:09.535569 4901 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 01:07:09.535734 4901 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ranger-kms
I20260812 01:07:09.535861 4901 mini_ranger_kms.cc:227] Using postgres at 127.4.201.84:42973
2026-08-12 01:07:10,077 [I] DB FLAVOR :POSTGRES
2026-08-12 01:07:10,077 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 01:07:10,077 [I] Checking connection
2026-08-12 01:07:10,078 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:42973/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 01:07:10,308 [I] connection success
2026-08-12 01:07:10,309 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 01:07:10,309 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 01:07:10,309 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:42973/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 01:07:10,547 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 01:07:10,547 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 01:07:10,547 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 01:07:10,547 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:42973/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 01:07:10,823 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 01:07:11.240543 4901 mini_ranger_kms.cc:310] Created kms service
I20260812 01:07:11.423899 4901 mini_ranger_kms.cc:326] Created kudu user
I20260812 01:07:11.466380 4901 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 01:07:11 dist-test-slave-bndk krb5kdc[22966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496828, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.4.201.84@KRBTEST.COM
I20260812 01:07:11.863876 4901 mini_ranger_kms.cc:384] Added ranger policy
I20260812 01:07:11.865476 4901 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ranger-kms:/tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 01:07:11.865551 4901 mini_ranger_kms.cc:240] Using host: 127.4.201.84
I20260812 01:07:11.898348 4901 mini_ranger_kms.cc:276] Ranger KMS PID: 23567
I20260812 01:07:11.898517 4901 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.4.201.84:43807
Aug 12, 2026 1:07:12 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 1:07:12 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 1:07:13 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 1:07:13 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 1:07:13 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 1:07:13 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 01:07:14 dist-test-slave-bndk krb5kdc[22966](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786496834, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.4.201.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:07:14.513252 4901 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.725s user 0.127s sys 0.455s
I20260812 01:07:14.513584 4901 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 01:07:14.513785 4901 mini_ranger_kms.cc:401] 127.4.201.84:43807/kms/v1/keys
Aug 12 01:07:14 dist-test-slave-bndk krb5kdc[22966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496834, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.4.201.84@KRBTEST.COM for HTTP/127.4.201.84@KRBTEST.COM
Aug 12 01:07:15 dist-test-slave-bndk krb5kdc[22966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496834, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.4.201.84@KRBTEST.COM for HTTP/127.4.201.84@KRBTEST.COM
Aug 12 01:07:17 dist-test-slave-bndk krb5kdc[22966](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496837, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.4.201.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
I20260812 01:07:17.286020 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:38487
--webserver_interface=127.4.201.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:44251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:38487
--ranger_config_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.201.84:43807/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:07:17.633504 23644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:07:17.633785 23644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:07:17.633898 23644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:07:17.640916 23644 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:07:17.641018 23644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:07:17.641076 23644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:07:17.641152 23644 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:07:17.641230 23644 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:07:17.651553 23644 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:44251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/master-0/wal
--ranger_kms_url=127.4.201.84:43807/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:38487
--ranger_config_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:38487
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:07:17.652890 23644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:07:17.654313 23644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:07:17.667807 23652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:07:17.667840 23653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:07:17.668448 23656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:07:17.669028 23644 server_base.cc:1034] running on GCE node
I20260812 01:07:17.670004 23644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:07:17.671759 23644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:07:17.673005 23644 hybrid_clock.cc:648] HybridClock initialized: now 1786496837672942 us; error 43 us; skew 500 ppm
I20260812 01:07:17.673484 23644 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:07:17 dist-test-slave-bndk krb5kdc[22966](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496837, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:07:17.677378 23644 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:07:17.679061 23644 webserver.cc:460] Webserver started at http://127.4.201.126:44457/ using document root <none> and password file <none>
I20260812 01:07:17.679875 23644 fs_manager.cc:359] Metadata directory not provided
I20260812 01:07:17.680003 23644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:07:17.680321 23644 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 01:07:17 dist-test-slave-bndk krb5kdc[22966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496837, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for HTTP/127.4.201.84@KRBTEST.COM
I20260812 01:07:17.753727 23644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "3a029a0b126d433dbbd39cf6a6894948"
format_stamp: "Formatted at 2026-08-12 01:07:17 on dist-test-slave-bndk"
server_key: "0fc7c6d4f27b5bdab0e89203dc26f376"
server_key_iv: "a9de8569b1f436131ffdfbdf23af00a1"
server_key_version: "kuduclusterkey@0"
I20260812 01:07:17.754582 23644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "3a029a0b126d433dbbd39cf6a6894948"
format_stamp: "Formatted at 2026-08-12 01:07:17 on dist-test-slave-bndk"
server_key: "0fc7c6d4f27b5bdab0e89203dc26f376"
server_key_iv: "a9de8569b1f436131ffdfbdf23af00a1"
server_key_version: "kuduclusterkey@0"
I20260812 01:07:17.760218 23644 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260812 01:07:17.780052 23663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:07:17.781689 23644 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260812 01:07:17.781879 23644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "3a029a0b126d433dbbd39cf6a6894948"
format_stamp: "Formatted at 2026-08-12 01:07:17 on dist-test-slave-bndk"
server_key: "0fc7c6d4f27b5bdab0e89203dc26f376"
server_key_iv: "a9de8569b1f436131ffdfbdf23af00a1"
server_key_version: "kuduclusterkey@0"
I20260812 01:07:17.782107 23644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:07:17.806277 23644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:07:17.810236 23644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:07:17.810560 23644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:07:17.828899 23644 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:38487
I20260812 01:07:17.828933 23750 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:38487 every 8 connection(s)
I20260812 01:07:17.830266 23644 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:07:17.831905 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 23644
I20260812 01:07:17.832132 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:07:17.832953 4901 external_mini_cluster.cc:1428] Setting key 25edecfed85171f09ac2b829f60cd95c
I20260812 01:07:17.835091 23753 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 12 01:07:17 dist-test-slave-bndk krb5kdc[22966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496837, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:07:17.848301 23753 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a029a0b126d433dbbd39cf6a6894948: Bootstrap starting.
I20260812 01:07:17.851976 23753 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a029a0b126d433dbbd39cf6a6894948: Neither blocks nor log segments found. Creating new log.
I20260812 01:07:17.853137 23753 log.cc:824] T 00000000000000000000000000000000 P 3a029a0b126d433dbbd39cf6a6894948: Log is configured to *not* fsync() on all Append() calls
I20260812 01:07:17.855252 23756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:07:17.835029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49610 (local address 127.4.201.126:38487)
0812 01:07:17.835813 (+ 784us) server_negotiation.cc:206] Beginning negotiation
0812 01:07:17.835824 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:07:17.835865 (+ 41us) server_negotiation.cc:407] Connection header received
0812 01:07:17.837556 (+ 1691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:07:17.837579 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:07:17.837945 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:07:17.838265 (+ 320us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:07:17.839810 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:07:17.841249 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:07:17.842907 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:07:17.843545 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:07:17.843711 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:07:17.848109 (+ 4398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:07:17.848117 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:07:17.848131 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:07:17.848165 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:07:17.850979 (+ 2814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:07:17.851814 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:07:17.851820 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:07:17.851827 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:07:17.851994 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:07:17.852417 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:07:17.852420 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:07:17.852422 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:07:17.852916 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:07:17.853143 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0812 01:07:17.853674 (+ 531us) server_negotiation.cc:299] Negotiation successful
0812 01:07:17.854111 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":372,"threads_started":1}
I20260812 01:07:17.856300 23753 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a029a0b126d433dbbd39cf6a6894948: No bootstrap required, opened a new log
I20260812 01:07:17.864149 23753 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a029a0b126d433dbbd39cf6a6894948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a029a0b126d433dbbd39cf6a6894948" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38487 } }
I20260812 01:07:17.864506 23753 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a029a0b126d433dbbd39cf6a6894948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:07:17.864593 23753 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a029a0b126d433dbbd39cf6a6894948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a029a0b126d433dbbd39cf6a6894948, State: Initialized, Role: FOLLOWER
I20260812 01:07:17.865108 23753 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a029a0b126d433dbbd39cf6a6894948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a029a0b126d433dbbd39cf6a6894948" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38487 } }
I20260812 01:07:17.865352 23753 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3a029a0b126d433dbbd39cf6a6894948 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:07:17.865480 23753 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a029a0b126d433dbbd39cf6a6894948 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:07:17.865645 23753 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a029a0b126d433dbbd39cf6a6894948 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:07:17.868149 23753 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a029a0b126d433dbbd39cf6a6894948 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a029a0b126d433dbbd39cf6a6894948" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38487 } }
I20260812 01:07:17.868620 23753 leader_election.cc:302] T 00000000000000000000000000000000 P 3a029a0b126d433dbbd39cf6a6894948 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a029a0b126d433dbbd39cf6a6894948; no voters:
I20260812 01:07:17.869277 23753 leader_election.cc:288] T 00000000000000000000000000000000 P 3a029a0b126d433dbbd39cf6a6894948 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:07:17.869413 23758 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a029a0b126d433dbbd39cf6a6894948 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:07:17.870942 23758 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a029a0b126d433dbbd39cf6a6894948 [term 1 LEADER]: Becoming Leader. State: Replica: 3a029a0b126d433dbbd39cf6a6894948, State: Running, Role: LEADER
I20260812 01:07:17.871511 23753 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a029a0b126d433dbbd39cf6a6894948 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:07:17.871518 23758 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a029a0b126d433dbbd39cf6a6894948 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a029a0b126d433dbbd39cf6a6894948" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38487 } }
I20260812 01:07:17.874624 23759 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a029a0b126d433dbbd39cf6a6894948 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a029a0b126d433dbbd39cf6a6894948" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a029a0b126d433dbbd39cf6a6894948" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38487 } } }
I20260812 01:07:17.875195 23759 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a029a0b126d433dbbd39cf6a6894948 [sys.catalog]: This master's current role is: LEADER
I20260812 01:07:17.874703 23760 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a029a0b126d433dbbd39cf6a6894948 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a029a0b126d433dbbd39cf6a6894948. Latest consensus state: current_term: 1 leader_uuid: "3a029a0b126d433dbbd39cf6a6894948" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a029a0b126d433dbbd39cf6a6894948" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38487 } } }
I20260812 01:07:17.875663 23760 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a029a0b126d433dbbd39cf6a6894948 [sys.catalog]: This master's current role is: LEADER
I20260812 01:07:17.878589 23768 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:07:17.879045 23753 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 01:07:17.893985 23768 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:07:17.908660 23768 catalog_manager.cc:1347] Generated new cluster ID: 677fe418f8b04a9cb89d6c0e3705d16a
I20260812 01:07:17.908789 23768 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:07:17.928427 23768 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:07:17.930410 23768 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:07:17.956017 23768 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3a029a0b126d433dbbd39cf6a6894948: Generated new TSK 0
I20260812 01:07:17.957129 23768 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.201.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
I20260812 01:07:18.661140 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.201.84:43807/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:0
--local_ip_for_outbound_sockets=127.4.201.65
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:38487
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:44251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 01:07:18 dist-test-slave-bndk krb5kdc[22966](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786496838, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260812 01:07:19.093305 23810 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:07:19.093608 23810 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:07:19.093757 23810 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:07:19.101776 23810 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:07:19.101899 23810 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:07:19.102121 23810 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:07:19.112252 23810 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:44251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.4.201.84:43807/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:38487
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:07:19.113600 23810 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:07:19.114995 23810 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:07:19.130264 23829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:07:19.130507 23828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:07:19.130678 23831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:07:19.131510 23810 server_base.cc:1034] running on GCE node
I20260812 01:07:19.132145 23810 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:07:19.133157 23810 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:07:19.134418 23810 hybrid_clock.cc:648] HybridClock initialized: now 1786496839134363 us; error 48 us; skew 500 ppm
I20260812 01:07:19.134737 23810 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:07:19 dist-test-slave-bndk krb5kdc[22966](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496839, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:07:19.138386 23810 init.cc:377] Logged in from keytab as kudu/127.4.201.65@KRBTEST.COM (short username kudu)
I20260812 01:07:19.143234 23810 webserver.cc:460] Webserver started at http://127.4.201.65:37707/ using document root <none> and password file <none>
I20260812 01:07:19.144217 23810 fs_manager.cc:359] Metadata directory not provided
I20260812 01:07:19.144390 23810 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:07:19.144809 23810 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 01:07:19 dist-test-slave-bndk krb5kdc[22966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496839, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for HTTP/127.4.201.84@KRBTEST.COM
I20260812 01:07:19.176844 23810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-0/data/instance:
uuid: "2a461a67ff8d42ba80cbc8a1800bbe7f"
format_stamp: "Formatted at 2026-08-12 01:07:19 on dist-test-slave-bndk"
server_key: "e9908ce37fbaf4a5ffdf77bd482f59c6"
server_key_iv: "e9bf53ff920752298cb2f1a0575e9c15"
server_key_version: "kuduclusterkey@0"
I20260812 01:07:19.178059 23810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance:
uuid: "2a461a67ff8d42ba80cbc8a1800bbe7f"
format_stamp: "Formatted at 2026-08-12 01:07:19 on dist-test-slave-bndk"
server_key: "e9908ce37fbaf4a5ffdf77bd482f59c6"
server_key_iv: "e9bf53ff920752298cb2f1a0575e9c15"
server_key_version: "kuduclusterkey@0"
I20260812 01:07:19.185648 23810 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260812 01:07:19.214764 23840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:07:19.222793 23810 fs_manager.cc:725] Time spent opening block manager: real 0.020s user 0.002s sys 0.011s
I20260812 01:07:19.223111 23810 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "2a461a67ff8d42ba80cbc8a1800bbe7f"
format_stamp: "Formatted at 2026-08-12 01:07:19 on dist-test-slave-bndk"
server_key: "e9908ce37fbaf4a5ffdf77bd482f59c6"
server_key_iv: "e9bf53ff920752298cb2f1a0575e9c15"
server_key_version: "kuduclusterkey@0"
I20260812 01:07:19.223487 23810 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:07:19.266793 23810 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:07:19.272516 23810 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:07:19.273079 23810 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:07:19.274410 23810 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:07:19.277181 23810 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:07:19.277315 23810 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260812 01:07:19.277505 23810 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:07:19.277582 23810 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:07:19.313534 23810 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:42493
I20260812 01:07:19.313495 24019 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:42493 every 8 connection(s)
I20260812 01:07:19.315483 23810 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:07:19.319572 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 23810
I20260812 01:07:19.319765 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance
I20260812 01:07:19.320477 4901 external_mini_cluster.cc:1428] Setting key c3baa6c95590de8fd5f55d97620573ec
Aug 12 01:07:19 dist-test-slave-bndk krb5kdc[22966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496839, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:07:19.344326 24022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:07:19.318342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:49999 (local address 127.4.201.126:38487)
0812 01:07:19.318872 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0812 01:07:19.318880 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:07:19.319965 (+ 1085us) server_negotiation.cc:407] Connection header received
0812 01:07:19.322529 (+ 2564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:07:19.322536 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:07:19.322632 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:07:19.322722 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:07:19.325000 (+ 2278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:07:19.328745 (+ 3745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:07:19.332424 (+ 3679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:07:19.332993 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:07:19.333087 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:07:19.337455 (+ 4368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:07:19.337462 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:07:19.337466 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:07:19.337527 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:07:19.340679 (+ 3152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:07:19.341612 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:07:19.341618 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:07:19.341621 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:07:19.341774 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:07:19.342297 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:07:19.342303 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:07:19.342306 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:07:19.342661 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:07:19.342768 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 01:07:19.343732 (+ 964us) server_negotiation.cc:299] Negotiation successful
0812 01:07:19.343973 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":247,"threads_started":1}
I20260812 01:07:19.346122 24024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:07:19.318903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:38487 (local address 127.4.201.65:49999)
0812 01:07:19.319750 (+ 847us) negotiation.cc:107] Waiting for socket to connect
0812 01:07:19.319813 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0812 01:07:19.322202 (+ 2389us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:07:19.323325 (+ 1123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:07:19.323337 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:07:19.324004 (+ 667us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:07:19.324785 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:07:19.324811 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:07:19.330284 (+ 5473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:07:19.330291 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:07:19.332233 (+ 1942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:07:19.332261 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:07:19.333436 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:07:19.333442 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:07:19.333727 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:07:19.334507 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:07:19.334547 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:07:19.337177 (+ 2630us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:07:19.340878 (+ 3701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:07:19.340887 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:07:19.340904 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:07:19.341467 (+ 563us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:07:19.341919 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:07:19.341923 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:07:19.341927 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:07:19.342175 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:07:19.342847 (+ 672us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:07:19.342853 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:07:19.343234 (+ 381us) client_negotiation.cc:769] Sending connection context
0812 01:07:19.344649 (+ 1415us) client_negotiation.cc:240] Negotiation successful
0812 01:07:19.345065 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":2003,"threads_started":1}
I20260812 01:07:19.348409 24020 heartbeater.cc:347] Connected to a master server at 127.4.201.126:38487
I20260812 01:07:19.348729 24020 heartbeater.cc:464] Registering TS with master...
I20260812 01:07:19.349596 24020 heartbeater.cc:511] Master 127.4.201.126:38487 requested a full tablet report, sending...
I20260812 01:07:19.352047 23692 ts_manager.cc:194] Registered new tserver with Master: 2a461a67ff8d42ba80cbc8a1800bbe7f (127.4.201.65:42493)
I20260812 01:07:19.353775 23692 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.65@KRBTEST.COM'} at 127.4.201.65:49999
WARNING: no policy specified for kudu/127.4.201.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
I20260812 01:07:19.411077 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.201.84:43807/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:0
--local_ip_for_outbound_sockets=127.4.201.66
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:38487
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:44251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 01:07:19 dist-test-slave-bndk krb5kdc[22966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496838, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for HTTP/127.4.201.84@KRBTEST.COM
Aug 12 01:07:19 dist-test-slave-bndk krb5kdc[22966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496838, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for HTTP/127.4.201.84@KRBTEST.COM
W20260812 01:07:20.060189 24027 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:07:20.060715 24027 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:07:20.060946 24027 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:07:20.070430 24027 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:07:20.070653 24027 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:07:20.070909 24027 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:07:20.082373 24027 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:44251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.4.201.84:43807/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:38487
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:07:20.083637 24027 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:07:20.085034 24027 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:07:20.100989 24046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:07:20.101271 24049 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:07:20.101470 24044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:07:20.101917 24027 server_base.cc:1034] running on GCE node
I20260812 01:07:20.102625 24027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:07:20.103721 24027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:07:20.104962 24027 hybrid_clock.cc:648] HybridClock initialized: now 1786496840104878 us; error 84 us; skew 500 ppm
I20260812 01:07:20.105351 24027 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:07:20 dist-test-slave-bndk krb5kdc[22966](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496840, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:07:20.109421 24027 init.cc:377] Logged in from keytab as kudu/127.4.201.66@KRBTEST.COM (short username kudu)
I20260812 01:07:20.111115 24027 webserver.cc:460] Webserver started at http://127.4.201.66:44725/ using document root <none> and password file <none>
I20260812 01:07:20.111958 24027 fs_manager.cc:359] Metadata directory not provided
I20260812 01:07:20.112097 24027 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:07:20.112457 24027 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 01:07:20 dist-test-slave-bndk krb5kdc[22966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496840, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for HTTP/127.4.201.84@KRBTEST.COM
I20260812 01:07:20.129938 24027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-1/data/instance:
uuid: "666e086de2b8406e9075e975d86c4fa3"
format_stamp: "Formatted at 2026-08-12 01:07:20 on dist-test-slave-bndk"
server_key: "9b67551906377848fe8c65afec881efd"
server_key_iv: "0984267c09258518d872a6c90123aaea"
server_key_version: "kuduclusterkey@0"
I20260812 01:07:20.130862 24027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance:
uuid: "666e086de2b8406e9075e975d86c4fa3"
format_stamp: "Formatted at 2026-08-12 01:07:20 on dist-test-slave-bndk"
server_key: "9b67551906377848fe8c65afec881efd"
server_key_iv: "0984267c09258518d872a6c90123aaea"
server_key_version: "kuduclusterkey@0"
I20260812 01:07:20.136900 24027 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260812 01:07:20.154341 24062 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:07:20.156315 24027 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.004s
I20260812 01:07:20.156505 24027 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "666e086de2b8406e9075e975d86c4fa3"
format_stamp: "Formatted at 2026-08-12 01:07:20 on dist-test-slave-bndk"
server_key: "9b67551906377848fe8c65afec881efd"
server_key_iv: "0984267c09258518d872a6c90123aaea"
server_key_version: "kuduclusterkey@0"
I20260812 01:07:20.156754 24027 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:07:20.191635 24027 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:07:20.196913 24027 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:07:20.197342 24027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:07:20.198670 24027 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:07:20.200544 24027 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:07:20.200642 24027 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:07:20.200768 24027 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:07:20.200837 24027 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:07:20.262029 24027 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:41489
I20260812 01:07:20.262089 24224 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:41489 every 8 connection(s)
I20260812 01:07:20.263938 24027 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:07:20.268332 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 24027
I20260812 01:07:20.268491 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance
I20260812 01:07:20.269009 4901 external_mini_cluster.cc:1428] Setting key b14d7f332c1d5262d4a64f85c6a234d7
Aug 12 01:07:20 dist-test-slave-bndk krb5kdc[22966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496840, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:07:20.296490 24229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:07:20.269453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:53943 (local address 127.4.201.126:38487)
0812 01:07:20.275158 (+ 5705us) server_negotiation.cc:206] Beginning negotiation
0812 01:07:20.275164 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:07:20.275186 (+ 22us) server_negotiation.cc:407] Connection header received
0812 01:07:20.277658 (+ 2472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:07:20.277665 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:07:20.277758 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:07:20.277878 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:07:20.279990 (+ 2112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:07:20.281136 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:07:20.283560 (+ 2424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:07:20.284171 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:07:20.284264 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:07:20.289171 (+ 4907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:07:20.289178 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:07:20.289183 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:07:20.289255 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:07:20.292565 (+ 3310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:07:20.293647 (+ 1082us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:07:20.293652 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:07:20.293656 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:07:20.293814 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:07:20.294380 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:07:20.294385 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:07:20.294389 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:07:20.294740 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:07:20.294889 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 01:07:20.295843 (+ 954us) server_negotiation.cc:299] Negotiation successful
0812 01:07:20.296074 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5585,"thread_start_us":8541,"threads_started":1}
I20260812 01:07:20.299005 24228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:07:20.267515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:38487 (local address 127.4.201.66:53943)
0812 01:07:20.274181 (+ 6666us) negotiation.cc:107] Waiting for socket to connect
0812 01:07:20.274248 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0812 01:07:20.277118 (+ 2870us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:07:20.278331 (+ 1213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:07:20.278343 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:07:20.278966 (+ 623us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:07:20.279774 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:07:20.279816 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:07:20.281389 (+ 1573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:07:20.281395 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:07:20.283384 (+ 1989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:07:20.283409 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:07:20.284650 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:07:20.284658 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:07:20.284975 (+ 317us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:07:20.285844 (+ 869us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:07:20.285873 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:07:20.288925 (+ 3052us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:07:20.292762 (+ 3837us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:07:20.292771 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:07:20.292789 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:07:20.293504 (+ 715us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:07:20.294010 (+ 506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:07:20.294014 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:07:20.294018 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:07:20.294254 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:07:20.294991 (+ 737us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:07:20.294999 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:07:20.295405 (+ 406us) client_negotiation.cc:769] Sending connection context
0812 01:07:20.297055 (+ 1650us) client_negotiation.cc:240] Negotiation successful
0812 01:07:20.297630 (+ 575us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6351,"thread_start_us":9588,"threads_started":1}
I20260812 01:07:20.300894 24225 heartbeater.cc:347] Connected to a master server at 127.4.201.126:38487
I20260812 01:07:20.301250 24225 heartbeater.cc:464] Registering TS with master...
I20260812 01:07:20.302093 24225 heartbeater.cc:511] Master 127.4.201.126:38487 requested a full tablet report, sending...
I20260812 01:07:20.303840 23692 ts_manager.cc:194] Registered new tserver with Master: 666e086de2b8406e9075e975d86c4fa3 (127.4.201.66:41489)
I20260812 01:07:20.304917 23692 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.66@KRBTEST.COM'} at 127.4.201.66:53943
WARNING: no policy specified for kudu/127.4.201.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
I20260812 01:07:20.352291 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.201.84:43807/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:0
--local_ip_for_outbound_sockets=127.4.201.67
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:38487
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:44251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:07:20.357560 24020 heartbeater.cc:503] Master 127.4.201.126:38487 was elected leader, sending a full tablet report...
W20260812 01:07:20.815672 24235 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:07:20.816046 24235 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:07:20.816243 24235 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:07:20.825032 24235 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:07:20.825156 24235 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:07:20.825376 24235 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:07:20.837246 24235 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:44251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.4.201.84:43807/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:38487
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:07:20.838503 24235 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:07:20.839910 24235 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:07:20.858409 24244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:07:20.858419 24245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:07:20.858655 24247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:07:20.860570 24235 server_base.cc:1034] running on GCE node
I20260812 01:07:20.861379 24235 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:07:20.862417 24235 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:07:20.863652 24235 hybrid_clock.cc:648] HybridClock initialized: now 1786496840863566 us; error 58 us; skew 500 ppm
I20260812 01:07:20.863996 24235 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:07:20 dist-test-slave-bndk krb5kdc[22966](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496840, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:07:20.869308 24235 init.cc:377] Logged in from keytab as kudu/127.4.201.67@KRBTEST.COM (short username kudu)
I20260812 01:07:20.871793 24235 webserver.cc:460] Webserver started at http://127.4.201.67:43739/ using document root <none> and password file <none>
I20260812 01:07:20.872980 24235 fs_manager.cc:359] Metadata directory not provided
I20260812 01:07:20.873253 24235 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:07:20.873759 24235 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 01:07:20 dist-test-slave-bndk krb5kdc[22966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496840, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for HTTP/127.4.201.84@KRBTEST.COM
I20260812 01:07:20.895457 24235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-2/data/instance:
uuid: "480ece8a1ad0430c8cc2d091d09538c7"
format_stamp: "Formatted at 2026-08-12 01:07:20 on dist-test-slave-bndk"
server_key: "238dcdd99c0b7f85157351f219ab5b33"
server_key_iv: "f81fd72bb9bcc5ea7b5d33f44b96ead2"
server_key_version: "kuduclusterkey@0"
I20260812 01:07:20.896992 24235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance:
uuid: "480ece8a1ad0430c8cc2d091d09538c7"
format_stamp: "Formatted at 2026-08-12 01:07:20 on dist-test-slave-bndk"
server_key: "238dcdd99c0b7f85157351f219ab5b33"
server_key_iv: "f81fd72bb9bcc5ea7b5d33f44b96ead2"
server_key_version: "kuduclusterkey@0"
I20260812 01:07:20.905602 24235 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.006s sys 0.001s
I20260812 01:07:20.927078 24255 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:07:20.928874 24235 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.000s sys 0.004s
I20260812 01:07:20.929162 24235 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "480ece8a1ad0430c8cc2d091d09538c7"
format_stamp: "Formatted at 2026-08-12 01:07:20 on dist-test-slave-bndk"
server_key: "238dcdd99c0b7f85157351f219ab5b33"
server_key_iv: "f81fd72bb9bcc5ea7b5d33f44b96ead2"
server_key_version: "kuduclusterkey@0"
I20260812 01:07:20.929554 24235 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:07:20.955255 24235 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:07:20.961246 24235 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:07:20.961665 24235 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:07:20.963281 24235 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:07:20.965884 24235 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:07:20.966045 24235 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:07:20.966266 24235 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:07:20.966384 24235 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:07:21.047201 24235 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:43157
I20260812 01:07:21.047258 24429 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:43157 every 8 connection(s)
I20260812 01:07:21.049064 24235 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:07:21.050328 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 24235
I20260812 01:07:21.050520 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance
I20260812 01:07:21.051079 4901 external_mini_cluster.cc:1428] Setting key 09a7e7f3b62155af3f597bd833817119
Aug 12 01:07:21 dist-test-slave-bndk krb5kdc[22966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496840, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:07:21.075177 24433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:07:21.052684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:40025 (local address 127.4.201.126:38487)
0812 01:07:21.053511 (+ 827us) server_negotiation.cc:206] Beginning negotiation
0812 01:07:21.053517 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:07:21.054703 (+ 1186us) server_negotiation.cc:407] Connection header received
0812 01:07:21.057065 (+ 2362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:07:21.057071 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:07:21.057181 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:07:21.057305 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:07:21.059249 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.060066 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.062241 (+ 2175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.062937 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.063060 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:07:21.067655 (+ 4595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:07:21.067660 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:07:21.067664 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:07:21.067732 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:07:21.071571 (+ 3839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:07:21.072451 (+ 880us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:07:21.072455 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:07:21.072458 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:07:21.072642 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:07:21.073166 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:07:21.073170 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:07:21.073173 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:07:21.073498 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:07:21.073639 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 01:07:21.074327 (+ 688us) server_negotiation.cc:299] Negotiation successful
0812 01:07:21.074588 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":681,"thread_start_us":450,"threads_started":1}
I20260812 01:07:21.076233 24435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:07:21.053450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:38487 (local address 127.4.201.67:40025)
0812 01:07:21.054535 (+ 1085us) negotiation.cc:107] Waiting for socket to connect
0812 01:07:21.054600 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0812 01:07:21.056808 (+ 2208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:07:21.057623 (+ 815us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:07:21.057632 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:07:21.058271 (+ 639us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:07:21.059081 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:07:21.059101 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.060278 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.060282 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:07:21.062085 (+ 1803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:07:21.062098 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.063244 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.063255 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:07:21.063577 (+ 322us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:07:21.064332 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:07:21.064355 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:07:21.067437 (+ 3082us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:07:21.071746 (+ 4309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:07:21.071754 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:07:21.071767 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:07:21.072326 (+ 559us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:07:21.072754 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:07:21.072758 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:07:21.072762 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:07:21.073051 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:07:21.073627 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:07:21.073634 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:07:21.073968 (+ 334us) client_negotiation.cc:769] Sending connection context
0812 01:07:21.074205 (+ 237us) client_negotiation.cc:240] Negotiation successful
0812 01:07:21.074746 (+ 541us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":762,"thread_start_us":489,"threads_started":1}
I20260812 01:07:21.077601 24430 heartbeater.cc:347] Connected to a master server at 127.4.201.126:38487
I20260812 01:07:21.078011 24430 heartbeater.cc:464] Registering TS with master...
I20260812 01:07:21.079149 24430 heartbeater.cc:511] Master 127.4.201.126:38487 requested a full tablet report, sending...
I20260812 01:07:21.080747 23692 ts_manager.cc:194] Registered new tserver with Master: 480ece8a1ad0430c8cc2d091d09538c7 (127.4.201.67:43157)
I20260812 01:07:21.081853 23692 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.67@KRBTEST.COM'} at 127.4.201.67:40025
I20260812 01:07:21.092044 4901 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:07:21.111497 24433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:07:21.097950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49616 (local address 127.4.201.126:38487)
0812 01:07:21.098107 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 01:07:21.098112 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:07:21.098564 (+ 452us) server_negotiation.cc:407] Connection header received
0812 01:07:21.098722 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:07:21.098725 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:07:21.098830 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:07:21.098909 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:07:21.101024 (+ 2115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.101843 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.103159 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.103587 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.103698 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:07:21.106439 (+ 2741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:07:21.106444 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:07:21.106448 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:07:21.106480 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:07:21.109078 (+ 2598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:07:21.109684 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:07:21.109687 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:07:21.109689 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:07:21.109837 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:07:21.110159 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:07:21.110162 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:07:21.110164 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:07:21.110479 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:07:21.110709 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0812 01:07:21.110924 (+ 215us) server_negotiation.cc:299] Negotiation successful
0812 01:07:21.111122 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 01:07:21.115526 23692 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49616:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:07:21.123062 23692 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:07:21.161336 24451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:07:21.138207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:41489 (local address 127.0.0.1:60852)
0812 01:07:21.149701 (+ 11494us) negotiation.cc:107] Waiting for socket to connect
0812 01:07:21.149723 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 01:07:21.149896 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:07:21.151080 (+ 1184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:07:21.151090 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:07:21.151126 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:07:21.152677 (+ 1551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:07:21.152698 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.155077 (+ 2379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.155086 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:07:21.157891 (+ 2805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:07:21.157907 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.160276 (+ 2369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.160282 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:07:21.160479 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:07:21.160532 (+ 53us) client_negotiation.cc:769] Sending connection context
0812 01:07:21.160674 (+ 142us) client_negotiation.cc:240] Negotiation successful
0812 01:07:21.160860 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11329,"mutex_wait_us":2,"thread_start_us":11051,"threads_started":1}
I20260812 01:07:21.161984 24447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:07:21.137116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:43157 (local address 127.0.0.1:37388)
0812 01:07:21.138375 (+ 1259us) negotiation.cc:107] Waiting for socket to connect
0812 01:07:21.138417 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 01:07:21.138586 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:07:21.154044 (+ 15458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:07:21.154049 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:07:21.154076 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:07:21.154549 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:07:21.154563 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.156081 (+ 1518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.156087 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:07:21.158792 (+ 2705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:07:21.158805 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.160789 (+ 1984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.160797 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:07:21.160998 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:07:21.161023 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 01:07:21.161101 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 01:07:21.161267 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":985,"mutex_wait_us":20,"thread_start_us":1047,"threads_started":1}
I20260812 01:07:21.162437 24449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:07:21.137774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37388 (local address 127.4.201.67:43157)
0812 01:07:21.153385 (+ 15611us) server_negotiation.cc:206] Beginning negotiation
0812 01:07:21.153393 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:07:21.153450 (+ 57us) server_negotiation.cc:407] Connection header received
0812 01:07:21.153536 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:07:21.153543 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:07:21.153797 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:07:21.154042 (+ 245us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:07:21.154751 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.155929 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.158974 (+ 3045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.160524 (+ 1550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.160638 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:07:21.160871 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0812 01:07:21.161173 (+ 302us) server_negotiation.cc:299] Negotiation successful
0812 01:07:21.161363 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15343,"thread_start_us":15060,"threads_started":1}
I20260812 01:07:21.162570 24448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:07:21.137976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60852 (local address 127.4.201.66:41489)
0812 01:07:21.149899 (+ 11923us) server_negotiation.cc:206] Beginning negotiation
0812 01:07:21.149908 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:07:21.149940 (+ 32us) server_negotiation.cc:407] Connection header received
0812 01:07:21.150056 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:07:21.150066 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:07:21.150392 (+ 326us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:07:21.150604 (+ 212us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:07:21.153448 (+ 2844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.154921 (+ 1473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.158091 (+ 3170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.159799 (+ 1708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.159932 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:07:21.160136 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0812 01:07:21.161878 (+ 1742us) server_negotiation.cc:299] Negotiation successful
0812 01:07:21.162049 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11739,"thread_start_us":11629,"threads_started":1}
I20260812 01:07:21.163292 24453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:07:21.139205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44198 (local address 127.4.201.65:42493)
0812 01:07:21.152038 (+ 12833us) server_negotiation.cc:206] Beginning negotiation
0812 01:07:21.152048 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:07:21.153245 (+ 1197us) server_negotiation.cc:407] Connection header received
0812 01:07:21.153437 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:07:21.153446 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:07:21.154476 (+ 1030us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:07:21.154662 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:07:21.155711 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.156848 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.159651 (+ 2803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.161177 (+ 1526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.161324 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:07:21.161549 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0812 01:07:21.162416 (+ 867us) server_negotiation.cc:299] Negotiation successful
0812 01:07:21.162775 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12637,"thread_start_us":13034,"threads_started":1}
I20260812 01:07:21.163769 24452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:07:21.138995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:42493 (local address 127.0.0.1:44198)
0812 01:07:21.153104 (+ 14109us) negotiation.cc:107] Waiting for socket to connect
0812 01:07:21.153122 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 01:07:21.153264 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:07:21.154674 (+ 1410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:07:21.154678 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:07:21.154701 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:07:21.155492 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:07:21.155508 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.157095 (+ 1587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.157099 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:07:21.159456 (+ 2357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:07:21.159472 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.161755 (+ 2283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.161763 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:07:21.162094 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:07:21.162127 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 01:07:21.162344 (+ 217us) client_negotiation.cc:240] Negotiation successful
0812 01:07:21.162469 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13999,"thread_start_us":13871,"threads_started":1}
I20260812 01:07:21.166411 24129 tablet_service.cc:1467] Processing CreateTablet for tablet f30309da0c9146d585be7a6d0573bbbc (DEFAULT_TABLE table=test-table [id=0b8dae73debc45b1ace3265e0804d4bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:07:21.166687 24331 tablet_service.cc:1467] Processing CreateTablet for tablet f30309da0c9146d585be7a6d0573bbbc (DEFAULT_TABLE table=test-table [id=0b8dae73debc45b1ace3265e0804d4bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:07:21.168107 24129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f30309da0c9146d585be7a6d0573bbbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:07:21.168356 24331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f30309da0c9146d585be7a6d0573bbbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:07:21.167807 23912 tablet_service.cc:1467] Processing CreateTablet for tablet f30309da0c9146d585be7a6d0573bbbc (DEFAULT_TABLE table=test-table [id=0b8dae73debc45b1ace3265e0804d4bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:07:21.169622 23912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f30309da0c9146d585be7a6d0573bbbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:07:21.182303 24455 tablet_bootstrap.cc:492] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3: Bootstrap starting.
I20260812 01:07:21.188274 24459 tablet_bootstrap.cc:492] T f30309da0c9146d585be7a6d0573bbbc P 2a461a67ff8d42ba80cbc8a1800bbe7f: Bootstrap starting.
I20260812 01:07:21.188925 24455 tablet_bootstrap.cc:654] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3: Neither blocks nor log segments found. Creating new log.
I20260812 01:07:21.190505 24458 tablet_bootstrap.cc:492] T f30309da0c9146d585be7a6d0573bbbc P 480ece8a1ad0430c8cc2d091d09538c7: Bootstrap starting.
I20260812 01:07:21.191563 24455 log.cc:824] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3: Log is configured to *not* fsync() on all Append() calls
I20260812 01:07:21.194371 24459 tablet_bootstrap.cc:654] T f30309da0c9146d585be7a6d0573bbbc P 2a461a67ff8d42ba80cbc8a1800bbe7f: Neither blocks nor log segments found. Creating new log.
I20260812 01:07:21.196300 24458 tablet_bootstrap.cc:654] T f30309da0c9146d585be7a6d0573bbbc P 480ece8a1ad0430c8cc2d091d09538c7: Neither blocks nor log segments found. Creating new log.
I20260812 01:07:21.196868 24459 log.cc:824] T f30309da0c9146d585be7a6d0573bbbc P 2a461a67ff8d42ba80cbc8a1800bbe7f: Log is configured to *not* fsync() on all Append() calls
I20260812 01:07:21.197736 24455 tablet_bootstrap.cc:492] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3: No bootstrap required, opened a new log
I20260812 01:07:21.198231 24455 ts_tablet_manager.cc:1397] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.006s
I20260812 01:07:21.198606 24458 log.cc:824] T f30309da0c9146d585be7a6d0573bbbc P 480ece8a1ad0430c8cc2d091d09538c7: Log is configured to *not* fsync() on all Append() calls
I20260812 01:07:21.202150 24459 tablet_bootstrap.cc:492] T f30309da0c9146d585be7a6d0573bbbc P 2a461a67ff8d42ba80cbc8a1800bbe7f: No bootstrap required, opened a new log
I20260812 01:07:21.202611 24459 ts_tablet_manager.cc:1397] T f30309da0c9146d585be7a6d0573bbbc P 2a461a67ff8d42ba80cbc8a1800bbe7f: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.005s
I20260812 01:07:21.209146 24458 tablet_bootstrap.cc:492] T f30309da0c9146d585be7a6d0573bbbc P 480ece8a1ad0430c8cc2d091d09538c7: No bootstrap required, opened a new log
I20260812 01:07:21.209547 24458 ts_tablet_manager.cc:1397] T f30309da0c9146d585be7a6d0573bbbc P 480ece8a1ad0430c8cc2d091d09538c7: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.013s
I20260812 01:07:21.216398 24455 raft_consensus.cc:348] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "480ece8a1ad0430c8cc2d091d09538c7" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 43157 } } peers { permanent_uuid: "2a461a67ff8d42ba80cbc8a1800bbe7f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42493 } } peers { permanent_uuid: "666e086de2b8406e9075e975d86c4fa3" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 41489 } }
I20260812 01:07:21.217110 24455 raft_consensus.cc:374] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:07:21.217317 24455 raft_consensus.cc:729] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 666e086de2b8406e9075e975d86c4fa3, State: Initialized, Role: FOLLOWER
I20260812 01:07:21.218191 24455 consensus_queue.cc:260] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "480ece8a1ad0430c8cc2d091d09538c7" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 43157 } } peers { permanent_uuid: "2a461a67ff8d42ba80cbc8a1800bbe7f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42493 } } peers { permanent_uuid: "666e086de2b8406e9075e975d86c4fa3" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 41489 } }
I20260812 01:07:21.219383 24459 raft_consensus.cc:348] T f30309da0c9146d585be7a6d0573bbbc P 2a461a67ff8d42ba80cbc8a1800bbe7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "480ece8a1ad0430c8cc2d091d09538c7" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 43157 } } peers { permanent_uuid: "2a461a67ff8d42ba80cbc8a1800bbe7f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42493 } } peers { permanent_uuid: "666e086de2b8406e9075e975d86c4fa3" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 41489 } }
I20260812 01:07:21.220043 24459 raft_consensus.cc:374] T f30309da0c9146d585be7a6d0573bbbc P 2a461a67ff8d42ba80cbc8a1800bbe7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:07:21.220245 24459 raft_consensus.cc:729] T f30309da0c9146d585be7a6d0573bbbc P 2a461a67ff8d42ba80cbc8a1800bbe7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a461a67ff8d42ba80cbc8a1800bbe7f, State: Initialized, Role: FOLLOWER
I20260812 01:07:21.220609 24225 heartbeater.cc:503] Master 127.4.201.126:38487 was elected leader, sending a full tablet report...
I20260812 01:07:21.221464 24455 ts_tablet_manager.cc:1428] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3: Time spent starting tablet: real 0.023s user 0.007s sys 0.016s
I20260812 01:07:21.221143 24459 consensus_queue.cc:260] T f30309da0c9146d585be7a6d0573bbbc P 2a461a67ff8d42ba80cbc8a1800bbe7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "480ece8a1ad0430c8cc2d091d09538c7" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 43157 } } peers { permanent_uuid: "2a461a67ff8d42ba80cbc8a1800bbe7f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42493 } } peers { permanent_uuid: "666e086de2b8406e9075e975d86c4fa3" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 41489 } }
I20260812 01:07:21.223747 24459 ts_tablet_manager.cc:1428] T f30309da0c9146d585be7a6d0573bbbc P 2a461a67ff8d42ba80cbc8a1800bbe7f: Time spent starting tablet: real 0.021s user 0.011s sys 0.010s
I20260812 01:07:21.223915 24458 raft_consensus.cc:348] T f30309da0c9146d585be7a6d0573bbbc P 480ece8a1ad0430c8cc2d091d09538c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "480ece8a1ad0430c8cc2d091d09538c7" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 43157 } } peers { permanent_uuid: "2a461a67ff8d42ba80cbc8a1800bbe7f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42493 } } peers { permanent_uuid: "666e086de2b8406e9075e975d86c4fa3" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 41489 } }
I20260812 01:07:21.224609 24458 raft_consensus.cc:374] T f30309da0c9146d585be7a6d0573bbbc P 480ece8a1ad0430c8cc2d091d09538c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:07:21.224808 24458 raft_consensus.cc:729] T f30309da0c9146d585be7a6d0573bbbc P 480ece8a1ad0430c8cc2d091d09538c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 480ece8a1ad0430c8cc2d091d09538c7, State: Initialized, Role: FOLLOWER
I20260812 01:07:21.225696 24458 consensus_queue.cc:260] T f30309da0c9146d585be7a6d0573bbbc P 480ece8a1ad0430c8cc2d091d09538c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "480ece8a1ad0430c8cc2d091d09538c7" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 43157 } } peers { permanent_uuid: "2a461a67ff8d42ba80cbc8a1800bbe7f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42493 } } peers { permanent_uuid: "666e086de2b8406e9075e975d86c4fa3" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 41489 } }
I20260812 01:07:21.229153 24430 heartbeater.cc:503] Master 127.4.201.126:38487 was elected leader, sending a full tablet report...
I20260812 01:07:21.229775 24458 ts_tablet_manager.cc:1428] T f30309da0c9146d585be7a6d0573bbbc P 480ece8a1ad0430c8cc2d091d09538c7: Time spent starting tablet: real 0.020s user 0.010s sys 0.010s
W20260812 01:07:21.274641 24227 tablet.cc:2369] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:07:21.302103 24431 tablet.cc:2369] T f30309da0c9146d585be7a6d0573bbbc P 480ece8a1ad0430c8cc2d091d09538c7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:07:21.318540 24021 tablet.cc:2369] T f30309da0c9146d585be7a6d0573bbbc P 2a461a67ff8d42ba80cbc8a1800bbe7f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:07:21.414143 24464 raft_consensus.cc:482] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:07:21.414716 24464 raft_consensus.cc:504] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "480ece8a1ad0430c8cc2d091d09538c7" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 43157 } } peers { permanent_uuid: "2a461a67ff8d42ba80cbc8a1800bbe7f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42493 } } peers { permanent_uuid: "666e086de2b8406e9075e975d86c4fa3" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 41489 } }
I20260812 01:07:21.417321 24464 leader_election.cc:288] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 480ece8a1ad0430c8cc2d091d09538c7 (127.4.201.67:43157), 2a461a67ff8d42ba80cbc8a1800bbe7f (127.4.201.65:42493)
I20260812 01:07:21.428081 24449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:07:21.417696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:56491 (local address 127.4.201.67:43157)
0812 01:07:21.417996 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0812 01:07:21.418002 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:07:21.419616 (+ 1614us) server_negotiation.cc:407] Connection header received
0812 01:07:21.419920 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:07:21.419926 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:07:21.420022 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:07:21.420111 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:07:21.421634 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.422727 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.425833 (+ 3106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.426810 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.427041 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:07:21.427127 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 01:07:21.427588 (+ 461us) server_negotiation.cc:299] Negotiation successful
0812 01:07:21.427718 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 01:07:21.428385 24469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:07:21.418122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:43157 (local address 127.4.201.66:56491)
0812 01:07:21.419492 (+ 1370us) negotiation.cc:107] Waiting for socket to connect
0812 01:07:21.419513 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 01:07:21.419722 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:07:21.420474 (+ 752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:07:21.420488 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:07:21.420517 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:07:21.421461 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:07:21.421476 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.422905 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.422909 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:07:21.425680 (+ 2771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:07:21.425693 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.427213 (+ 1520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.427220 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:07:21.427420 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:07:21.427447 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 01:07:21.427544 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 01:07:21.427683 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1191,"mutex_wait_us":21,"thread_start_us":873,"threads_started":1}
I20260812 01:07:21.430035 24453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:07:21.420336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:58375 (local address 127.4.201.65:42493)
0812 01:07:21.420619 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0812 01:07:21.420624 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:07:21.421354 (+ 730us) server_negotiation.cc:407] Connection header received
0812 01:07:21.421589 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:07:21.421593 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:07:21.421654 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:07:21.421728 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:07:21.423172 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.424312 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.427447 (+ 3135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.428935 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.429165 (+ 230us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:07:21.429273 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 01:07:21.429571 (+ 298us) server_negotiation.cc:299] Negotiation successful
0812 01:07:21.429694 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 01:07:21.429904 24358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f30309da0c9146d585be7a6d0573bbbc" candidate_uuid: "666e086de2b8406e9075e975d86c4fa3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "480ece8a1ad0430c8cc2d091d09538c7" is_pre_election: true
I20260812 01:07:21.430337 24470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:07:21.419634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:42493 (local address 127.4.201.66:58375)
0812 01:07:21.421248 (+ 1614us) negotiation.cc:107] Waiting for socket to connect
0812 01:07:21.421267 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 01:07:21.421444 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:07:21.421757 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:07:21.421761 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:07:21.421785 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:07:21.422950 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:07:21.422963 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.424445 (+ 1482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.424449 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:07:21.427257 (+ 2808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:07:21.427270 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.429190 (+ 1920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.429197 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:07:21.429398 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:07:21.429423 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 01:07:21.429517 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 01:07:21.429644 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1429,"mutex_wait_us":18,"thread_start_us":1086,"threads_started":1}
I20260812 01:07:21.430763 24358 raft_consensus.cc:2454] T f30309da0c9146d585be7a6d0573bbbc P 480ece8a1ad0430c8cc2d091d09538c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 666e086de2b8406e9075e975d86c4fa3 in term 0.
I20260812 01:07:21.431747 24065 leader_election.cc:302] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 480ece8a1ad0430c8cc2d091d09538c7, 666e086de2b8406e9075e975d86c4fa3; no voters:
I20260812 01:07:21.432426 24464 raft_consensus.cc:2781] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:07:21.431986 23941 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f30309da0c9146d585be7a6d0573bbbc" candidate_uuid: "666e086de2b8406e9075e975d86c4fa3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a461a67ff8d42ba80cbc8a1800bbe7f" is_pre_election: true
I20260812 01:07:21.432675 24464 raft_consensus.cc:482] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:07:21.432876 24464 raft_consensus.cc:3037] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:07:21.432993 23941 raft_consensus.cc:2454] T f30309da0c9146d585be7a6d0573bbbc P 2a461a67ff8d42ba80cbc8a1800bbe7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 666e086de2b8406e9075e975d86c4fa3 in term 0.
I20260812 01:07:21.437235 24464 raft_consensus.cc:504] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "480ece8a1ad0430c8cc2d091d09538c7" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 43157 } } peers { permanent_uuid: "2a461a67ff8d42ba80cbc8a1800bbe7f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42493 } } peers { permanent_uuid: "666e086de2b8406e9075e975d86c4fa3" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 41489 } }
I20260812 01:07:21.437947 24464 leader_election.cc:288] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3 [CANDIDATE]: Term 1 election: Requested vote from peers 480ece8a1ad0430c8cc2d091d09538c7 (127.4.201.67:43157), 2a461a67ff8d42ba80cbc8a1800bbe7f (127.4.201.65:42493)
I20260812 01:07:21.438555 24358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f30309da0c9146d585be7a6d0573bbbc" candidate_uuid: "666e086de2b8406e9075e975d86c4fa3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "480ece8a1ad0430c8cc2d091d09538c7"
I20260812 01:07:21.438582 23941 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f30309da0c9146d585be7a6d0573bbbc" candidate_uuid: "666e086de2b8406e9075e975d86c4fa3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a461a67ff8d42ba80cbc8a1800bbe7f"
I20260812 01:07:21.438807 24358 raft_consensus.cc:3037] T f30309da0c9146d585be7a6d0573bbbc P 480ece8a1ad0430c8cc2d091d09538c7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:07:21.438858 23941 raft_consensus.cc:3037] T f30309da0c9146d585be7a6d0573bbbc P 2a461a67ff8d42ba80cbc8a1800bbe7f [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:07:21.442602 24358 raft_consensus.cc:2454] T f30309da0c9146d585be7a6d0573bbbc P 480ece8a1ad0430c8cc2d091d09538c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666e086de2b8406e9075e975d86c4fa3 in term 1.
I20260812 01:07:21.442965 23941 raft_consensus.cc:2454] T f30309da0c9146d585be7a6d0573bbbc P 2a461a67ff8d42ba80cbc8a1800bbe7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666e086de2b8406e9075e975d86c4fa3 in term 1.
I20260812 01:07:21.443114 24065 leader_election.cc:302] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 480ece8a1ad0430c8cc2d091d09538c7, 666e086de2b8406e9075e975d86c4fa3; no voters:
I20260812 01:07:21.443429 24464 raft_consensus.cc:2781] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:07:21.444126 24464 raft_consensus.cc:686] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3 [term 1 LEADER]: Becoming Leader. State: Replica: 666e086de2b8406e9075e975d86c4fa3, State: Running, Role: LEADER
I20260812 01:07:21.444671 24464 consensus_queue.cc:237] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "480ece8a1ad0430c8cc2d091d09538c7" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 43157 } } peers { permanent_uuid: "2a461a67ff8d42ba80cbc8a1800bbe7f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42493 } } peers { permanent_uuid: "666e086de2b8406e9075e975d86c4fa3" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 41489 } }
I20260812 01:07:21.449734 23692 catalog_manager.cc:5495] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 666e086de2b8406e9075e975d86c4fa3 (127.4.201.66). New cstate: current_term: 1 leader_uuid: "666e086de2b8406e9075e975d86c4fa3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "480ece8a1ad0430c8cc2d091d09538c7" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 43157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a461a67ff8d42ba80cbc8a1800bbe7f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "666e086de2b8406e9075e975d86c4fa3" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 41489 } health_report { overall_health: HEALTHY } } }
I20260812 01:07:21.517804 24448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:07:21.511501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60854 (local address 127.4.201.66:41489)
0812 01:07:21.511732 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0812 01:07:21.511739 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:07:21.511815 (+ 76us) server_negotiation.cc:407] Connection header received
0812 01:07:21.512044 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:07:21.512049 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:07:21.512128 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:07:21.512261 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:07:21.512723 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.513733 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.515248 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.515890 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.516008 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:07:21.516608 (+ 600us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:07:21.517117 (+ 509us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:07:21.517292 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0812 01:07:21.517387 (+ 95us) server_negotiation.cc:299] Negotiation successful
0812 01:07:21.517481 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 01:07:21.527215 24358 raft_consensus.cc:1261] T f30309da0c9146d585be7a6d0573bbbc P 480ece8a1ad0430c8cc2d091d09538c7 [term 1 FOLLOWER]: Refusing update from remote peer 666e086de2b8406e9075e975d86c4fa3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:07:21.527215 23941 raft_consensus.cc:1261] T f30309da0c9146d585be7a6d0573bbbc P 2a461a67ff8d42ba80cbc8a1800bbe7f [term 1 FOLLOWER]: Refusing update from remote peer 666e086de2b8406e9075e975d86c4fa3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:07:21.528209 24471 consensus_queue.cc:1035] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a461a67ff8d42ba80cbc8a1800bbe7f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 42493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:07:21.528664 24464 consensus_queue.cc:1035] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "480ece8a1ad0430c8cc2d091d09538c7" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 43157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:07:21.550113 24476 mvcc.cc:205] Tried to move back new op lower bound from 7317491062884163584 to 7317491062561501184. Current Snapshot: MvccSnapshot[applied={T|T < 7317491062884163584 or (T in {7317491062884163584})}]
I20260812 01:07:21.550487 24477 mvcc.cc:205] Tried to move back new op lower bound from 7317491062884163584 to 7317491062561501184. Current Snapshot: MvccSnapshot[applied={T|T < 7317491062884163584 or (T in {7317491062884163584})}]
I20260812 01:07:21.557758 23689 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49616:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:07:21.558156 23689 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49616:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:07:21.562677 23689 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3a029a0b126d433dbbd39cf6a6894948: Sending DeleteTablet for 3 replicas of tablet f30309da0c9146d585be7a6d0573bbbc
I20260812 01:07:21.563886 24331 tablet_service.cc:1514] Processing DeleteTablet for tablet f30309da0c9146d585be7a6d0573bbbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:07:21 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:37388
I20260812 01:07:21.564226 23912 tablet_service.cc:1514] Processing DeleteTablet for tablet f30309da0c9146d585be7a6d0573bbbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:07:21 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:44198
I20260812 01:07:21.564298 24129 tablet_service.cc:1514] Processing DeleteTablet for tablet f30309da0c9146d585be7a6d0573bbbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:07:21 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:60852
I20260812 01:07:21.568001 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 23810
I20260812 01:07:21.571579 24490 tablet_replica.cc:330] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3: stopping tablet replica
I20260812 01:07:21.571995 24486 tablet_replica.cc:330] T f30309da0c9146d585be7a6d0573bbbc P 480ece8a1ad0430c8cc2d091d09538c7: stopping tablet replica
I20260812 01:07:21.572045 24490 raft_consensus.cc:2229] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3 [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:07:21.572451 24486 raft_consensus.cc:2229] T f30309da0c9146d585be7a6d0573bbbc P 480ece8a1ad0430c8cc2d091d09538c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:07:21.572719 24490 raft_consensus.cc:2258] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:07:21.572963 24486 raft_consensus.cc:2258] T f30309da0c9146d585be7a6d0573bbbc P 480ece8a1ad0430c8cc2d091d09538c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:07:21.573490 24488 tablet_replica.cc:330] T f30309da0c9146d585be7a6d0573bbbc P 2a461a67ff8d42ba80cbc8a1800bbe7f: stopping tablet replica
I20260812 01:07:21.573866 24488 raft_consensus.cc:2229] T f30309da0c9146d585be7a6d0573bbbc P 2a461a67ff8d42ba80cbc8a1800bbe7f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:07:21.574368 24488 raft_consensus.cc:2258] T f30309da0c9146d585be7a6d0573bbbc P 2a461a67ff8d42ba80cbc8a1800bbe7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:07:21.575145 24486 ts_tablet_manager.cc:1905] T f30309da0c9146d585be7a6d0573bbbc P 480ece8a1ad0430c8cc2d091d09538c7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:07:21.575172 24490 ts_tablet_manager.cc:1905] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:07:21.577934 24488 ts_tablet_manager.cc:1905] T f30309da0c9146d585be7a6d0573bbbc P 2a461a67ff8d42ba80cbc8a1800bbe7f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:07:21.583140 24486 ts_tablet_manager.cc:1918] T f30309da0c9146d585be7a6d0573bbbc P 480ece8a1ad0430c8cc2d091d09538c7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:07:21.583317 24486 log.cc:1196] T f30309da0c9146d585be7a6d0573bbbc P 480ece8a1ad0430c8cc2d091d09538c7: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-2/wal/wals/f30309da0c9146d585be7a6d0573bbbc
I20260812 01:07:21.583874 24486 ts_tablet_manager.cc:1939] T f30309da0c9146d585be7a6d0573bbbc P 480ece8a1ad0430c8cc2d091d09538c7: Deleting consensus metadata
I20260812 01:07:21.584935 24490 ts_tablet_manager.cc:1918] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:07:21.585127 24490 log.cc:1196] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-1/wal/wals/f30309da0c9146d585be7a6d0573bbbc
I20260812 01:07:21.585857 23667 catalog_manager.cc:4841] TS 480ece8a1ad0430c8cc2d091d09538c7 (127.4.201.67:43157): tablet f30309da0c9146d585be7a6d0573bbbc (table test-table [id=0b8dae73debc45b1ace3265e0804d4bb]) successfully deleted
I20260812 01:07:21.586351 24490 ts_tablet_manager.cc:1939] T f30309da0c9146d585be7a6d0573bbbc P 666e086de2b8406e9075e975d86c4fa3: Deleting consensus metadata
I20260812 01:07:21.588500 23664 catalog_manager.cc:4841] TS 666e086de2b8406e9075e975d86c4fa3 (127.4.201.66:41489): tablet f30309da0c9146d585be7a6d0573bbbc (table test-table [id=0b8dae73debc45b1ace3265e0804d4bb]) successfully deleted
I20260812 01:07:21.591904 24488 ts_tablet_manager.cc:1918] T f30309da0c9146d585be7a6d0573bbbc P 2a461a67ff8d42ba80cbc8a1800bbe7f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
Aug 12 01:07:21 dist-test-slave-bndk krb5kdc[22966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496837, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.65@KRBTEST.COM
I20260812 01:07:21.592082 24488 log.cc:1196] T f30309da0c9146d585be7a6d0573bbbc P 2a461a67ff8d42ba80cbc8a1800bbe7f: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786496689953932-4901-0/minicluster-data/ts-0/wal/wals/f30309da0c9146d585be7a6d0573bbbc
I20260812 01:07:21.592670 24488 ts_tablet_manager.cc:1939] T f30309da0c9146d585be7a6d0573bbbc P 2a461a67ff8d42ba80cbc8a1800bbe7f: Deleting consensus metadata
I20260812 01:07:21.594617 23667 catalog_manager.cc:4841] TS 2a461a67ff8d42ba80cbc8a1800bbe7f (127.4.201.65:42493): tablet f30309da0c9146d585be7a6d0573bbbc (table test-table [id=0b8dae73debc45b1ace3265e0804d4bb]) successfully deleted
I20260812 01:07:21.600344 24453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:07:21.569877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44208 (local address 127.4.201.65:42493)
0812 01:07:21.570081 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 01:07:21.570088 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:07:21.576263 (+ 6175us) server_negotiation.cc:407] Connection header received
0812 01:07:21.576450 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:07:21.576456 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:07:21.576561 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:07:21.576659 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:07:21.583432 (+ 6773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.584537 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.586911 (+ 2374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.587546 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.587655 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:07:21.593344 (+ 5689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:07:21.593357 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:07:21.593376 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:07:21.593420 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:07:21.597059 (+ 3639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:07:21.597793 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:07:21.597803 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:07:21.597805 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:07:21.598003 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:07:21.598410 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:07:21.598413 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:07:21.598416 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:07:21.598948 (+ 532us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:07:21.599417 (+ 469us) server_negotiation.cc:1035] Waiting for connection context
0812 01:07:21.599615 (+ 198us) server_negotiation.cc:299] Negotiation successful
0812 01:07:21.599829 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 01:07:21.601080 24015 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:07:21.704336 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 23810
I20260812 01:07:21.735004 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 24027
Aug 12 01:07:21 dist-test-slave-bndk krb5kdc[22966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496837, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.66@KRBTEST.COM
I20260812 01:07:21.754877 24448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:07:21.735903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60858 (local address 127.4.201.66:41489)
0812 01:07:21.736091 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 01:07:21.736098 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:07:21.736197 (+ 99us) server_negotiation.cc:407] Connection header received
0812 01:07:21.736394 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:07:21.736400 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:07:21.736488 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:07:21.736605 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:07:21.738426 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.739668 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.741431 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.742115 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.742248 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:07:21.747621 (+ 5373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:07:21.747642 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:07:21.747666 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:07:21.747733 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:07:21.751134 (+ 3401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:07:21.751998 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:07:21.752007 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:07:21.752010 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:07:21.752181 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:07:21.752571 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:07:21.752574 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:07:21.752576 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:07:21.752938 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:07:21.753209 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0812 01:07:21.754223 (+ 1014us) server_negotiation.cc:299] Negotiation successful
0812 01:07:21.754467 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 01:07:21.755707 24219 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:07:21.872447 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 24027
I20260812 01:07:21.898875 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 24235
Aug 12 01:07:21 dist-test-slave-bndk krb5kdc[22966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496837, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.67@KRBTEST.COM
I20260812 01:07:21.913614 24449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:07:21.899671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37394 (local address 127.4.201.67:43157)
0812 01:07:21.899855 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 01:07:21.899861 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:07:21.899883 (+ 22us) server_negotiation.cc:407] Connection header received
0812 01:07:21.900107 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:07:21.900111 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:07:21.900188 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:07:21.900275 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:07:21.901704 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.902415 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.903681 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:07:21.904075 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:07:21.904188 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:07:21.908441 (+ 4253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:07:21.908456 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:07:21.908488 (+ 32us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:07:21.908524 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:07:21.911325 (+ 2801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:07:21.911919 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:07:21.911925 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:07:21.911927 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:07:21.912053 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:07:21.912316 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:07:21.912319 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:07:21.912321 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:07:21.912692 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:07:21.912905 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0812 01:07:21.913103 (+ 198us) server_negotiation.cc:299] Negotiation successful
0812 01:07:21.913321 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 01:07:21.914235 24421 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:07:22.001766 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 24235
I20260812 01:07:22.027343 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 23644
I20260812 01:07:22.028622 23745 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:07:22.141425 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 23644
I20260812 01:07:22.175516 4901 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 01:07:22.520202 4901 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 01:07:22.520514 4901 mini_ranger.cc:66] Stopping Ranger...
I20260812 01:07:22.864789 4901 mini_ranger.cc:68] Stopped Ranger
2026-08-12 01:07:22.865 UTC [23014] LOG: received smart shutdown request
2026-08-12 01:07:22.868 UTC [23014] LOG: background worker "logical replication launcher" (PID 23036) exited with exit code 1
2026-08-12 01:07:22.869 UTC [23027] LOG: shutting down
2026-08-12 01:07:23.013 UTC [23014] LOG: database system is shut down
2026-08-12T01:07:23Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (50054 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:07:23 dist-test-slave-bndk krb5kdc[24514](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:07:23 dist-test-slave-bndk krb5kdc[24514](info): set up 2 sockets
Aug 12 01:07:23 dist-test-slave-bndk krb5kdc[24514](info): commencing operation
krb5kdc: starting...
W20260812 01:07:24.366371 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.205s user 0.003s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:07:24 dist-test-slave-bndk krb5kdc[24514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496844, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:07:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:07:24Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.4.201.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.4.201.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.4.201.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/rangeradmin_127.4.201.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.4.201.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/rangeradmin_127.4.201.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.4.201.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.4.201.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.4.201.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/rangerlookup_127.4.201.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.4.201.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/rangerlookup_127.4.201.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.4.201.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.4.201.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.4.201.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/HTTP_127.4.201.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.4.201.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/HTTP_127.4.201.84@KRBTEST.COM.keytab.
I20260812 01:07:24.713630 4901 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskuEa_sO/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/postgres -l logfile start
2026-08-12 01:07:26.885 UTC [24557] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 01:07:26.885 UTC [24557] LOG: listening on IPv4 address "127.4.201.84", port 55091
2026-08-12 01:07:26.888 UTC [24557] LOG: listening on Unix socket "/tmp/.s.PGSQL.55091"
2026-08-12 01:07:26.907 UTC [24560] LOG: database system was shut down at 2026-08-12 01:07:25 UTC
2026-08-12 01:07:26.911 UTC [24557] LOG: database system is ready to accept connections
I20260812 01:07:27.998565 4901 mini_postgres.cc:96] Postgres bound to 55091
2026-08-12 01:07:28.020 UTC [24574] FATAL: database "slave" does not exist
127.4.201.84:55091 - accepting connections
I20260812 01:07:28.021525 4901 mini_ranger.cc:161] Starting Ranger...
I20260812 01:07:28.049431 4901 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 01:07:28.445250 4901 mini_ranger.cc:87] Created ranger Postgres database
I20260812 01:07:28.445354 4901 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ranger-admin
2026-08-12 01:07:28,747 [I] DB FLAVOR :POSTGRES
2026-08-12 01:07:28,747 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 01:07:28,747 [I] Checking connection..
2026-08-12 01:07:28,747 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:55091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 01:07:28,990 [I] Checking connection passed.
2026-08-12 01:07:28,990 [I] --------- Verifying version history table ---------
2026-08-12 01:07:28,990 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:55091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 01:07:29,253 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 01:07:29,253 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:55091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 01:07:29,508 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 01:07:29,508 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 01:07:29,509 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:55091/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 01:07:29.764 UTC [24675] WARNING: there is no transaction in progress
2026-08-12 01:07:29,770 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 01:07:29,770 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:55091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 01:07:30,030 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 01:07:30,030 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 01:07:30,030 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:55091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 01:07:30,281 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:55091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 01:07:30,516 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:55091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-bndk.c.gcp-upstream.internal','N') ;"
2026-08-12 01:07:30,737 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:55091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 01:07:30,990 [I] Table x_portal_user does not exist in database ranger
2026-08-12 01:07:30,990 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:55091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 01:07:31,245 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 01:07:31,245 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:55091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 01:07:31,500 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:55091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 01:07:31,752 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 01:07:31,753 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:55091/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 01:07:32.628 UTC [24842] WARNING: there is no transaction in progress
2026-08-12 01:07:32.642 UTC [24842] WARNING: there is no transaction in progress
2026-08-12 01:07:32.656 UTC [24842] WARNING: there is no transaction in progress
2026-08-12 01:07:32.669 UTC [24842] WARNING: there is no transaction in progress
2026-08-12 01:07:32.682 UTC [24842] WARNING: there is no transaction in progress
2026-08-12 01:07:32.699 UTC [24842] WARNING: there is no transaction in progress
2026-08-12 01:07:32.759 UTC [24842] WARNING: there is no transaction in progress
2026-08-12 01:07:32.765 UTC [24842] WARNING: there is no transaction in progress
2026-08-12 01:07:32.778 UTC [24842] WARNING: there is no transaction in progress
2026-08-12 01:07:32.787 UTC [24842] WARNING: there is no transaction in progress
2026-08-12 01:07:32.797 UTC [24842] WARNING: there is no transaction in progress
2026-08-12 01:07:32.809 UTC [24842] WARNING: there is no transaction in progress
2026-08-12 01:07:32.817 UTC [24842] WARNING: there is no transaction in progress
2026-08-12 01:07:32.823 UTC [24842] WARNING: there is no transaction in progress
2026-08-12 01:07:32.829 UTC [24842] WARNING: there is no transaction in progress
2026-08-12 01:07:32.835 UTC [24842] WARNING: there is no transaction in progress
2026-08-12 01:07:33,379 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 01:07:33,379 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:55091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 01:07:33,624 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 01:07:33,625 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:55091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 01:07:33,877 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 01:07:33,878 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:55091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 01:07:34,136 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 01:07:34,137 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:55091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 01:07:34,392 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:55091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 01:07:34,648 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:55091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-bndk.c.gcp-upstream.internal';"
2026-08-12 01:07:34,899 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 01:07:34,900 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:55091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 01:07:35,155 [I] DB_PATCHES have already been applied
I20260812 01:07:35.161173 4901 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ranger-admin:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskuEa_sO/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 01:07:35.161283 4901 mini_ranger.cc:193] Using host: 127.4.201.84
I20260812 01:07:35.180625 4901 mini_ranger.cc:227] Ranger admin URL: http://127.4.201.84:41799
Aug 12, 2026 1:07:35 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 1:07:35 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 1:07:35 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 1:07:35 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 1:07:35 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 1:07:36 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 1:07:36 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 01:07:36.441915 4901 mini_ranger.cc:160] Time spent starting Ranger: real 8.420s user 0.011s sys 0.043s
Aug 12, 2026 1:07:55 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 1:07:55 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 12, 2026 1:07:55 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 1:07:55 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 1:07:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 1:07:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 1:07:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 1:07:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 1:07:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 1:07:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 1:07:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 1:07:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 1:07:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 1:07:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 1:07:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 1:07:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 1:07:55 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 1:07:56 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 01:07:57.076201 4901 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.4.201.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.4.201.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.4.201.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/rangerkms_127.4.201.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.4.201.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/rangerkms_127.4.201.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.4.201.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.4.201.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.4.201.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/HTTP_127.4.201.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.4.201.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/HTTP_127.4.201.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 01:07:57 dist-test-slave-bndk krb5kdc[24514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496877, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 01:07:57.278051 4901 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 01:07:57.304711 4901 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 01:07:58.042482 4901 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 01:07:58.042586 4901 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ranger-kms
I20260812 01:07:58.042639 4901 mini_ranger_kms.cc:227] Using postgres at 127.4.201.84:55091
2026-08-12 01:07:58,392 [I] DB FLAVOR :POSTGRES
2026-08-12 01:07:58,393 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 01:07:58,393 [I] Checking connection
2026-08-12 01:07:58,393 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:55091/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 01:07:58,697 [I] connection success
2026-08-12 01:07:58,697 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 01:07:58,698 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 01:07:58,698 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:55091/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 01:07:58,996 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 01:07:58,997 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 01:07:58,997 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 01:07:58,997 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.201.84:55091/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 01:07:59,306 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 01:07:59.745561 4901 mini_ranger_kms.cc:310] Created kms service
I20260812 01:07:59.914794 4901 mini_ranger_kms.cc:326] Created kudu user
I20260812 01:07:59.958426 4901 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 01:07:59 dist-test-slave-bndk krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496877, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.4.201.84@KRBTEST.COM
I20260812 01:08:00.363402 4901 mini_ranger_kms.cc:384] Added ranger policy
I20260812 01:08:00.363730 4901 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ranger-kms:/tmp/dist-test-taskuEa_sO/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskuEa_sO/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 01:08:00.363801 4901 mini_ranger_kms.cc:240] Using host: 127.4.201.84
I20260812 01:08:00.389496 4901 mini_ranger_kms.cc:276] Ranger KMS PID: 25110
I20260812 01:08:00.389670 4901 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.4.201.84:45745
Aug 12, 2026 1:08:01 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 1:08:01 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 1:08:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 1:08:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 1:08:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 1:08:01 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 01:08:02 dist-test-slave-bndk krb5kdc[24514](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786496882, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.4.201.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:08:02.977649 4901 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.700s user 0.083s sys 0.302s
I20260812 01:08:02.977918 4901 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 01:08:02.978124 4901 mini_ranger_kms.cc:401] 127.4.201.84:45745/kms/v1/keys
Aug 12 01:08:03 dist-test-slave-bndk krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496882, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.4.201.84@KRBTEST.COM for HTTP/127.4.201.84@KRBTEST.COM
Aug 12 01:08:03 dist-test-slave-bndk krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496882, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.4.201.84@KRBTEST.COM for HTTP/127.4.201.84@KRBTEST.COM
Aug 12 01:08:05 dist-test-slave-bndk krb5kdc[24514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.4.201.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
I20260812 01:08:05.908648 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:42601
--webserver_interface=127.4.201.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:38425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:42601
--ranger_config_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.201.84:45745/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:08:06.257548 25191 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:08:06.257838 25191 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:08:06.257987 25191 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:08:06.265326 25191 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:08:06.265435 25191 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:08:06.265518 25191 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:08:06.265591 25191 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:08:06.265661 25191 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:08:06.275600 25191 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:38425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/wal
--ranger_kms_url=127.4.201.84:45745/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:42601
--ranger_config_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:42601
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:08:06.276837 25191 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:08:06.278158 25191 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:08:06.289602 25200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:06.289645 25201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:06.289614 25204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:08:06.290066 25191 server_base.cc:1034] running on GCE node
I20260812 01:08:06.290990 25191 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:08:06.292331 25191 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:08:06.293532 25191 hybrid_clock.cc:648] HybridClock initialized: now 1786496886293484 us; error 32 us; skew 500 ppm
I20260812 01:08:06.293843 25191 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:08:06 dist-test-slave-bndk krb5kdc[24514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496886, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:08:06.296844 25191 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:08:06.298290 25191 webserver.cc:460] Webserver started at http://127.4.201.126:34591/ using document root <none> and password file <none>
I20260812 01:08:06.298982 25191 fs_manager.cc:359] Metadata directory not provided
I20260812 01:08:06.299094 25191 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:08:06.299392 25191 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 01:08:06 dist-test-slave-bndk krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496886, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for HTTP/127.4.201.84@KRBTEST.COM
I20260812 01:08:06.357867 25191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "eafdf9df2c2f4fab9c0d5970a0a6e48b"
format_stamp: "Formatted at 2026-08-12 01:08:06 on dist-test-slave-bndk"
server_key: "d4590a9a1ebb76ee27df1bc320d48b97"
server_key_iv: "dd9753dc971c2dcd54176cf0dd26ad83"
server_key_version: "kuduclusterkey@0"
I20260812 01:08:06.358740 25191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "eafdf9df2c2f4fab9c0d5970a0a6e48b"
format_stamp: "Formatted at 2026-08-12 01:08:06 on dist-test-slave-bndk"
server_key: "d4590a9a1ebb76ee27df1bc320d48b97"
server_key_iv: "dd9753dc971c2dcd54176cf0dd26ad83"
server_key_version: "kuduclusterkey@0"
I20260812 01:08:06.364125 25191 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260812 01:08:06.384164 25213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:06.385900 25191 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 01:08:06.386118 25191 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "eafdf9df2c2f4fab9c0d5970a0a6e48b"
format_stamp: "Formatted at 2026-08-12 01:08:06 on dist-test-slave-bndk"
server_key: "d4590a9a1ebb76ee27df1bc320d48b97"
server_key_iv: "dd9753dc971c2dcd54176cf0dd26ad83"
server_key_version: "kuduclusterkey@0"
I20260812 01:08:06.386420 25191 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:08:06.409911 25191 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:08:06.414614 25191 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:08:06.414975 25191 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:08:06.434031 25191 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:42601
I20260812 01:08:06.434046 25298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:42601 every 8 connection(s)
I20260812 01:08:06.435350 25191 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:08:06.436429 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 25191
I20260812 01:08:06.436661 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:08:06.437567 4901 external_mini_cluster.cc:1428] Setting key fe7320b034915cc40df531e90afea1bd
I20260812 01:08:06.440079 25299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 12 01:08:06 dist-test-slave-bndk krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:08:06.451735 25299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b: Bootstrap starting.
I20260812 01:08:06.454938 25299 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b: Neither blocks nor log segments found. Creating new log.
I20260812 01:08:06.455935 25299 log.cc:824] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b: Log is configured to *not* fsync() on all Append() calls
I20260812 01:08:06.458737 25299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b: No bootstrap required, opened a new log
I20260812 01:08:06.458961 25303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:06.439676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38504 (local address 127.4.201.126:42601)
0812 01:08:06.440422 (+ 746us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:06.440434 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:06.440475 (+ 41us) server_negotiation.cc:407] Connection header received
0812 01:08:06.442078 (+ 1603us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:06.442100 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:06.442460 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:06.442792 (+ 332us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:06.444466 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:06.445894 (+ 1428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:06.447613 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:06.448252 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:06.448378 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:06.452204 (+ 3826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:06.452211 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:06.452225 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:06.452264 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:06.455126 (+ 2862us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:06.455780 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:06.455787 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:06.455794 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:06.455956 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:06.456337 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:06.456341 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:06.456343 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:06.456862 (+ 519us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:06.457183 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:06.457663 (+ 480us) server_negotiation.cc:299] Negotiation successful
0812 01:08:06.458039 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":368,"threads_started":1}
I20260812 01:08:06.466569 25299 raft_consensus.cc:348] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eafdf9df2c2f4fab9c0d5970a0a6e48b" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 42601 } }
I20260812 01:08:06.466950 25299 raft_consensus.cc:374] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:08:06.467067 25299 raft_consensus.cc:729] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafdf9df2c2f4fab9c0d5970a0a6e48b, State: Initialized, Role: FOLLOWER
I20260812 01:08:06.467660 25299 consensus_queue.cc:260] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eafdf9df2c2f4fab9c0d5970a0a6e48b" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 42601 } }
I20260812 01:08:06.467873 25299 raft_consensus.cc:388] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:08:06.468009 25299 raft_consensus.cc:482] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:08:06.468170 25299 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:08:06.470274 25299 raft_consensus.cc:504] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eafdf9df2c2f4fab9c0d5970a0a6e48b" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 42601 } }
I20260812 01:08:06.470742 25299 leader_election.cc:302] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eafdf9df2c2f4fab9c0d5970a0a6e48b; no voters:
I20260812 01:08:06.471312 25299 leader_election.cc:288] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:08:06.471459 25307 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:08:06.472527 25307 raft_consensus.cc:686] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [term 1 LEADER]: Becoming Leader. State: Replica: eafdf9df2c2f4fab9c0d5970a0a6e48b, State: Running, Role: LEADER
I20260812 01:08:06.473049 25307 consensus_queue.cc:237] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eafdf9df2c2f4fab9c0d5970a0a6e48b" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 42601 } }
I20260812 01:08:06.473528 25299 sys_catalog.cc:564] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:08:06.475852 25308 sys_catalog.cc:455] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eafdf9df2c2f4fab9c0d5970a0a6e48b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eafdf9df2c2f4fab9c0d5970a0a6e48b" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 42601 } } }
I20260812 01:08:06.475942 25309 sys_catalog.cc:455] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [sys.catalog]: SysCatalogTable state changed. Reason: New leader eafdf9df2c2f4fab9c0d5970a0a6e48b. Latest consensus state: current_term: 1 leader_uuid: "eafdf9df2c2f4fab9c0d5970a0a6e48b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eafdf9df2c2f4fab9c0d5970a0a6e48b" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 42601 } } }
I20260812 01:08:06.476284 25308 sys_catalog.cc:458] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [sys.catalog]: This master's current role is: LEADER
I20260812 01:08:06.476291 25309 sys_catalog.cc:458] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [sys.catalog]: This master's current role is: LEADER
I20260812 01:08:06.482137 25317 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:08:06.487149 25317 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:08:06.487967 25299 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 01:08:06.508708 25317 catalog_manager.cc:1347] Generated new cluster ID: eb7a5aec0ed54341a83685d1d134376b
I20260812 01:08:06.508864 25317 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:08:06.538738 25317 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:08:06.540892 25317 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:08:06.550153 25317 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b: Generated new TSK 0
I20260812 01:08:06.551191 25317 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.201.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
I20260812 01:08:07.278864 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.201.84:45745/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:0
--local_ip_for_outbound_sockets=127.4.201.65
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:42601
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:38425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 01:08:07 dist-test-slave-bndk krb5kdc[24514](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786496887, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260812 01:08:07.678614 25366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:08:07.678902 25366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:08:07.679061 25366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:08:07.688028 25366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:08:07.688150 25366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:08:07.688329 25366 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:08:07.703323 25366 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:38425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.4.201.84:45745/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:42601
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:08:07.705420 25366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:08:07.707371 25366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:08:07.745937 25381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:07.746884 25383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:08:07.761659 25366 server_base.cc:1034] running on GCE node
W20260812 01:08:07.762130 25385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:08:07.762873 25366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:08:07.763999 25366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:08:07.765292 25366 hybrid_clock.cc:648] HybridClock initialized: now 1786496887765215 us; error 61 us; skew 500 ppm
I20260812 01:08:07.765753 25366 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:08:07 dist-test-slave-bndk krb5kdc[24514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496887, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:08:07.770382 25366 init.cc:377] Logged in from keytab as kudu/127.4.201.65@KRBTEST.COM (short username kudu)
I20260812 01:08:07.795426 25366 webserver.cc:460] Webserver started at http://127.4.201.65:33517/ using document root <none> and password file <none>
I20260812 01:08:07.796684 25366 fs_manager.cc:359] Metadata directory not provided
I20260812 01:08:07.796940 25366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:08:07.797422 25366 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 01:08:07 dist-test-slave-bndk krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496887, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for HTTP/127.4.201.84@KRBTEST.COM
I20260812 01:08:07.823676 25366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-0/data/instance:
uuid: "c894d3e120054c0cb189b9fe6b2319e4"
format_stamp: "Formatted at 2026-08-12 01:08:07 on dist-test-slave-bndk"
server_key: "d93d1a09d0637a4d1094db9e1705b740"
server_key_iv: "89a89ec3ea30150b96177bf2d442bee1"
server_key_version: "kuduclusterkey@0"
I20260812 01:08:07.824851 25366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance:
uuid: "c894d3e120054c0cb189b9fe6b2319e4"
format_stamp: "Formatted at 2026-08-12 01:08:07 on dist-test-slave-bndk"
server_key: "d93d1a09d0637a4d1094db9e1705b740"
server_key_iv: "89a89ec3ea30150b96177bf2d442bee1"
server_key_version: "kuduclusterkey@0"
I20260812 01:08:07.832477 25366 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.001s
I20260812 01:08:07.869982 25399 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:07.875293 25366 fs_manager.cc:725] Time spent opening block manager: real 0.023s user 0.013s sys 0.004s
I20260812 01:08:07.875584 25366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "c894d3e120054c0cb189b9fe6b2319e4"
format_stamp: "Formatted at 2026-08-12 01:08:07 on dist-test-slave-bndk"
server_key: "d93d1a09d0637a4d1094db9e1705b740"
server_key_iv: "89a89ec3ea30150b96177bf2d442bee1"
server_key_version: "kuduclusterkey@0"
I20260812 01:08:07.875947 25366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:08:07.953197 25366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:08:07.958637 25366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:08:07.959065 25366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:08:07.966645 25366 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:08:07.975023 25366 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:08:07.975206 25366 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:07.975421 25366 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:08:07.975559 25366 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 01:08:08 dist-test-slave-bndk krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496887, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for HTTP/127.4.201.84@KRBTEST.COM
I20260812 01:08:08.210391 25366 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:46105
I20260812 01:08:08.210389 25572 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:46105 every 8 connection(s)
I20260812 01:08:08.212059 25366 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:08:08.216753 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 25366
I20260812 01:08:08.216966 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance
I20260812 01:08:08.217875 4901 external_mini_cluster.cc:1428] Setting key f3173023fa4950673abef1b43d2f9d6a
Aug 12 01:08:08 dist-test-slave-bndk krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496887, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.201.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.66@KRBTEST.COM" created.
I20260812 01:08:08.267720 25583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:08.215893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:42601 (local address 127.4.201.65:59009)
0812 01:08:08.227551 (+ 11658us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:08.227617 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:08.229991 (+ 2374us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:08.230831 (+ 840us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:08.230843 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:08.231495 (+ 652us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:08:08.232451 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:08.232479 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:08.233739 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:08.233743 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:08.235018 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:08.235033 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:08.235954 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:08.235963 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:08.236190 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:08.241061 (+ 4871us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:08:08.241098 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:08:08.258081 (+ 16983us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:08:08.262612 (+ 4531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:08.262624 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:08.262645 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:08.263282 (+ 637us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:08.263770 (+ 488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:08.263774 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:08.263777 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:08.264040 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:08.264815 (+ 775us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:08:08.264824 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:08:08.265351 (+ 527us) client_negotiation.cc:769] Sending connection context
0812 01:08:08.265692 (+ 341us) client_negotiation.cc:240] Negotiation successful
0812 01:08:08.266256 (+ 564us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11298,"thread_start_us":11017,"threads_started":1}
I20260812 01:08:08.268780 25582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:08.215150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:59009 (local address 127.4.201.126:42601)
0812 01:08:08.229601 (+ 14451us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:08.229608 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:08.229631 (+ 23us) server_negotiation.cc:407] Connection header received
0812 01:08:08.230316 (+ 685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:08.230322 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:08.230426 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:08.230550 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:08.232659 (+ 2109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:08.233580 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:08.235170 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:08.235705 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:08.235824 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:08.258435 (+ 22611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:08.258444 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:08.258448 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:08.258509 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:08.262366 (+ 3857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:08.263466 (+ 1100us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:08.263472 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:08.263475 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:08.263635 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:08.264171 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:08.264175 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:08.264178 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:08.264606 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:08.264739 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:08.268228 (+ 3489us) server_negotiation.cc:299] Negotiation successful
0812 01:08:08.268442 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14323,"thread_start_us":15154,"threads_started":1}
I20260812 01:08:08.271226 25575 heartbeater.cc:347] Connected to a master server at 127.4.201.126:42601
I20260812 01:08:08.271752 25575 heartbeater.cc:464] Registering TS with master...
I20260812 01:08:08.272958 25575 heartbeater.cc:511] Master 127.4.201.126:42601 requested a full tablet report, sending...
I20260812 01:08:08.275861 25244 ts_manager.cc:194] Registered new tserver with Master: c894d3e120054c0cb189b9fe6b2319e4 (127.4.201.65:46105)
I20260812 01:08:08.278396 25244 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.65@KRBTEST.COM'} at 127.4.201.65:59009
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
I20260812 01:08:08.298461 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.201.84:45745/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:0
--local_ip_for_outbound_sockets=127.4.201.66
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:42601
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:38425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 01:08:08 dist-test-slave-bndk krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496887, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for HTTP/127.4.201.84@KRBTEST.COM
W20260812 01:08:08.819986 25586 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:08:08.820252 25586 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:08:08.820387 25586 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:08:08.828701 25586 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:08:08.828811 25586 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:08:08.828963 25586 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:08:08.839522 25586 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:38425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.4.201.84:45745/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:42601
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:08:08.840799 25586 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:08:08.842177 25586 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:08:08.856619 25607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:08.857188 25609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:08.857237 25605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:08:08.857620 25586 server_base.cc:1034] running on GCE node
I20260812 01:08:08.858261 25586 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:08:08.859499 25586 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:08:08.860734 25586 hybrid_clock.cc:648] HybridClock initialized: now 1786496888860662 us; error 45 us; skew 500 ppm
I20260812 01:08:08.861132 25586 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:08:08 dist-test-slave-bndk krb5kdc[24514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496888, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:08:08.864423 25586 init.cc:377] Logged in from keytab as kudu/127.4.201.66@KRBTEST.COM (short username kudu)
I20260812 01:08:08.866007 25586 webserver.cc:460] Webserver started at http://127.4.201.66:40389/ using document root <none> and password file <none>
I20260812 01:08:08.866743 25586 fs_manager.cc:359] Metadata directory not provided
I20260812 01:08:08.866864 25586 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:08:08.867272 25586 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 01:08:08 dist-test-slave-bndk krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496888, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for HTTP/127.4.201.84@KRBTEST.COM
I20260812 01:08:08.884580 25586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-1/data/instance:
uuid: "1c60c6ec00f648248678e7044cd38ec2"
format_stamp: "Formatted at 2026-08-12 01:08:08 on dist-test-slave-bndk"
server_key: "ddf5ed9980c193f3c72fb8096af63c86"
server_key_iv: "528bcb7250cb5505855cf0729c551698"
server_key_version: "kuduclusterkey@0"
I20260812 01:08:08.885475 25586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance:
uuid: "1c60c6ec00f648248678e7044cd38ec2"
format_stamp: "Formatted at 2026-08-12 01:08:08 on dist-test-slave-bndk"
server_key: "ddf5ed9980c193f3c72fb8096af63c86"
server_key_iv: "528bcb7250cb5505855cf0729c551698"
server_key_version: "kuduclusterkey@0"
I20260812 01:08:08.890915 25586 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 01:08:08.909049 25620 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:08.910723 25586 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260812 01:08:08.910899 25586 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "1c60c6ec00f648248678e7044cd38ec2"
format_stamp: "Formatted at 2026-08-12 01:08:08 on dist-test-slave-bndk"
server_key: "ddf5ed9980c193f3c72fb8096af63c86"
server_key_iv: "528bcb7250cb5505855cf0729c551698"
server_key_version: "kuduclusterkey@0"
I20260812 01:08:08.911132 25586 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:08:08.929979 25586 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:08:08.934186 25586 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:08:08.934804 25586 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:08:08.935920 25586 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:08:08.937377 25586 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:08:08.937460 25586 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:08.937585 25586 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:08:08.937647 25586 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:08.973732 25586 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:35897
I20260812 01:08:08.973757 25808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:35897 every 8 connection(s)
I20260812 01:08:08.975252 25586 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:08:08.981279 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 25586
I20260812 01:08:08.981449 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance
I20260812 01:08:08.981901 4901 external_mini_cluster.cc:1428] Setting key f7dfc7b3aaebb9d9ed05922340dc16ac
Aug 12 01:08:08 dist-test-slave-bndk krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496888, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:08:09.000233 25812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:08.978165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:33673 (local address 127.4.201.126:42601)
0812 01:08:08.978678 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:08.978685 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:08.979864 (+ 1179us) server_negotiation.cc:407] Connection header received
0812 01:08:08.982614 (+ 2750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:08.982620 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:08.982729 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:08.982847 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:08.984947 (+ 2100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:08.985993 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:08.988379 (+ 2386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:08.988932 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:08.989057 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:08.993670 (+ 4613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:08.993676 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:08.993680 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:08.993720 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:08.996542 (+ 2822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:08.997370 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:08.997377 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:08.997381 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:08.997546 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:08.998110 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:08.998115 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:08.998119 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:08.998489 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:08.998643 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:08.999545 (+ 902us) server_negotiation.cc:299] Negotiation successful
0812 01:08:08.999796 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":260,"threads_started":1}
I20260812 01:08:09.001394 25815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:08.978862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:42601 (local address 127.4.201.66:33673)
0812 01:08:08.979675 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:08.979729 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:08.982263 (+ 2534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:08.983136 (+ 873us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:08.983147 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:08.983782 (+ 635us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:08:08.984710 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:08.984738 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:08.986179 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:08.986185 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:08.988213 (+ 2028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:08.988229 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:08.989202 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:08.989211 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:08.989560 (+ 349us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:08.990375 (+ 815us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:08:08.990406 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:08:08.993435 (+ 3029us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:08:08.996737 (+ 3302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:08.996744 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:08.996759 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:08.997243 (+ 484us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:08.997671 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:08.997675 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:08.997679 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:08.997974 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:08.998632 (+ 658us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:08:08.998640 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:08:08.999055 (+ 415us) client_negotiation.cc:769] Sending connection context
0812 01:08:08.999409 (+ 354us) client_negotiation.cc:240] Negotiation successful
0812 01:08:08.999934 (+ 525us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":309,"threads_started":1}
I20260812 01:08:09.003052 25809 heartbeater.cc:347] Connected to a master server at 127.4.201.126:42601
I20260812 01:08:09.003405 25809 heartbeater.cc:464] Registering TS with master...
I20260812 01:08:09.004356 25809 heartbeater.cc:511] Master 127.4.201.126:42601 requested a full tablet report, sending...
I20260812 01:08:09.006197 25244 ts_manager.cc:194] Registered new tserver with Master: 1c60c6ec00f648248678e7044cd38ec2 (127.4.201.66:35897)
I20260812 01:08:09.007279 25244 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.66@KRBTEST.COM'} at 127.4.201.66:33673
WARNING: no policy specified for kudu/127.4.201.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
I20260812 01:08:09.046775 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.201.84:45745/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:0
--local_ip_for_outbound_sockets=127.4.201.67
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:42601
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:38425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:08:09.282279 25575 heartbeater.cc:503] Master 127.4.201.126:42601 was elected leader, sending a full tablet report...
W20260812 01:08:09.391112 25818 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:08:09.391446 25818 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:08:09.391595 25818 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:08:09.399035 25818 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:08:09.399147 25818 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:08:09.399298 25818 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:08:09.409107 25818 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:38425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.4.201.84:45745/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:42601
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:08:09.410413 25818 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:08:09.411731 25818 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:08:09.424495 25823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:09.424646 25828 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:09.424522 25824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:08:09.425558 25818 server_base.cc:1034] running on GCE node
I20260812 01:08:09.426134 25818 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:08:09.427088 25818 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:08:09.428283 25818 hybrid_clock.cc:648] HybridClock initialized: now 1786496889428243 us; error 31 us; skew 500 ppm
I20260812 01:08:09.428566 25818 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:08:09 dist-test-slave-bndk krb5kdc[24514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496889, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:08:09.432179 25818 init.cc:377] Logged in from keytab as kudu/127.4.201.67@KRBTEST.COM (short username kudu)
I20260812 01:08:09.433712 25818 webserver.cc:460] Webserver started at http://127.4.201.67:38193/ using document root <none> and password file <none>
I20260812 01:08:09.434414 25818 fs_manager.cc:359] Metadata directory not provided
I20260812 01:08:09.434546 25818 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:08:09.434844 25818 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 01:08:09 dist-test-slave-bndk krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496889, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for HTTP/127.4.201.84@KRBTEST.COM
I20260812 01:08:09.450372 25818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-2/data/instance:
uuid: "bc2b2dba0179421fb528b0c2ac3d0e6e"
format_stamp: "Formatted at 2026-08-12 01:08:09 on dist-test-slave-bndk"
server_key: "6fd4b74ec68e4e23c9ba31fe5d186035"
server_key_iv: "762c94a2065a741a01b5318394434691"
server_key_version: "kuduclusterkey@0"
I20260812 01:08:09.451309 25818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance:
uuid: "bc2b2dba0179421fb528b0c2ac3d0e6e"
format_stamp: "Formatted at 2026-08-12 01:08:09 on dist-test-slave-bndk"
server_key: "6fd4b74ec68e4e23c9ba31fe5d186035"
server_key_iv: "762c94a2065a741a01b5318394434691"
server_key_version: "kuduclusterkey@0"
I20260812 01:08:09.456888 25818 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260812 01:08:09.471668 25837 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:09.473536 25818 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 01:08:09.473721 25818 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "bc2b2dba0179421fb528b0c2ac3d0e6e"
format_stamp: "Formatted at 2026-08-12 01:08:09 on dist-test-slave-bndk"
server_key: "6fd4b74ec68e4e23c9ba31fe5d186035"
server_key_iv: "762c94a2065a741a01b5318394434691"
server_key_version: "kuduclusterkey@0"
I20260812 01:08:09.473987 25818 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:08:09.486989 25818 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:08:09.490857 25818 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:08:09.491134 25818 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:08:09.492093 25818 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:08:09.493554 25818 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:08:09.493633 25818 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:09.493728 25818 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:08:09.493773 25818 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:09.525862 25818 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:33701
I20260812 01:08:09.525902 26029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:33701 every 8 connection(s)
I20260812 01:08:09.527110 25818 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:08:09.534438 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 25818
I20260812 01:08:09.534629 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance
I20260812 01:08:09.535280 4901 external_mini_cluster.cc:1428] Setting key 45fe9d64eca46409e3901bd477324a1f
Aug 12 01:08:09 dist-test-slave-bndk krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496889, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:08:09.546566 26034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:09.529534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:54561 (local address 127.4.201.126:42601)
0812 01:08:09.530030 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:09.530037 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:09.531125 (+ 1088us) server_negotiation.cc:407] Connection header received
0812 01:08:09.532915 (+ 1790us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:09.532920 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:09.532992 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:09.533087 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:09.534526 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:09.535589 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:09.537393 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:09.537863 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:09.537959 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:09.541267 (+ 3308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:09.541273 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:09.541277 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:09.541312 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:09.543782 (+ 2470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:09.544486 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:09.544490 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:09.544492 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:09.544626 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:09.544984 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:09.544987 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:09.544988 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:09.545299 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:09.545419 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:09.546117 (+ 698us) server_negotiation.cc:299] Negotiation successful
0812 01:08:09.546294 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":219,"threads_started":1}
I20260812 01:08:09.547513 26035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:09.530184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:42601 (local address 127.4.201.67:54561)
0812 01:08:09.530951 (+ 767us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:09.531004 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:09.532667 (+ 1663us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:09.533323 (+ 656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:09.533331 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:09.533754 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:08:09.534341 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:09.534360 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:09.535737 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:09.535741 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:09.537271 (+ 1530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:09.537285 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:09.538112 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:09.538121 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:09.538426 (+ 305us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:09.539025 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:08:09.539048 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:08:09.541034 (+ 1986us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:08:09.543921 (+ 2887us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:09.543928 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:09.543941 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:09.544370 (+ 429us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:09.544709 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:09.544711 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:09.544714 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:09.544903 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:09.545445 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:08:09.545452 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:08:09.545786 (+ 334us) client_negotiation.cc:769] Sending connection context
0812 01:08:09.546026 (+ 240us) client_negotiation.cc:240] Negotiation successful
0812 01:08:09.546446 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":346,"threads_started":1}
I20260812 01:08:09.548844 26031 heartbeater.cc:347] Connected to a master server at 127.4.201.126:42601
I20260812 01:08:09.549167 26031 heartbeater.cc:464] Registering TS with master...
I20260812 01:08:09.550146 26031 heartbeater.cc:511] Master 127.4.201.126:42601 requested a full tablet report, sending...
I20260812 01:08:09.551739 25244 ts_manager.cc:194] Registered new tserver with Master: bc2b2dba0179421fb528b0c2ac3d0e6e (127.4.201.67:33701)
I20260812 01:08:09.552517 25244 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.67@KRBTEST.COM'} at 127.4.201.67:54561
I20260812 01:08:09.562704 4901 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:08:09.564448 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 25366
Aug 12 01:08:09 dist-test-slave-bndk krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.65@KRBTEST.COM
I20260812 01:08:09.581384 26040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:09.565427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54242 (local address 127.4.201.65:46105)
0812 01:08:09.566067 (+ 640us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:09.566073 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:09.566099 (+ 26us) server_negotiation.cc:407] Connection header received
0812 01:08:09.566155 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:09.566161 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:09.566361 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:09.566516 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:09.568036 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:09.569051 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:09.570588 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:09.571145 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:09.571244 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:09.575568 (+ 4324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:09.575580 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:09.575595 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:09.575628 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:09.578578 (+ 2950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:09.579375 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:09.579383 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:09.579385 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:09.579534 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:09.579847 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:09.579851 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:09.579853 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:09.580192 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:09.580459 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:09.580791 (+ 332us) server_negotiation.cc:299] Negotiation successful
0812 01:08:09.581011 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":331,"threads_started":1}
I20260812 01:08:09.582671 25567 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:08:09.665597 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 25366
I20260812 01:08:09.691852 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 25586
Aug 12 01:08:09 dist-test-slave-bndk krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.66@KRBTEST.COM
I20260812 01:08:09.709396 26044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:09.692880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47016 (local address 127.4.201.66:35897)
0812 01:08:09.693641 (+ 761us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:09.693651 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:09.693684 (+ 33us) server_negotiation.cc:407] Connection header received
0812 01:08:09.693763 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:09.693772 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:09.694080 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:09.694252 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:09.695961 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:09.697050 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:09.698626 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:09.699192 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:09.699312 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:09.704204 (+ 4892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:09.704215 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:09.704231 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:09.704272 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:09.706926 (+ 2654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:09.707565 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:09.707572 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:09.707575 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:09.707710 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:09.708000 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:09.708003 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:09.708005 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:09.708338 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:09.708570 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:09.708773 (+ 203us) server_negotiation.cc:299] Negotiation successful
0812 01:08:09.708977 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":574,"thread_start_us":457,"threads_started":1}
I20260812 01:08:09.710640 25799 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:08:09.790951 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 25586
I20260812 01:08:09.814884 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 25818
Aug 12 01:08:09 dist-test-slave-bndk krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.67@KRBTEST.COM
I20260812 01:08:09.831655 26046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:09.815903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40794 (local address 127.4.201.67:33701)
0812 01:08:09.816549 (+ 646us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:09.816557 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:09.816587 (+ 30us) server_negotiation.cc:407] Connection header received
0812 01:08:09.816651 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:09.816657 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:09.816867 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:09.817013 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:09.818522 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:09.819631 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:09.820894 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:09.821562 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:09.821662 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:09.825816 (+ 4154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:09.825829 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:09.825845 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:09.825885 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:09.828575 (+ 2690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:09.829435 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:09.829443 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:09.829446 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:09.829590 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:09.830001 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:09.830005 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:09.830007 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:09.830375 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:09.830680 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:09.831009 (+ 329us) server_negotiation.cc:299] Negotiation successful
0812 01:08:09.831282 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":490,"thread_start_us":338,"threads_started":1}
I20260812 01:08:09.832958 26022 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:08:09.914707 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 25818
I20260812 01:08:09.938526 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 25191
I20260812 01:08:09.939734 25287 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:08:10.045924 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 25191
I20260812 01:08:10.079550 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:42601
--webserver_interface=127.4.201.126
--webserver_port=34591
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:38425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:42601
--ranger_config_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.201.84:45745/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.4.201.84:45745/kms with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:08:10.411286 26053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:08:10.411582 26053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:08:10.411710 26053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:08:10.418785 26053 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:08:10.418885 26053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:08:10.418959 26053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:08:10.419026 26053 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:08:10.419088 26053 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:08:10.428846 26053 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:38425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.4.201.84:45745/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:42601
--ranger_config_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:42601
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=34591
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:08:10.430040 26053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:08:10.431289 26053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:08:10.442495 26066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:10.442580 26064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:10.442540 26063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:08:10.443621 26053 server_base.cc:1034] running on GCE node
I20260812 01:08:10.444336 26053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:08:10.445663 26053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:08:10.446868 26053 hybrid_clock.cc:648] HybridClock initialized: now 1786496890446811 us; error 41 us; skew 500 ppm
I20260812 01:08:10.447190 26053 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:08:10 dist-test-slave-bndk krb5kdc[24514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496890, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:08:10.450155 26053 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:08:10.451471 26053 webserver.cc:460] Webserver started at http://127.4.201.126:34591/ using document root <none> and password file <none>
I20260812 01:08:10.452085 26053 fs_manager.cc:359] Metadata directory not provided
I20260812 01:08:10.452203 26053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 01:08:10 dist-test-slave-bndk krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496890, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for HTTP/127.4.201.84@KRBTEST.COM
I20260812 01:08:10.528736 26053 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 01:08:10.532542 26077 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:10.534164 26053 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:08:10.534361 26053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "eafdf9df2c2f4fab9c0d5970a0a6e48b"
format_stamp: "Formatted at 2026-08-12 01:08:06 on dist-test-slave-bndk"
server_key: "d4590a9a1ebb76ee27df1bc320d48b97"
server_key_iv: "dd9753dc971c2dcd54176cf0dd26ad83"
server_key_version: "kuduclusterkey@0"
I20260812 01:08:10.535673 26053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:08:10.570254 26053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:08:10.574244 26053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:08:10.574525 26053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:08:10.591621 26053 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:42601
I20260812 01:08:10.591673 26157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:42601 every 8 connection(s)
I20260812 01:08:10.593004 26053 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:08:10.595170 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 26053
I20260812 01:08:10.596191 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.201.84:45745/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:46105
--local_ip_for_outbound_sockets=127.4.201.65
--tserver_master_addrs=127.4.201.126:42601
--webserver_port=33517
--webserver_interface=127.4.201.65
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:38425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.4.201.84:45745/kms with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:08:10.601814 26158 sys_catalog.cc:263] Verifying existing consensus state
I20260812 01:08:10.606101 26158 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b: Bootstrap starting.
I20260812 01:08:10.624915 26158 log.cc:824] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b: Log is configured to *not* fsync() on all Append() calls
I20260812 01:08:10.634120 26158 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 01:08:10.634611 26158 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b: Bootstrap complete.
I20260812 01:08:10.643769 26158 raft_consensus.cc:348] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eafdf9df2c2f4fab9c0d5970a0a6e48b" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 42601 } }
I20260812 01:08:10.644603 26158 raft_consensus.cc:729] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafdf9df2c2f4fab9c0d5970a0a6e48b, State: Initialized, Role: FOLLOWER
I20260812 01:08:10.645210 26158 consensus_queue.cc:260] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eafdf9df2c2f4fab9c0d5970a0a6e48b" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 42601 } }
I20260812 01:08:10.645457 26158 raft_consensus.cc:388] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:08:10.645576 26158 raft_consensus.cc:482] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:08:10.645743 26158 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [term 1 FOLLOWER]: Advancing to term 2
I20260812 01:08:10.649574 26158 raft_consensus.cc:504] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eafdf9df2c2f4fab9c0d5970a0a6e48b" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 42601 } }
I20260812 01:08:10.650069 26158 leader_election.cc:302] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eafdf9df2c2f4fab9c0d5970a0a6e48b; no voters:
I20260812 01:08:10.650666 26158 leader_election.cc:288] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 01:08:10.650810 26165 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [term 2 FOLLOWER]: Leader election won for term 2
I20260812 01:08:10.652024 26165 raft_consensus.cc:686] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [term 2 LEADER]: Becoming Leader. State: Replica: eafdf9df2c2f4fab9c0d5970a0a6e48b, State: Running, Role: LEADER
I20260812 01:08:10.652673 26165 consensus_queue.cc:237] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eafdf9df2c2f4fab9c0d5970a0a6e48b" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 42601 } }
I20260812 01:08:10.652973 26158 sys_catalog.cc:564] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:08:10.655207 26172 sys_catalog.cc:455] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [sys.catalog]: SysCatalogTable state changed. Reason: New leader eafdf9df2c2f4fab9c0d5970a0a6e48b. Latest consensus state: current_term: 2 leader_uuid: "eafdf9df2c2f4fab9c0d5970a0a6e48b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eafdf9df2c2f4fab9c0d5970a0a6e48b" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 42601 } } }
I20260812 01:08:10.655710 26172 sys_catalog.cc:458] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [sys.catalog]: This master's current role is: LEADER
I20260812 01:08:10.655810 26171 sys_catalog.cc:455] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "eafdf9df2c2f4fab9c0d5970a0a6e48b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eafdf9df2c2f4fab9c0d5970a0a6e48b" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 42601 } } }
I20260812 01:08:10.656452 26171 sys_catalog.cc:458] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b [sys.catalog]: This master's current role is: LEADER
I20260812 01:08:10.667775 26178 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:08:10.673799 26178 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:08:10.674623 26158 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 01:08:10.675285 26178 catalog_manager.cc:1259] Loaded cluster ID: eb7a5aec0ed54341a83685d1d134376b
I20260812 01:08:10.675374 26178 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:08:10.679457 26178 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:08:10.680907 26178 catalog_manager.cc:5879] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b: Loaded TSK: 0
I20260812 01:08:10.682523 26178 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 01:08:11.057510 26163 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:08:11.058028 26163 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:08:11.058254 26163 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:08:11.069471 26163 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:08:11.069671 26163 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:08:11.069893 26163 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:08:11.085485 26163 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:38425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.4.201.84:45745/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:46105
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=33517
--tserver_master_addrs=127.4.201.126:42601
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:08:11.087607 26163 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:08:11.089653 26163 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:08:11.112066 26219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:11.115700 26220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:11.116446 26225 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:08:11.116878 26163 server_base.cc:1034] running on GCE node
I20260812 01:08:11.117733 26163 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:08:11.123973 26163 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:08:11.125331 26163 hybrid_clock.cc:648] HybridClock initialized: now 1786496891125259 us; error 62 us; skew 500 ppm
I20260812 01:08:11.125774 26163 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:08:11 dist-test-slave-bndk krb5kdc[24514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496891, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:08:11.130159 26163 init.cc:377] Logged in from keytab as kudu/127.4.201.65@KRBTEST.COM (short username kudu)
I20260812 01:08:11.132417 26163 webserver.cc:460] Webserver started at http://127.4.201.65:33517/ using document root <none> and password file <none>
I20260812 01:08:11.133394 26163 fs_manager.cc:359] Metadata directory not provided
I20260812 01:08:11.133549 26163 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 01:08:11 dist-test-slave-bndk krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496891, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for HTTP/127.4.201.84@KRBTEST.COM
I20260812 01:08:11.164783 26163 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.005s sys 0.001s
I20260812 01:08:11.173710 26241 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:11.175508 26163 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.001s sys 0.007s
I20260812 01:08:11.175698 26163 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "c894d3e120054c0cb189b9fe6b2319e4"
format_stamp: "Formatted at 2026-08-12 01:08:07 on dist-test-slave-bndk"
server_key: "d93d1a09d0637a4d1094db9e1705b740"
server_key_iv: "89a89ec3ea30150b96177bf2d442bee1"
server_key_version: "kuduclusterkey@0"
I20260812 01:08:11.176749 26163 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:08:11.209695 26163 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:08:11.213765 26163 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:08:11.214044 26163 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:08:11.215493 26163 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:08:11.217029 26163 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:08:11.217128 26163 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:11.217252 26163 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:08:11.217336 26163 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260812 01:08:11.290494 26163 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:46105
I20260812 01:08:11.290556 26438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:46105 every 8 connection(s)
I20260812 01:08:11.292423 26163 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:08:11.297452 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 26163
I20260812 01:08:11.298321 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.201.84:45745/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:35897
--local_ip_for_outbound_sockets=127.4.201.66
--tserver_master_addrs=127.4.201.126:42601
--webserver_port=40389
--webserver_interface=127.4.201.66
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:38425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.4.201.84:45745/kms with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 01:08:11 dist-test-slave-bndk krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496891, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:08:11.342353 26443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:11.296198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:42601 (local address 127.4.201.65:60003)
0812 01:08:11.313871 (+ 17673us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:11.313937 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:11.316115 (+ 2178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:11.318174 (+ 2059us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:11.318186 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:11.318745 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:08:11.319318 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:11.319337 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:11.321168 (+ 1831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:11.321174 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:11.322502 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:11.322517 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:11.324268 (+ 1751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:11.324276 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:11.324564 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:11.325396 (+ 832us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:08:11.325429 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:08:11.328047 (+ 2618us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:08:11.335484 (+ 7437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:11.335495 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:11.335514 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:11.336179 (+ 665us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:11.337760 (+ 1581us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:11.337765 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:11.337770 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:11.338063 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:11.339196 (+ 1133us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:08:11.339205 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:08:11.339623 (+ 418us) client_negotiation.cc:769] Sending connection context
0812 01:08:11.339956 (+ 333us) client_negotiation.cc:240] Negotiation successful
0812 01:08:11.341074 (+ 1118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17334,"thread_start_us":17125,"threads_started":1}
I20260812 01:08:11.342356 26442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:11.296090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:60003 (local address 127.4.201.126:42601)
0812 01:08:11.313202 (+ 17112us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:11.313246 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:11.314520 (+ 1274us) server_negotiation.cc:407] Connection header received
0812 01:08:11.317049 (+ 2529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:11.317071 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:11.317630 (+ 559us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:11.317998 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:11.319530 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:11.321001 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:11.322642 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:11.323681 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:11.323873 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:11.328385 (+ 4512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:11.328396 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:11.328418 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:11.328480 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:11.335285 (+ 6805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:11.337375 (+ 2090us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:11.337386 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:11.337395 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:11.337607 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:11.338210 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:11.338216 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:11.338220 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:11.338926 (+ 706us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:11.339105 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:11.340289 (+ 1184us) server_negotiation.cc:299] Negotiation successful
0812 01:08:11.340801 (+ 512us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16828,"thread_start_us":16597,"threads_started":1}
I20260812 01:08:11.346218 26439 heartbeater.cc:347] Connected to a master server at 127.4.201.126:42601
I20260812 01:08:11.346537 26439 heartbeater.cc:464] Registering TS with master...
I20260812 01:08:11.347290 26439 heartbeater.cc:511] Master 127.4.201.126:42601 requested a full tablet report, sending...
W20260812 01:08:11.350270 26439 heartbeater.cc:644] Failed to heartbeat to 127.4.201.126:42601 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 01:08:11.350499 26439 heartbeater.cc:464] Registering TS with master...
I20260812 01:08:11.350766 26439 heartbeater.cc:511] Master 127.4.201.126:42601 requested a full tablet report, sending...
I20260812 01:08:11.352053 26439 heartbeater.cc:464] Registering TS with master...
I20260812 01:08:11.352308 26439 heartbeater.cc:511] Master 127.4.201.126:42601 requested a full tablet report, sending...
W20260812 01:08:11.353518 26439 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 01:08:11.724783 26444 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:08:11.725085 26444 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:08:11.725277 26444 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:08:11.732766 26444 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:08:11.732893 26444 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:08:11.733086 26444 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:08:11.744200 26444 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:38425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.4.201.84:45745/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:35897
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=40389
--tserver_master_addrs=127.4.201.126:42601
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:08:11.745661 26444 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:08:11.747049 26444 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:08:11.760955 26465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:11.761243 26464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:08:11.761647 26444 server_base.cc:1034] running on GCE node
W20260812 01:08:11.761933 26469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:08:11.762615 26444 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:08:11.763561 26444 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:08:11.764765 26444 hybrid_clock.cc:648] HybridClock initialized: now 1786496891764693 us; error 62 us; skew 500 ppm
I20260812 01:08:11.765070 26444 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:08:11 dist-test-slave-bndk krb5kdc[24514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496891, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:08:11.768959 26444 init.cc:377] Logged in from keytab as kudu/127.4.201.66@KRBTEST.COM (short username kudu)
I20260812 01:08:11.774734 26444 webserver.cc:460] Webserver started at http://127.4.201.66:40389/ using document root <none> and password file <none>
I20260812 01:08:11.775674 26444 fs_manager.cc:359] Metadata directory not provided
I20260812 01:08:11.775841 26444 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 01:08:11 dist-test-slave-bndk krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496891, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for HTTP/127.4.201.84@KRBTEST.COM
I20260812 01:08:11.820488 26444 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.001s sys 0.005s
I20260812 01:08:11.833905 26491 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:11.837626 26444 fs_manager.cc:725] Time spent opening block manager: real 0.015s user 0.000s sys 0.013s
I20260812 01:08:11.837940 26444 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "1c60c6ec00f648248678e7044cd38ec2"
format_stamp: "Formatted at 2026-08-12 01:08:08 on dist-test-slave-bndk"
server_key: "ddf5ed9980c193f3c72fb8096af63c86"
server_key_iv: "528bcb7250cb5505855cf0729c551698"
server_key_version: "kuduclusterkey@0"
I20260812 01:08:11.839520 26444 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:08:11.865413 26444 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:08:11.870936 26444 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:08:11.871259 26444 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:08:11.875571 26444 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:08:11.877532 26444 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:08:11.877648 26444 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:11.877750 26444 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:08:11.877820 26444 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 01:08:11 dist-test-slave-bndk krb5kdc[24514](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786496891, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:08:11.963972 26444 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:35897
I20260812 01:08:11.964052 26678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:35897 every 8 connection(s)
I20260812 01:08:11.965989 26444 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:08:11.971401 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 26444
I20260812 01:08:11.972242 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.201.84:45745/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:33701
--local_ip_for_outbound_sockets=127.4.201.67
--tserver_master_addrs=127.4.201.126:42601
--webserver_port=38193
--webserver_interface=127.4.201.67
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:38425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.4.201.84:45745/kms with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 01:08:11 dist-test-slave-bndk krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496891, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:08:12.006589 26682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:11.977407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:55053 (local address 127.4.201.126:42601)
0812 01:08:11.991855 (+ 14448us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:11.991861 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:11.991918 (+ 57us) server_negotiation.cc:407] Connection header received
0812 01:08:11.991989 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:11.991994 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:11.992078 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:11.992189 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:11.994199 (+ 2010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:11.994947 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:11.996530 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:11.996952 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:11.997069 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:12.000416 (+ 3347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:12.000422 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:12.000425 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:12.000472 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:12.003238 (+ 2766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:12.004199 (+ 961us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:12.004205 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:12.004209 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:12.004336 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:12.004798 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:12.004804 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:12.004807 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:12.005105 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:12.005295 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:12.005993 (+ 698us) server_negotiation.cc:299] Negotiation successful
0812 01:08:12.006223 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14305,"thread_start_us":15839,"threads_started":1}
I20260812 01:08:12.007848 26681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:11.969653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:42601 (local address 127.4.201.66:55053)
0812 01:08:11.985912 (+ 16259us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:11.985969 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:11.988480 (+ 2511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:11.992655 (+ 4175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:11.992669 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:11.993364 (+ 695us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:08:11.994006 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:11.994025 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:11.995123 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:11.995127 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:11.996379 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:11.996394 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:11.997198 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:11.997207 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:11.997443 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:11.998153 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:08:11.998182 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:08:12.000192 (+ 2010us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:08:12.003411 (+ 3219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:12.003421 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:12.003439 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:12.004054 (+ 615us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:12.004456 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:12.004460 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:12.004462 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:12.004676 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:12.005255 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:08:12.005264 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:08:12.005610 (+ 346us) client_negotiation.cc:769] Sending connection context
0812 01:08:12.005858 (+ 248us) client_negotiation.cc:240] Negotiation successful
0812 01:08:12.006417 (+ 559us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15875,"thread_start_us":19137,"threads_started":1}
I20260812 01:08:12.014482 26679 heartbeater.cc:347] Connected to a master server at 127.4.201.126:42601
I20260812 01:08:12.014809 26679 heartbeater.cc:464] Registering TS with master...
I20260812 01:08:12.015668 26679 heartbeater.cc:511] Master 127.4.201.126:42601 requested a full tablet report, sending...
I20260812 01:08:12.017792 26103 ts_manager.cc:194] Registered new tserver with Master: 1c60c6ec00f648248678e7044cd38ec2 (127.4.201.66:35897)
I20260812 01:08:12.020025 26103 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.66@KRBTEST.COM'} at 127.4.201.66:55053
Aug 12 01:08:12 dist-test-slave-bndk krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496891, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for HTTP/127.4.201.84@KRBTEST.COM
I20260812 01:08:12.353668 26439 heartbeater.cc:464] Registering TS with master...
I20260812 01:08:12.354125 26439 heartbeater.cc:511] Master 127.4.201.126:42601 requested a full tablet report, sending...
I20260812 01:08:12.355445 26103 ts_manager.cc:194] Registered new tserver with Master: c894d3e120054c0cb189b9fe6b2319e4 (127.4.201.65:46105)
I20260812 01:08:12.356571 26103 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.65@KRBTEST.COM'} at 127.4.201.65:60003
W20260812 01:08:12.467295 26684 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:08:12.467727 26684 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:08:12.467891 26684 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:08:12.479565 26684 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:08:12.479759 26684 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:08:12.479981 26684 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:08:12.493284 26684 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:38425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.4.201.84:45745/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:33701
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=38193
--tserver_master_addrs=127.4.201.126:42601
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:08:12.494669 26684 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:08:12.496057 26684 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:08:12.511562 26696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:12.514305 26697 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:12.523718 26704 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:08:12.524215 26684 server_base.cc:1034] running on GCE node
I20260812 01:08:12.524879 26684 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:08:12.525975 26684 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:08:12.527227 26684 hybrid_clock.cc:648] HybridClock initialized: now 1786496892527166 us; error 54 us; skew 500 ppm
I20260812 01:08:12.527547 26684 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:08:12 dist-test-slave-bndk krb5kdc[24514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496892, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:08:12.530777 26684 init.cc:377] Logged in from keytab as kudu/127.4.201.67@KRBTEST.COM (short username kudu)
I20260812 01:08:12.534459 26684 webserver.cc:460] Webserver started at http://127.4.201.67:38193/ using document root <none> and password file <none>
I20260812 01:08:12.535200 26684 fs_manager.cc:359] Metadata directory not provided
I20260812 01:08:12.535342 26684 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 01:08:12 dist-test-slave-bndk krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496892, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for HTTP/127.4.201.84@KRBTEST.COM
I20260812 01:08:12.561360 26684 fs_manager.cc:709] Time spent opening directory manager: real 0.009s user 0.003s sys 0.005s
I20260812 01:08:12.565421 26721 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:12.566777 26684 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 01:08:12.566941 26684 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "bc2b2dba0179421fb528b0c2ac3d0e6e"
format_stamp: "Formatted at 2026-08-12 01:08:09 on dist-test-slave-bndk"
server_key: "6fd4b74ec68e4e23c9ba31fe5d186035"
server_key_iv: "762c94a2065a741a01b5318394434691"
server_key_version: "kuduclusterkey@0"
I20260812 01:08:12.568082 26684 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:08:12.626967 26684 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:08:12.631711 26684 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:08:12.631995 26684 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:08:12.633200 26684 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:08:12.640743 26684 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:08:12.642320 26684 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:12.642508 26684 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:08:12.642630 26684 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 01:08:12 dist-test-slave-bndk krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496891, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for HTTP/127.4.201.84@KRBTEST.COM
I20260812 01:08:13.022258 26684 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:33701
I20260812 01:08:13.022342 26903 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:33701 every 8 connection(s)
I20260812 01:08:13.023686 26679 heartbeater.cc:503] Master 127.4.201.126:42601 was elected leader, sending a full tablet report...
I20260812 01:08:13.024523 26684 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:08:13.028213 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 26684
Aug 12 01:08:13 dist-test-slave-bndk krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496892, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:08:13.057296 26910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:13.027807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:55421 (local address 127.4.201.126:42601)
0812 01:08:13.038405 (+ 10598us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:13.038415 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:13.038438 (+ 23us) server_negotiation.cc:407] Connection header received
0812 01:08:13.038676 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:13.038682 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:13.038779 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:13.038886 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:13.040398 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.041198 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.043534 (+ 2336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.044235 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.044359 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:13.047893 (+ 3534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:13.047899 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:13.047904 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:13.047938 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:13.053930 (+ 5992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:13.054849 (+ 919us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:13.054854 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:13.054858 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:13.055015 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:13.055509 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:13.055518 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:13.055522 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:13.055821 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:13.055966 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:13.056663 (+ 697us) server_negotiation.cc:299] Negotiation successful
0812 01:08:13.056882 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10454,"thread_start_us":10548,"threads_started":1}
I20260812 01:08:13.058559 26908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:13.028309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:42601 (local address 127.4.201.67:55421)
0812 01:08:13.035916 (+ 7607us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:13.035965 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:13.038372 (+ 2407us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:13.039177 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:13.039185 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:13.039635 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:08:13.040198 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:13.040215 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.041385 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.041390 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:13.043365 (+ 1975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:13.043382 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.044425 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.044430 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:13.044627 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:13.045480 (+ 853us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:08:13.045513 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:08:13.047674 (+ 2161us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:08:13.054071 (+ 6397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:13.054081 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:13.054099 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:13.054719 (+ 620us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:13.055124 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:13.055129 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:13.055132 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:13.055382 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:13.055955 (+ 573us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:08:13.055963 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:08:13.056305 (+ 342us) client_negotiation.cc:769] Sending connection context
0812 01:08:13.056555 (+ 250us) client_negotiation.cc:240] Negotiation successful
0812 01:08:13.057108 (+ 553us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7303,"thread_start_us":7082,"threads_started":1}
I20260812 01:08:13.060289 26904 heartbeater.cc:347] Connected to a master server at 127.4.201.126:42601
I20260812 01:08:13.060516 26906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:13.029630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47164 (local address 127.4.201.126:42601)
0812 01:08:13.038639 (+ 9009us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:13.038644 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:13.038662 (+ 18us) server_negotiation.cc:407] Connection header received
0812 01:08:13.038737 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:13.038742 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:13.038805 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:13.038913 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:13.040425 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.041704 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.044545 (+ 2841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.045196 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.045346 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:13.053457 (+ 8111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:13.053463 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:13.053466 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:13.053500 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:13.056698 (+ 3198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:13.058347 (+ 1649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:13.058352 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:13.058356 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:13.058502 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:13.058941 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:13.058946 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:13.058950 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:13.059292 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:13.059614 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:13.059928 (+ 314us) server_negotiation.cc:299] Negotiation successful
0812 01:08:13.060147 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8884,"spinlock_wait_cycles":1792,"thread_start_us":8509,"threads_started":1}
I20260812 01:08:13.060595 26904 heartbeater.cc:464] Registering TS with master...
I20260812 01:08:13.061528 26904 heartbeater.cc:511] Master 127.4.201.126:42601 requested a full tablet report, sending...
I20260812 01:08:13.063323 26100 ts_manager.cc:194] Registered new tserver with Master: bc2b2dba0179421fb528b0c2ac3d0e6e (127.4.201.67:33701)
I20260812 01:08:13.064275 26100 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.67@KRBTEST.COM'} at 127.4.201.67:55421
I20260812 01:08:13.075285 4901 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:08:13.092702 26906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:13.078610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47174 (local address 127.4.201.126:42601)
0812 01:08:13.078807 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:13.078813 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:13.079236 (+ 423us) server_negotiation.cc:407] Connection header received
0812 01:08:13.079384 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:13.079390 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:13.079465 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:13.079570 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:13.081073 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.082182 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.083523 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.084127 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.084245 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:13.086843 (+ 2598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:13.086850 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:13.086855 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:13.086892 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:13.090137 (+ 3245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:13.090792 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:13.090798 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:13.090802 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:13.090966 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:13.091252 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:13.091257 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:13.091260 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:13.091609 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:13.091862 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:13.092131 (+ 269us) server_negotiation.cc:299] Negotiation successful
0812 01:08:13.092365 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 01:08:13.097652 26100 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47174:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:08:13.105154 26100 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:08:13.161139 26936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:13.121580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:35897 (local address 127.0.0.1:47030)
0812 01:08:13.150560 (+ 28980us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:13.150583 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:13.150745 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:13.152802 (+ 2057us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:13.152810 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:13.152849 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:08:13.153397 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:13.153416 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.155426 (+ 2010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.155432 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:13.157743 (+ 2311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:13.157764 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.160206 (+ 2442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.160212 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:13.160404 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:13.160456 (+ 52us) client_negotiation.cc:769] Sending connection context
0812 01:08:13.160584 (+ 128us) client_negotiation.cc:240] Negotiation successful
0812 01:08:13.160775 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28823,"thread_start_us":38895,"threads_started":1}
I20260812 01:08:13.162222 26934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:13.122321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47030 (local address 127.4.201.66:35897)
0812 01:08:13.152208 (+ 29887us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:13.152215 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:13.152242 (+ 27us) server_negotiation.cc:407] Connection header received
0812 01:08:13.152332 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:13.152337 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:13.152554 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:13.152868 (+ 314us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:08:13.153640 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.155259 (+ 1619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.157948 (+ 2689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.159490 (+ 1542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.159638 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:13.159879 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:13.161724 (+ 1845us) server_negotiation.cc:299] Negotiation successful
0812 01:08:13.161896 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29626,"thread_start_us":29131,"threads_started":1}
I20260812 01:08:13.165647 26935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:13.134756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54254 (local address 127.4.201.65:46105)
0812 01:08:13.150081 (+ 15325us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:13.150092 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:13.153702 (+ 3610us) server_negotiation.cc:407] Connection header received
0812 01:08:13.154108 (+ 406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:13.154117 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:13.154345 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:13.154518 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:08:13.155351 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.156858 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.160774 (+ 3916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.162224 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.162326 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:13.162540 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:13.163533 (+ 993us) server_negotiation.cc:299] Negotiation successful
0812 01:08:13.165307 (+ 1774us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15092,"thread_start_us":16257,"threads_started":1}
I20260812 01:08:13.166545 26931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:13.140652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:46105 (local address 127.0.0.1:54254)
0812 01:08:13.153577 (+ 12925us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:13.153602 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:13.153853 (+ 251us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:13.154780 (+ 927us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:13.154785 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:13.154830 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:08:13.155136 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:13.155147 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.157051 (+ 1904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.157056 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:13.159088 (+ 2032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:13.159106 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.163099 (+ 3993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.163105 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:13.163314 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:13.163349 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 01:08:13.166020 (+ 2671us) client_negotiation.cc:240] Negotiation successful
0812 01:08:13.166163 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12802,"mutex_wait_us":3,"thread_start_us":10178,"threads_started":1}
I20260812 01:08:13.167083 26569 tablet_service.cc:1467] Processing CreateTablet for tablet 77ac7862890940b3aa3a0a9e059964a6 (DEFAULT_TABLE table=test-table [id=4d303bfc04c24dfe83bee700fb0f05a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:08:13.168021 26927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:13.120745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:33701 (local address 127.0.0.1:40802)
0812 01:08:13.133033 (+ 12288us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:13.133093 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:13.133308 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:13.160877 (+ 27569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:13.160883 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:13.160914 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:08:13.161282 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:13.161296 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.163067 (+ 1771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.163076 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:13.165010 (+ 1934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:13.165026 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.167190 (+ 2164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.167197 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:13.167371 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:13.167405 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 01:08:13.167474 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 01:08:13.167609 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11994,"mutex_wait_us":18,"thread_start_us":12787,"threads_started":1}
I20260812 01:08:13.169257 26928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:13.121526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40802 (local address 127.4.201.67:33701)
0812 01:08:13.159660 (+ 38134us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:13.159668 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:13.159696 (+ 28us) server_negotiation.cc:407] Connection header received
0812 01:08:13.159786 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:13.159793 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:13.160015 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:13.160206 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:08:13.161476 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.162926 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.165236 (+ 2310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.166761 (+ 1525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.168383 (+ 1622us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:13.168641 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:13.168709 (+ 68us) server_negotiation.cc:299] Negotiation successful
0812 01:08:13.168877 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37933,"thread_start_us":37797,"threads_started":1}
I20260812 01:08:13.170872 26324 tablet_service.cc:1467] Processing CreateTablet for tablet 77ac7862890940b3aa3a0a9e059964a6 (DEFAULT_TABLE table=test-table [id=4d303bfc04c24dfe83bee700fb0f05a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:08:13.172322 26324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77ac7862890940b3aa3a0a9e059964a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:08:13.175872 26792 tablet_service.cc:1467] Processing CreateTablet for tablet 77ac7862890940b3aa3a0a9e059964a6 (DEFAULT_TABLE table=test-table [id=4d303bfc04c24dfe83bee700fb0f05a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:08:13.177182 26792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77ac7862890940b3aa3a0a9e059964a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:08:13.178265 26569 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77ac7862890940b3aa3a0a9e059964a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:08:13.198566 26937 tablet_bootstrap.cc:492] T 77ac7862890940b3aa3a0a9e059964a6 P bc2b2dba0179421fb528b0c2ac3d0e6e: Bootstrap starting.
I20260812 01:08:13.204131 26937 tablet_bootstrap.cc:654] T 77ac7862890940b3aa3a0a9e059964a6 P bc2b2dba0179421fb528b0c2ac3d0e6e: Neither blocks nor log segments found. Creating new log.
I20260812 01:08:13.205003 26941 tablet_bootstrap.cc:492] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4: Bootstrap starting.
I20260812 01:08:13.205909 26943 tablet_bootstrap.cc:492] T 77ac7862890940b3aa3a0a9e059964a6 P 1c60c6ec00f648248678e7044cd38ec2: Bootstrap starting.
I20260812 01:08:13.207290 26937 log.cc:824] T 77ac7862890940b3aa3a0a9e059964a6 P bc2b2dba0179421fb528b0c2ac3d0e6e: Log is configured to *not* fsync() on all Append() calls
I20260812 01:08:13.208868 26941 tablet_bootstrap.cc:654] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4: Neither blocks nor log segments found. Creating new log.
I20260812 01:08:13.209343 26943 tablet_bootstrap.cc:654] T 77ac7862890940b3aa3a0a9e059964a6 P 1c60c6ec00f648248678e7044cd38ec2: Neither blocks nor log segments found. Creating new log.
I20260812 01:08:13.210353 26941 log.cc:824] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4: Log is configured to *not* fsync() on all Append() calls
I20260812 01:08:13.210722 26943 log.cc:824] T 77ac7862890940b3aa3a0a9e059964a6 P 1c60c6ec00f648248678e7044cd38ec2: Log is configured to *not* fsync() on all Append() calls
I20260812 01:08:13.217036 26937 tablet_bootstrap.cc:492] T 77ac7862890940b3aa3a0a9e059964a6 P bc2b2dba0179421fb528b0c2ac3d0e6e: No bootstrap required, opened a new log
I20260812 01:08:13.217371 26937 ts_tablet_manager.cc:1397] T 77ac7862890940b3aa3a0a9e059964a6 P bc2b2dba0179421fb528b0c2ac3d0e6e: Time spent bootstrapping tablet: real 0.019s user 0.011s sys 0.004s
I20260812 01:08:13.220541 26941 tablet_bootstrap.cc:492] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4: No bootstrap required, opened a new log
I20260812 01:08:13.220561 26943 tablet_bootstrap.cc:492] T 77ac7862890940b3aa3a0a9e059964a6 P 1c60c6ec00f648248678e7044cd38ec2: No bootstrap required, opened a new log
I20260812 01:08:13.220871 26941 ts_tablet_manager.cc:1397] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.005s
I20260812 01:08:13.220904 26943 ts_tablet_manager.cc:1397] T 77ac7862890940b3aa3a0a9e059964a6 P 1c60c6ec00f648248678e7044cd38ec2: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.009s
I20260812 01:08:13.227753 26937 raft_consensus.cc:348] T 77ac7862890940b3aa3a0a9e059964a6 P bc2b2dba0179421fb528b0c2ac3d0e6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2b2dba0179421fb528b0c2ac3d0e6e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 33701 } } peers { permanent_uuid: "c894d3e120054c0cb189b9fe6b2319e4" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 46105 } } peers { permanent_uuid: "1c60c6ec00f648248678e7044cd38ec2" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 35897 } }
I20260812 01:08:13.228214 26937 raft_consensus.cc:374] T 77ac7862890940b3aa3a0a9e059964a6 P bc2b2dba0179421fb528b0c2ac3d0e6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:08:13.228336 26937 raft_consensus.cc:729] T 77ac7862890940b3aa3a0a9e059964a6 P bc2b2dba0179421fb528b0c2ac3d0e6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc2b2dba0179421fb528b0c2ac3d0e6e, State: Initialized, Role: FOLLOWER
I20260812 01:08:13.228758 26943 raft_consensus.cc:348] T 77ac7862890940b3aa3a0a9e059964a6 P 1c60c6ec00f648248678e7044cd38ec2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2b2dba0179421fb528b0c2ac3d0e6e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 33701 } } peers { permanent_uuid: "c894d3e120054c0cb189b9fe6b2319e4" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 46105 } } peers { permanent_uuid: "1c60c6ec00f648248678e7044cd38ec2" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 35897 } }
I20260812 01:08:13.229076 26943 raft_consensus.cc:374] T 77ac7862890940b3aa3a0a9e059964a6 P 1c60c6ec00f648248678e7044cd38ec2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:08:13.228978 26937 consensus_queue.cc:260] T 77ac7862890940b3aa3a0a9e059964a6 P bc2b2dba0179421fb528b0c2ac3d0e6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2b2dba0179421fb528b0c2ac3d0e6e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 33701 } } peers { permanent_uuid: "c894d3e120054c0cb189b9fe6b2319e4" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 46105 } } peers { permanent_uuid: "1c60c6ec00f648248678e7044cd38ec2" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 35897 } }
I20260812 01:08:13.229168 26943 raft_consensus.cc:729] T 77ac7862890940b3aa3a0a9e059964a6 P 1c60c6ec00f648248678e7044cd38ec2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c60c6ec00f648248678e7044cd38ec2, State: Initialized, Role: FOLLOWER
I20260812 01:08:13.229736 26943 consensus_queue.cc:260] T 77ac7862890940b3aa3a0a9e059964a6 P 1c60c6ec00f648248678e7044cd38ec2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2b2dba0179421fb528b0c2ac3d0e6e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 33701 } } peers { permanent_uuid: "c894d3e120054c0cb189b9fe6b2319e4" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 46105 } } peers { permanent_uuid: "1c60c6ec00f648248678e7044cd38ec2" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 35897 } }
I20260812 01:08:13.231206 26943 ts_tablet_manager.cc:1428] T 77ac7862890940b3aa3a0a9e059964a6 P 1c60c6ec00f648248678e7044cd38ec2: Time spent starting tablet: real 0.010s user 0.007s sys 0.003s
I20260812 01:08:13.231882 26941 raft_consensus.cc:348] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2b2dba0179421fb528b0c2ac3d0e6e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 33701 } } peers { permanent_uuid: "c894d3e120054c0cb189b9fe6b2319e4" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 46105 } } peers { permanent_uuid: "1c60c6ec00f648248678e7044cd38ec2" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 35897 } }
I20260812 01:08:13.232275 26941 raft_consensus.cc:374] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:08:13.233019 26904 heartbeater.cc:503] Master 127.4.201.126:42601 was elected leader, sending a full tablet report...
I20260812 01:08:13.233167 26941 raft_consensus.cc:729] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c894d3e120054c0cb189b9fe6b2319e4, State: Initialized, Role: FOLLOWER
I20260812 01:08:13.234437 26941 consensus_queue.cc:260] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2b2dba0179421fb528b0c2ac3d0e6e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 33701 } } peers { permanent_uuid: "c894d3e120054c0cb189b9fe6b2319e4" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 46105 } } peers { permanent_uuid: "1c60c6ec00f648248678e7044cd38ec2" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 35897 } }
I20260812 01:08:13.236625 26937 ts_tablet_manager.cc:1428] T 77ac7862890940b3aa3a0a9e059964a6 P bc2b2dba0179421fb528b0c2ac3d0e6e: Time spent starting tablet: real 0.019s user 0.011s sys 0.005s
I20260812 01:08:13.237560 26439 heartbeater.cc:503] Master 127.4.201.126:42601 was elected leader, sending a full tablet report...
I20260812 01:08:13.238173 26941 ts_tablet_manager.cc:1428] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4: Time spent starting tablet: real 0.017s user 0.010s sys 0.003s
W20260812 01:08:13.277896 26905 tablet.cc:2369] T 77ac7862890940b3aa3a0a9e059964a6 P bc2b2dba0179421fb528b0c2ac3d0e6e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:08:13.307926 26441 tablet.cc:2369] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:08:13.373149 26952 raft_consensus.cc:482] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:08:13.373499 26952 raft_consensus.cc:504] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2b2dba0179421fb528b0c2ac3d0e6e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 33701 } } peers { permanent_uuid: "c894d3e120054c0cb189b9fe6b2319e4" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 46105 } } peers { permanent_uuid: "1c60c6ec00f648248678e7044cd38ec2" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 35897 } }
I20260812 01:08:13.375432 26952 leader_election.cc:288] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc2b2dba0179421fb528b0c2ac3d0e6e (127.4.201.67:33701), 1c60c6ec00f648248678e7044cd38ec2 (127.4.201.66:35897)
I20260812 01:08:13.382755 26928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:13.375866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:43739 (local address 127.4.201.67:33701)
0812 01:08:13.376079 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:13.376085 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:13.377006 (+ 921us) server_negotiation.cc:407] Connection header received
0812 01:08:13.377236 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:13.377241 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:13.377325 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:13.377404 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:08:13.378031 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.378797 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.380789 (+ 1992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.381760 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.381920 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:13.381995 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:13.382399 (+ 404us) server_negotiation.cc:299] Negotiation successful
0812 01:08:13.382519 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 01:08:13.382790 26934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:13.376000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:47605 (local address 127.4.201.66:35897)
0812 01:08:13.376228 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:13.376234 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:13.377104 (+ 870us) server_negotiation.cc:407] Connection header received
0812 01:08:13.377292 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:13.377296 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:13.377354 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:13.377432 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:08:13.378062 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.378801 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.380790 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.381818 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.381976 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:13.382048 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:13.382422 (+ 374us) server_negotiation.cc:299] Negotiation successful
0812 01:08:13.382552 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 01:08:13.382925 26954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:13.375968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:35897 (local address 127.4.201.65:47605)
0812 01:08:13.376984 (+ 1016us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:13.376999 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:13.377135 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:13.377466 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:13.377470 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:13.377495 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:08:13.377906 (+ 411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:13.377917 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.378927 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.378933 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:13.380644 (+ 1711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:13.380657 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.382045 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.382051 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:13.382272 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:13.382296 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 01:08:13.382383 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 01:08:13.382505 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":910,"mutex_wait_us":91,"thread_start_us":683,"threads_started":1}
I20260812 01:08:13.383276 26953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:13.375752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:33701 (local address 127.4.201.65:43739)
0812 01:08:13.376894 (+ 1142us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:13.376911 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:13.377070 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:13.377433 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:13.377437 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:13.377467 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:08:13.377890 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:13.377901 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.378928 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.378934 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:13.380638 (+ 1704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:13.380652 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.381994 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.382026 (+ 32us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:13.382200 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:13.382262 (+ 62us) client_negotiation.cc:769] Sending connection context
0812 01:08:13.382343 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 01:08:13.382474 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":945,"mutex_wait_us":73,"thread_start_us":507,"threads_started":1}
I20260812 01:08:13.383868 26605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77ac7862890940b3aa3a0a9e059964a6" candidate_uuid: "c894d3e120054c0cb189b9fe6b2319e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c60c6ec00f648248678e7044cd38ec2" is_pre_election: true
I20260812 01:08:13.384146 26826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77ac7862890940b3aa3a0a9e059964a6" candidate_uuid: "c894d3e120054c0cb189b9fe6b2319e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc2b2dba0179421fb528b0c2ac3d0e6e" is_pre_election: true
I20260812 01:08:13.384392 26605 raft_consensus.cc:2454] T 77ac7862890940b3aa3a0a9e059964a6 P 1c60c6ec00f648248678e7044cd38ec2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c894d3e120054c0cb189b9fe6b2319e4 in term 0.
I20260812 01:08:13.384647 26826 raft_consensus.cc:2454] T 77ac7862890940b3aa3a0a9e059964a6 P bc2b2dba0179421fb528b0c2ac3d0e6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c894d3e120054c0cb189b9fe6b2319e4 in term 0.
I20260812 01:08:13.385089 26243 leader_election.cc:302] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c60c6ec00f648248678e7044cd38ec2, c894d3e120054c0cb189b9fe6b2319e4; no voters:
I20260812 01:08:13.385494 26952 raft_consensus.cc:2781] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:08:13.385627 26952 raft_consensus.cc:482] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:08:13.385732 26952 raft_consensus.cc:3037] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:08:13.387944 26952 raft_consensus.cc:504] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2b2dba0179421fb528b0c2ac3d0e6e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 33701 } } peers { permanent_uuid: "c894d3e120054c0cb189b9fe6b2319e4" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 46105 } } peers { permanent_uuid: "1c60c6ec00f648248678e7044cd38ec2" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 35897 } }
I20260812 01:08:13.388517 26952 leader_election.cc:288] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4 [CANDIDATE]: Term 1 election: Requested vote from peers bc2b2dba0179421fb528b0c2ac3d0e6e (127.4.201.67:33701), 1c60c6ec00f648248678e7044cd38ec2 (127.4.201.66:35897)
I20260812 01:08:13.388962 26826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77ac7862890940b3aa3a0a9e059964a6" candidate_uuid: "c894d3e120054c0cb189b9fe6b2319e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc2b2dba0179421fb528b0c2ac3d0e6e"
I20260812 01:08:13.388978 26605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77ac7862890940b3aa3a0a9e059964a6" candidate_uuid: "c894d3e120054c0cb189b9fe6b2319e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c60c6ec00f648248678e7044cd38ec2"
I20260812 01:08:13.389140 26826 raft_consensus.cc:3037] T 77ac7862890940b3aa3a0a9e059964a6 P bc2b2dba0179421fb528b0c2ac3d0e6e [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:08:13.389133 26605 raft_consensus.cc:3037] T 77ac7862890940b3aa3a0a9e059964a6 P 1c60c6ec00f648248678e7044cd38ec2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:08:13.391285 26605 raft_consensus.cc:2454] T 77ac7862890940b3aa3a0a9e059964a6 P 1c60c6ec00f648248678e7044cd38ec2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c894d3e120054c0cb189b9fe6b2319e4 in term 1.
I20260812 01:08:13.391359 26826 raft_consensus.cc:2454] T 77ac7862890940b3aa3a0a9e059964a6 P bc2b2dba0179421fb528b0c2ac3d0e6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c894d3e120054c0cb189b9fe6b2319e4 in term 1.
I20260812 01:08:13.391649 26243 leader_election.cc:302] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c60c6ec00f648248678e7044cd38ec2, c894d3e120054c0cb189b9fe6b2319e4; no voters:
I20260812 01:08:13.391949 26952 raft_consensus.cc:2781] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:08:13.392449 26952 raft_consensus.cc:686] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4 [term 1 LEADER]: Becoming Leader. State: Replica: c894d3e120054c0cb189b9fe6b2319e4, State: Running, Role: LEADER
I20260812 01:08:13.392912 26952 consensus_queue.cc:237] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2b2dba0179421fb528b0c2ac3d0e6e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 33701 } } peers { permanent_uuid: "c894d3e120054c0cb189b9fe6b2319e4" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 46105 } } peers { permanent_uuid: "1c60c6ec00f648248678e7044cd38ec2" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 35897 } }
I20260812 01:08:13.397683 26103 catalog_manager.cc:5495] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to c894d3e120054c0cb189b9fe6b2319e4 (127.4.201.65). New cstate: current_term: 1 leader_uuid: "c894d3e120054c0cb189b9fe6b2319e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2b2dba0179421fb528b0c2ac3d0e6e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 33701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c894d3e120054c0cb189b9fe6b2319e4" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c60c6ec00f648248678e7044cd38ec2" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 35897 } health_report { overall_health: UNKNOWN } } }
I20260812 01:08:13.428069 26935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:13.422862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54262 (local address 127.4.201.65:46105)
0812 01:08:13.423070 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:13.423075 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:13.423092 (+ 17us) server_negotiation.cc:407] Connection header received
0812 01:08:13.423303 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:13.423306 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:13.423396 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:13.423518 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:08:13.423867 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.424550 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.426016 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.426448 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.426547 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:13.427025 (+ 478us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:08:13.427523 (+ 498us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:08:13.427640 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:13.427719 (+ 79us) server_negotiation.cc:299] Negotiation successful
0812 01:08:13.427786 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 01:08:13.436214 26605 raft_consensus.cc:1261] T 77ac7862890940b3aa3a0a9e059964a6 P 1c60c6ec00f648248678e7044cd38ec2 [term 1 FOLLOWER]: Refusing update from remote peer c894d3e120054c0cb189b9fe6b2319e4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:08:13.436323 26826 raft_consensus.cc:1261] T 77ac7862890940b3aa3a0a9e059964a6 P bc2b2dba0179421fb528b0c2ac3d0e6e [term 1 FOLLOWER]: Refusing update from remote peer c894d3e120054c0cb189b9fe6b2319e4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:08:13.437171 26955 consensus_queue.cc:1035] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c60c6ec00f648248678e7044cd38ec2" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 35897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:08:13.437543 26952 consensus_queue.cc:1035] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc2b2dba0179421fb528b0c2ac3d0e6e" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 33701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:08:13.448520 26964 mvcc.cc:205] Tried to move back new op lower bound from 7317491275504644096 to 7317491275340947456. Current Snapshot: MvccSnapshot[applied={T|T < 7317491275504644096}]
I20260812 01:08:13.453497 26966 mvcc.cc:205] Tried to move back new op lower bound from 7317491275504644096 to 7317491275340947456. Current Snapshot: MvccSnapshot[applied={T|T < 7317491275504644096}]
I20260812 01:08:13.461354 26100 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47174:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:08:13.461654 26100 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47174:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:08:13.465433 26100 catalog_manager.cc:5782] T 00000000000000000000000000000000 P eafdf9df2c2f4fab9c0d5970a0a6e48b: Sending DeleteTablet for 3 replicas of tablet 77ac7862890940b3aa3a0a9e059964a6
I20260812 01:08:13.466586 26792 tablet_service.cc:1514] Processing DeleteTablet for tablet 77ac7862890940b3aa3a0a9e059964a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:08:13 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:40802
I20260812 01:08:13.466593 26324 tablet_service.cc:1514] Processing DeleteTablet for tablet 77ac7862890940b3aa3a0a9e059964a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:08:13 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:54254
I20260812 01:08:13.466655 26569 tablet_service.cc:1514] Processing DeleteTablet for tablet 77ac7862890940b3aa3a0a9e059964a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:08:13 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:47030
I20260812 01:08:13.475924 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 26163
I20260812 01:08:13.479562 26977 tablet_replica.cc:330] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4: stopping tablet replica
I20260812 01:08:13.479805 26978 tablet_replica.cc:330] T 77ac7862890940b3aa3a0a9e059964a6 P bc2b2dba0179421fb528b0c2ac3d0e6e: stopping tablet replica
I20260812 01:08:13.480201 26977 raft_consensus.cc:2229] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4 [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:08:13.480194 26978 raft_consensus.cc:2229] T 77ac7862890940b3aa3a0a9e059964a6 P bc2b2dba0179421fb528b0c2ac3d0e6e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:08:13.480808 26978 raft_consensus.cc:2258] T 77ac7862890940b3aa3a0a9e059964a6 P bc2b2dba0179421fb528b0c2ac3d0e6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:08:13.481096 26977 raft_consensus.cc:2258] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:08:13.483803 26978 ts_tablet_manager.cc:1905] T 77ac7862890940b3aa3a0a9e059964a6 P bc2b2dba0179421fb528b0c2ac3d0e6e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:08:13.488415 26979 tablet_replica.cc:330] T 77ac7862890940b3aa3a0a9e059964a6 P 1c60c6ec00f648248678e7044cd38ec2: stopping tablet replica
I20260812 01:08:13.489147 26979 raft_consensus.cc:2229] T 77ac7862890940b3aa3a0a9e059964a6 P 1c60c6ec00f648248678e7044cd38ec2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:08:13.489773 26979 raft_consensus.cc:2258] T 77ac7862890940b3aa3a0a9e059964a6 P 1c60c6ec00f648248678e7044cd38ec2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:08:13.492208 26979 ts_tablet_manager.cc:1905] T 77ac7862890940b3aa3a0a9e059964a6 P 1c60c6ec00f648248678e7044cd38ec2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:08:13.494401 26977 ts_tablet_manager.cc:1905] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:08:13.499250 26979 ts_tablet_manager.cc:1918] T 77ac7862890940b3aa3a0a9e059964a6 P 1c60c6ec00f648248678e7044cd38ec2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:08:13.499429 26979 log.cc:1196] T 77ac7862890940b3aa3a0a9e059964a6 P 1c60c6ec00f648248678e7044cd38ec2: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-1/wal/wals/77ac7862890940b3aa3a0a9e059964a6
I20260812 01:08:13.499991 26979 ts_tablet_manager.cc:1939] T 77ac7862890940b3aa3a0a9e059964a6 P 1c60c6ec00f648248678e7044cd38ec2: Deleting consensus metadata
I20260812 01:08:13.501914 26978 ts_tablet_manager.cc:1918] T 77ac7862890940b3aa3a0a9e059964a6 P bc2b2dba0179421fb528b0c2ac3d0e6e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:08:13.502108 26978 log.cc:1196] T 77ac7862890940b3aa3a0a9e059964a6 P bc2b2dba0179421fb528b0c2ac3d0e6e: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-2/wal/wals/77ac7862890940b3aa3a0a9e059964a6
I20260812 01:08:13.502678 26978 ts_tablet_manager.cc:1939] T 77ac7862890940b3aa3a0a9e059964a6 P bc2b2dba0179421fb528b0c2ac3d0e6e: Deleting consensus metadata
I20260812 01:08:13.504643 26078 catalog_manager.cc:4841] TS bc2b2dba0179421fb528b0c2ac3d0e6e (127.4.201.67:33701): tablet 77ac7862890940b3aa3a0a9e059964a6 (table test-table [id=4d303bfc04c24dfe83bee700fb0f05a3]) successfully deleted
I20260812 01:08:13.505030 26977 ts_tablet_manager.cc:1918] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:08:13.505244 26977 log.cc:1196] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786496689953932-4901-0/minicluster-data/ts-0/wal/wals/77ac7862890940b3aa3a0a9e059964a6
I20260812 01:08:13.505780 26977 ts_tablet_manager.cc:1939] T 77ac7862890940b3aa3a0a9e059964a6 P c894d3e120054c0cb189b9fe6b2319e4: Deleting consensus metadata
I20260812 01:08:13.507552 26078 catalog_manager.cc:4841] TS c894d3e120054c0cb189b9fe6b2319e4 (127.4.201.65:46105): tablet 77ac7862890940b3aa3a0a9e059964a6 (table test-table [id=4d303bfc04c24dfe83bee700fb0f05a3]) successfully deleted
I20260812 01:08:13.508136 26079 catalog_manager.cc:4841] TS 1c60c6ec00f648248678e7044cd38ec2 (127.4.201.66:35897): tablet 77ac7862890940b3aa3a0a9e059964a6 (table test-table [id=4d303bfc04c24dfe83bee700fb0f05a3]) successfully deleted
I20260812 01:08:13.512137 26935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:13.477028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54264 (local address 127.4.201.65:46105)
0812 01:08:13.477234 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:13.477241 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:13.481960 (+ 4719us) server_negotiation.cc:407] Connection header received
0812 01:08:13.482036 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:13.482041 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:13.482135 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:13.482233 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:13.484538 (+ 2305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.486141 (+ 1603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.496290 (+ 10149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.497026 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.497179 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:13.502540 (+ 5361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:13.502554 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:13.502574 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:13.502625 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:13.509064 (+ 6439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:13.509847 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:13.509865 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:13.509870 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:13.510060 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:13.510458 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:13.510463 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:13.510467 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:13.510961 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:13.511274 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:13.511513 (+ 239us) server_negotiation.cc:299] Negotiation successful
0812 01:08:13.511765 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 01:08:13.512843 26431 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:08:13.611635 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 26163
I20260812 01:08:13.634827 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 26444
I20260812 01:08:13.647496 26934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:13.635542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47038 (local address 127.4.201.66:35897)
0812 01:08:13.635703 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:13.635707 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:13.635754 (+ 47us) server_negotiation.cc:407] Connection header received
0812 01:08:13.635916 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:13.635920 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:13.635984 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:13.636066 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:13.637369 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.638143 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.639342 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.639720 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.639805 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:13.642293 (+ 2488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:13.642306 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:13.642322 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:13.642357 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:13.645154 (+ 2797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:13.645809 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:13.645816 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:13.645819 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:13.645957 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:13.646236 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:13.646239 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:13.646241 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:13.646589 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:13.646816 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:13.647042 (+ 226us) server_negotiation.cc:299] Negotiation successful
0812 01:08:13.647199 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 01:08:13.648172 26673 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:08:13.738391 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 26444
I20260812 01:08:13.758531 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 26684
I20260812 01:08:13.771705 26928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:13.759276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40816 (local address 127.4.201.67:33701)
0812 01:08:13.759520 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:13.759527 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:13.759614 (+ 87us) server_negotiation.cc:407] Connection header received
0812 01:08:13.759821 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:13.759825 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:13.759895 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:13.759984 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:13.761366 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.762083 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.763364 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:13.763774 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:13.763898 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:13.766512 (+ 2614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:13.766527 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:13.766545 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:13.766584 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:13.769392 (+ 2808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:13.770021 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:13.770028 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:13.770030 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:13.770164 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:13.770430 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:13.770432 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:13.770434 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:13.770784 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:13.771026 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:13.771200 (+ 174us) server_negotiation.cc:299] Negotiation successful
0812 01:08:13.771377 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260812 01:08:13.772310 26898 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:08:13.859153 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 26684
I20260812 01:08:13.884542 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 26053
I20260812 01:08:13.885794 26152 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:08:13.997716 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 26053
I20260812 01:08:14.030573 4901 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 01:08:14.374478 4901 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 01:08:14.374706 4901 mini_ranger.cc:66] Stopping Ranger...
I20260812 01:08:14.719249 4901 mini_ranger.cc:68] Stopped Ranger
2026-08-12 01:08:14.719 UTC [24557] LOG: received smart shutdown request
2026-08-12 01:08:14.722 UTC [24557] LOG: background worker "logical replication launcher" (PID 24572) exited with exit code 1
2026-08-12 01:08:14.722 UTC [24561] LOG: shutting down
2026-08-12 01:08:14.856 UTC [24557] LOG: database system is shut down
2026-08-12T01:08:14Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (51844 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:08:15 dist-test-slave-bndk krb5kdc[27008](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:08:15 dist-test-slave-bndk krb5kdc[27008](info): set up 2 sockets
Aug 12 01:08:15 dist-test-slave-bndk krb5kdc[27008](info): commencing operation
krb5kdc: starting...
W20260812 01:08:16.200083 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.195s user 0.002s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:08:16 dist-test-slave-bndk krb5kdc[27008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496896, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:08:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:08:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.201.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
I20260812 01:08:16.454676 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:43859
--webserver_interface=127.4.201.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:44595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:43859,127.4.201.125:33311,127.4.201.124:46307
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:08:16.786202 27028 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:08:16.786504 27028 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:08:16.786643 27028 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:08:16.793684 27028 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:08:16.793797 27028 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:08:16.793877 27028 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:08:16.793953 27028 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:08:16.794015 27028 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:08:16.803628 27028 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:44595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:43859,127.4.201.125:33311,127.4.201.124:46307
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:43859
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:08:16.804986 27028 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:08:16.806298 27028 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:08:16.817639 27036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:16.817682 27041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:16.817718 27037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:08:16.818419 27028 server_base.cc:1034] running on GCE node
I20260812 01:08:16.819172 27028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:08:16.820515 27028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:08:16.821717 27028 hybrid_clock.cc:648] HybridClock initialized: now 1786496896821676 us; error 26 us; skew 500 ppm
I20260812 01:08:16.822058 27028 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:08:16 dist-test-slave-bndk krb5kdc[27008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496896, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:08:16.824949 27028 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:08:16.826356 27028 webserver.cc:460] Webserver started at http://127.4.201.126:40197/ using document root <none> and password file <none>
I20260812 01:08:16.827028 27028 fs_manager.cc:359] Metadata directory not provided
I20260812 01:08:16.827147 27028 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:08:16.827430 27028 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:08:16.830384 27028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "a0eade5586114f76902cf78a13ab40ae"
format_stamp: "Formatted at 2026-08-12 01:08:16 on dist-test-slave-bndk"
server_key: "08b76e7ab8c63d006e217d24a98f8ad1"
server_key_iv: "d86bfbd70f303edf6dffca13ca68f627"
server_key_version: "encryptionkey@0"
I20260812 01:08:16.831182 27028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "a0eade5586114f76902cf78a13ab40ae"
format_stamp: "Formatted at 2026-08-12 01:08:16 on dist-test-slave-bndk"
server_key: "08b76e7ab8c63d006e217d24a98f8ad1"
server_key_iv: "d86bfbd70f303edf6dffca13ca68f627"
server_key_version: "encryptionkey@0"
I20260812 01:08:16.836257 27028 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 01:08:16.839697 27054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:16.840988 27028 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 01:08:16.841146 27028 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "a0eade5586114f76902cf78a13ab40ae"
format_stamp: "Formatted at 2026-08-12 01:08:16 on dist-test-slave-bndk"
server_key: "08b76e7ab8c63d006e217d24a98f8ad1"
server_key_iv: "d86bfbd70f303edf6dffca13ca68f627"
server_key_version: "encryptionkey@0"
I20260812 01:08:16.841382 27028 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:08:16.860750 27028 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:08:16.864375 27028 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:08:16.864620 27028 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:08:16.882019 27028 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:43859
I20260812 01:08:16.882061 27137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:43859 every 8 connection(s)
I20260812 01:08:16.883324 27028 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:08:16.887035 27139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:08:16.887156 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 27028
I20260812 01:08:16.887379 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:08:16.888227 4901 external_mini_cluster.cc:1428] Setting key 229d445092ec172a440b570e83a5a0fb
I20260812 01:08:16.895841 27139 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43859 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 01:08:16 dist-test-slave-bndk krb5kdc[27008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496896, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.201.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.125@KRBTEST.COM" created.
I20260812 01:08:16.918226 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:16.899442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:43859 (local address 127.0.0.1:35408)
0812 01:08:16.900725 (+ 1283us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:16.900774 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:16.902515 (+ 1741us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:16.903315 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:16.903321 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:16.904052 (+ 731us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:08:16.904395 (+ 343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:16.904412 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:16.905989 (+ 1577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:16.905993 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:16.907274 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:16.907288 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:16.908169 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:16.908177 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:16.908392 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:16.908973 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:08:16.909003 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:08:16.911120 (+ 2117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:08:16.914224 (+ 3104us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:16.914236 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:16.914248 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:16.914618 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:16.915015 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:16.915020 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:16.915024 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:16.915176 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:16.915911 (+ 735us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:08:16.915919 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:08:16.916122 (+ 203us) client_negotiation.cc:769] Sending connection context
0812 01:08:16.916340 (+ 218us) client_negotiation.cc:240] Negotiation successful
0812 01:08:16.916893 (+ 553us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1009,"mutex_wait_us":133,"spinlock_wait_cycles":25856,"thread_start_us":791,"threads_started":1}
I20260812 01:08:16.918208 27142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:16.899442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35408 (local address 127.4.201.126:43859)
0812 01:08:16.900349 (+ 907us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:16.900364 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:16.900916 (+ 552us) server_negotiation.cc:407] Connection header received
0812 01:08:16.902870 (+ 1954us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:16.902876 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:16.903097 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:16.903285 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:16.904589 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:16.905840 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:16.907404 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:16.907941 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:16.908120 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:16.911342 (+ 3222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:16.911350 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:16.911362 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:16.911395 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:16.914097 (+ 2702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:16.914737 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:16.914743 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:16.914746 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:16.914904 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:16.915277 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:16.915283 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:16.915287 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:16.915781 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:16.915953 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:16.916501 (+ 548us) server_negotiation.cc:299] Negotiation successful
0812 01:08:16.916770 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":46,"server-negotiator.queue_time_us":660,"thread_start_us":430,"threads_started":1}
I20260812 01:08:16.921093 27139 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.201.125" port: 33311 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:08:16.922096 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:16.921728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:33311 (local address 127.0.0.1:37000)
0812 01:08:16.921877 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:16.921989 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.125:33311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260812 01:08:16.922320 27055 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.201.125:33311: connect: Connection refused (error 111)
I20260812 01:08:16.923822 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:16.923507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:33311 (local address 127.0.0.1:37012)
0812 01:08:16.923641 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:16.923703 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.125:33311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260812 01:08:16.924014 27139 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.125:33311: Network error: Client connection negotiation failed: client connection to 127.4.201.125:33311: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.125.keytab.
Entry for principal kudu/127.4.201.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.125.keytab.
I20260812 01:08:16.946192 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.125:33311
--webserver_interface=127.4.201.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.125.keytab
--principal=kudu/127.4.201.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:44595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:43859,127.4.201.125:33311,127.4.201.124:46307
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:08:16.973398 27139 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.125" port: 33311 } attempt: 1
I20260812 01:08:16.974723 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:16.974193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:33311 (local address 127.0.0.1:37020)
0812 01:08:16.974420 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:16.974561 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.125:33311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260812 01:08:16.975709 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:16.975339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:33311 (local address 127.0.0.1:37032)
0812 01:08:16.975468 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:16.975552 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.125:33311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260812 01:08:16.975886 27139 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.125:33311: Network error: Client connection negotiation failed: client connection to 127.4.201.125:33311: connect: Connection refused (error 111)
I20260812 01:08:17.044140 27139 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.125" port: 33311 } attempt: 2
I20260812 01:08:17.045466 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.044850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:33311 (local address 127.0.0.1:37042)
0812 01:08:17.045121 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:17.045297 (+ 176us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.125:33311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260812 01:08:17.046531 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.046122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:33311 (local address 127.0.0.1:37056)
0812 01:08:17.046286 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:17.046374 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.125:33311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260812 01:08:17.046736 27139 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.125:33311: Network error: Client connection negotiation failed: client connection to 127.4.201.125:33311: connect: Connection refused (error 111)
I20260812 01:08:17.138047 27139 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.125" port: 33311 } attempt: 3
I20260812 01:08:17.139392 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.138798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:33311 (local address 127.0.0.1:37068)
0812 01:08:17.139073 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:17.139203 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.125:33311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
I20260812 01:08:17.140606 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.140129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:33311 (local address 127.0.0.1:37080)
0812 01:08:17.140295 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:17.140418 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.125:33311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260812 01:08:17.140827 27139 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.125:33311: Network error: Client connection negotiation failed: client connection to 127.4.201.125:33311: connect: Connection refused (error 111)
W20260812 01:08:17.277920 27147 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:08:17.278191 27147 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:08:17.278285 27147 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260812 01:08:17.284096 27139 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.125" port: 33311 } attempt: 4
I20260812 01:08:17.285379 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.284755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:33311 (local address 127.0.0.1:37096)
0812 01:08:17.285065 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:17.285183 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.125:33311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148}
W20260812 01:08:17.285576 27147 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:08:17.285681 27147 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:08:17.285759 27147 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:08:17.285842 27147 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:08:17.285908 27147 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:08:17.286445 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.286056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:33311 (local address 127.0.0.1:37108)
0812 01:08:17.286205 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:17.286302 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.125:33311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260812 01:08:17.286614 27139 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.125:33311: Network error: Client connection negotiation failed: client connection to 127.4.201.125:33311: connect: Connection refused (error 111)
I20260812 01:08:17.295765 27147 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:44595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:43859,127.4.201.125:33311,127.4.201.124:46307
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.125.keytab
--principal=kudu/127.4.201.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.125:33311
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.4.201.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:08:17.297025 27147 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:08:17.298380 27147 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:08:17.309912 27153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:17.309957 27163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:17.309973 27155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:08:17.310707 27147 server_base.cc:1034] running on GCE node
I20260812 01:08:17.311466 27147 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:08:17.312745 27147 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:08:17.313957 27147 hybrid_clock.cc:648] HybridClock initialized: now 1786496897313908 us; error 35 us; skew 500 ppm
I20260812 01:08:17.314316 27147 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:08:17 dist-test-slave-bndk krb5kdc[27008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496897, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:08:17.317396 27147 init.cc:377] Logged in from keytab as kudu/127.4.201.125@KRBTEST.COM (short username kudu)
I20260812 01:08:17.318831 27147 webserver.cc:460] Webserver started at http://127.4.201.125:35711/ using document root <none> and password file <none>
I20260812 01:08:17.319504 27147 fs_manager.cc:359] Metadata directory not provided
I20260812 01:08:17.319617 27147 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:08:17.319908 27147 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:08:17.322885 27147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-1/data/instance:
uuid: "1c2c11b0199849a0b3023ac6e979b18b"
format_stamp: "Formatted at 2026-08-12 01:08:17 on dist-test-slave-bndk"
server_key: "1fc2f613ca35adcd114efcb99a2afabe"
server_key_iv: "0f83070c6dd0838146a2a273ac2d8e62"
server_key_version: "encryptionkey@0"
I20260812 01:08:17.323693 27147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-1/wal/instance:
uuid: "1c2c11b0199849a0b3023ac6e979b18b"
format_stamp: "Formatted at 2026-08-12 01:08:17 on dist-test-slave-bndk"
server_key: "1fc2f613ca35adcd114efcb99a2afabe"
server_key_iv: "0f83070c6dd0838146a2a273ac2d8e62"
server_key_version: "encryptionkey@0"
I20260812 01:08:17.328845 27147 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260812 01:08:17.332258 27176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:17.333611 27147 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:08:17.333772 27147 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-1/wal
uuid: "1c2c11b0199849a0b3023ac6e979b18b"
format_stamp: "Formatted at 2026-08-12 01:08:17 on dist-test-slave-bndk"
server_key: "1fc2f613ca35adcd114efcb99a2afabe"
server_key_iv: "0f83070c6dd0838146a2a273ac2d8e62"
server_key_version: "encryptionkey@0"
I20260812 01:08:17.333940 27147 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:08:17.353104 27147 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:08:17.357328 27147 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:08:17.357571 27147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:08:17.374791 27147 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.125:33311
I20260812 01:08:17.374833 27261 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.125:33311 every 8 connection(s)
I20260812 01:08:17.376186 27147 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-1/data/info.pb
I20260812 01:08:17.378463 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 27147
I20260812 01:08:17.378670 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-1/wal/instance
I20260812 01:08:17.379236 4901 external_mini_cluster.cc:1428] Setting key 35e8dc39e01f87e73b64d693b000d094
I20260812 01:08:17.380452 27262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:08:17.389112 27262 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43859 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 01:08:17 dist-test-slave-bndk krb5kdc[27008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496897, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.125@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.201.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.124@KRBTEST.COM" created.
I20260812 01:08:17.409462 27142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.392256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35422 (local address 127.4.201.126:43859)
0812 01:08:17.392490 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:17.392497 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:17.393647 (+ 1150us) server_negotiation.cc:407] Connection header received
0812 01:08:17.395505 (+ 1858us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:17.395512 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:17.395596 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:17.395706 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:17.397158 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.397923 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.399460 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.399872 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.399995 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:17.403594 (+ 3599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:17.403599 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:17.403602 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:17.403636 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:17.406356 (+ 2720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:17.407137 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:17.407144 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:17.407146 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:17.407329 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:17.407753 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:17.407759 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:17.407763 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:17.408040 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:17.408175 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:17.408890 (+ 715us) server_negotiation.cc:299] Negotiation successful
0812 01:08:17.409113 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 01:08:17.410398 27265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.392650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:43859 (local address 127.0.0.1:35422)
0812 01:08:17.393477 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:17.393525 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:17.395228 (+ 1703us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:17.395897 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:17.395905 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:17.396419 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:08:17.396980 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:17.396999 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.398106 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.398111 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:17.399315 (+ 1204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:17.399328 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.400096 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.400105 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:17.400320 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:17.400990 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:08:17.401013 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:08:17.403371 (+ 2358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:08:17.406504 (+ 3133us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:17.406514 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:17.406529 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:17.407025 (+ 496us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:17.407436 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:17.407441 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:17.407445 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:17.407645 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:17.408168 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:08:17.408175 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:08:17.408522 (+ 347us) client_negotiation.cc:769] Sending connection context
0812 01:08:17.408763 (+ 241us) client_negotiation.cc:240] Negotiation successful
0812 01:08:17.409282 (+ 519us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":324,"threads_started":1}
I20260812 01:08:17.412145 27262 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.201.125" port: 33311 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 01:08:17 dist-test-slave-bndk krb5kdc[27008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496897, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.125@KRBTEST.COM for kudu/127.4.201.125@KRBTEST.COM
I20260812 01:08:17.425868 27265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.412866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:33311 (local address 127.0.0.1:37124)
0812 01:08:17.413070 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:17.413085 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:17.413161 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:17.414095 (+ 934us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:17.414099 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:17.414477 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:08:17.414605 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:17.414613 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.415907 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.415911 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:17.416717 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:17.416728 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.417560 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.417566 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:17.417736 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:17.418233 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:08:17.418248 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:08:17.420405 (+ 2157us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:08:17.423295 (+ 2890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:17.423300 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:17.423304 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:17.423770 (+ 466us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:17.424118 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:17.424122 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:17.424125 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:17.424299 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:17.424878 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:08:17.424883 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:08:17.425018 (+ 135us) client_negotiation.cc:769] Sending connection context
0812 01:08:17.425151 (+ 133us) client_negotiation.cc:240] Negotiation successful
0812 01:08:17.425437 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260812 01:08:17.425875 27270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.413096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37124 (local address 127.4.201.125:33311)
0812 01:08:17.413723 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:17.413729 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:17.413753 (+ 24us) server_negotiation.cc:407] Connection header received
0812 01:08:17.413793 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:17.413798 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:17.413954 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:17.414084 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:17.414750 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.415779 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.416841 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.417403 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.417529 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:17.420609 (+ 3080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:17.420620 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:17.420633 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:17.420666 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:17.423158 (+ 2492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:17.423883 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:17.423890 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:17.423892 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:17.424004 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:17.424411 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:17.424414 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:17.424416 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:17.424736 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:17.424886 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:17.425318 (+ 432us) server_negotiation.cc:299] Negotiation successful
0812 01:08:17.425553 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":34,"server-negotiator.queue_time_us":491,"thread_start_us":354,"threads_started":1}
I20260812 01:08:17.428485 27262 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46307 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:08:17.429602 27265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.429172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46307 (local address 127.0.0.1:33098)
0812 01:08:17.429352 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:17.429464 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
W20260812 01:08:17.429857 27177 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46307: connect: Connection refused (error 111)
I20260812 01:08:17.431380 27265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.431069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46307 (local address 127.0.0.1:33102)
0812 01:08:17.431197 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:17.431274 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260812 01:08:17.431597 27262 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.124:46307: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46307: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.124.keytab.
Entry for principal kudu/127.4.201.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.124.keytab.
I20260812 01:08:17.440181 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.124:46307
--webserver_interface=127.4.201.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.124.keytab
--principal=kudu/127.4.201.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:44595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:43859,127.4.201.125:33311,127.4.201.124:46307
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:08:17.480891 27262 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46307 } attempt: 1
I20260812 01:08:17.482110 27265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.481647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46307 (local address 127.0.0.1:33114)
0812 01:08:17.481836 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:17.481942 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260812 01:08:17.483183 27265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.482768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46307 (local address 127.0.0.1:33122)
0812 01:08:17.482935 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:17.483037 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260812 01:08:17.483484 27262 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.124:46307: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46307: connect: Connection refused (error 111)
I20260812 01:08:17.551697 27262 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46307 } attempt: 2
I20260812 01:08:17.552820 27265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.552393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46307 (local address 127.0.0.1:33130)
0812 01:08:17.552580 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:17.552670 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260812 01:08:17.553789 27265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.553497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46307 (local address 127.0.0.1:33132)
0812 01:08:17.553612 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:17.553679 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260812 01:08:17.554008 27262 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.124:46307: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46307: connect: Connection refused (error 111)
I20260812 01:08:17.585882 27139 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.125" port: 33311 } attempt: 5
Aug 12 01:08:17 dist-test-slave-bndk krb5kdc[27008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496896, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for kudu/127.4.201.125@KRBTEST.COM
I20260812 01:08:17.599511 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.586634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:33311 (local address 127.0.0.1:37138)
0812 01:08:17.586823 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:17.586844 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:17.586958 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:17.587397 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:17.587402 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:17.587800 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:08:17.587991 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:17.588004 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.588991 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.588997 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:17.589917 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:17.589929 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.590646 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.590652 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:17.590832 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:17.591487 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:08:17.591504 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:08:17.593899 (+ 2395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:08:17.596702 (+ 2803us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:17.596708 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:17.596712 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:17.597270 (+ 558us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:17.597615 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:17.597620 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:17.597623 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:17.597803 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:17.598506 (+ 703us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:08:17.598512 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:08:17.598703 (+ 191us) client_negotiation.cc:769] Sending connection context
0812 01:08:17.598859 (+ 156us) client_negotiation.cc:240] Negotiation successful
0812 01:08:17.599162 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260812 01:08:17.599591 27270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.586885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37138 (local address 127.4.201.125:33311)
0812 01:08:17.587098 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:17.587103 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:17.587119 (+ 16us) server_negotiation.cc:407] Connection header received
0812 01:08:17.587185 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:17.587188 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:17.587245 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:17.587330 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:17.588159 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.588854 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.590064 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.590502 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.590615 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:17.594095 (+ 3480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:17.594101 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:17.594104 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:17.594135 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:17.596553 (+ 2418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:17.597380 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:17.597384 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:17.597387 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:17.597507 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:17.597931 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:17.597936 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:17.597939 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:17.598328 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:17.598486 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:17.599048 (+ 562us) server_negotiation.cc:299] Negotiation successful
0812 01:08:17.599294 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 01:08:17.600728 27139 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46307 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:08:17.601816 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.601372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46307 (local address 127.0.0.1:33136)
0812 01:08:17.601544 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:17.601641 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 01:08:17.602694 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.602394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46307 (local address 127.0.0.1:33146)
0812 01:08:17.602516 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:17.602596 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260812 01:08:17.602902 27139 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.124:46307: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46307: connect: Connection refused (error 111)
I20260812 01:08:17.645205 27262 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46307 } attempt: 3
I20260812 01:08:17.646287 27265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.645827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46307 (local address 127.0.0.1:33150)
0812 01:08:17.646042 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:17.646129 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260812 01:08:17.647303 27265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.646880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46307 (local address 127.0.0.1:33154)
0812 01:08:17.647107 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:17.647184 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126}
W20260812 01:08:17.647526 27262 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.124:46307: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46307: connect: Connection refused (error 111)
I20260812 01:08:17.654102 27139 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46307 } attempt: 1
I20260812 01:08:17.655057 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.654642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46307 (local address 127.0.0.1:33164)
0812 01:08:17.654815 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:17.654897 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260812 01:08:17.655952 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.655636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46307 (local address 127.0.0.1:33176)
0812 01:08:17.655778 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:17.655851 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260812 01:08:17.656153 27139 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.124:46307: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46307: connect: Connection refused (error 111)
I20260812 01:08:17.724344 27139 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46307 } attempt: 2
I20260812 01:08:17.725462 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.724942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46307 (local address 127.0.0.1:33192)
0812 01:08:17.725161 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:17.725304 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260812 01:08:17.726423 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.726079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46307 (local address 127.0.0.1:33206)
0812 01:08:17.726226 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:17.726310 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260812 01:08:17.726624 27139 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.124:46307: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46307: connect: Connection refused (error 111)
W20260812 01:08:17.776736 27273 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:08:17.777047 27273 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:08:17.777187 27273 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:08:17.784366 27273 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:08:17.784504 27273 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:08:17.784590 27273 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:08:17.784672 27273 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:08:17.784734 27273 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:08:17.790719 27262 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46307 } attempt: 4
I20260812 01:08:17.791832 27265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.791335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46307 (local address 127.0.0.1:33212)
0812 01:08:17.791582 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:17.791677 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260812 01:08:17.792843 27265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.792539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46307 (local address 127.0.0.1:33218)
0812 01:08:17.792669 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:17.792742 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260812 01:08:17.793085 27262 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.124:46307: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46307: connect: Connection refused (error 111)
I20260812 01:08:17.795150 27273 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:44595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:43859,127.4.201.125:33311,127.4.201.124:46307
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.124.keytab
--principal=kudu/127.4.201.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.124:46307
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.4.201.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:08:17.796433 27273 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:08:17.797781 27273 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:08:17.809098 27282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:17.809099 27286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:17.809080 27289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:08:17.809736 27273 server_base.cc:1034] running on GCE node
I20260812 01:08:17.810508 27273 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:08:17.811843 27273 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:08:17.813040 27273 hybrid_clock.cc:648] HybridClock initialized: now 1786496897812994 us; error 41 us; skew 500 ppm
I20260812 01:08:17.813423 27273 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:08:17 dist-test-slave-bndk krb5kdc[27008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496897, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:08:17.816323 27273 init.cc:377] Logged in from keytab as kudu/127.4.201.124@KRBTEST.COM (short username kudu)
I20260812 01:08:17.817729 27273 webserver.cc:460] Webserver started at http://127.4.201.124:38645/ using document root <none> and password file <none>
I20260812 01:08:17.818404 27273 fs_manager.cc:359] Metadata directory not provided
I20260812 01:08:17.818533 27273 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:08:17.818822 27273 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:08:17.821732 27273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-2/data/instance:
uuid: "754ffea9f1154add9c7acfced66f22a4"
format_stamp: "Formatted at 2026-08-12 01:08:17 on dist-test-slave-bndk"
server_key: "ad824dfc2aa9b5c758ae278b0d040a10"
server_key_iv: "5c89dd885f00384ccb82e9ef6e4a67af"
server_key_version: "encryptionkey@0"
I20260812 01:08:17.822510 27273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-2/wal/instance:
uuid: "754ffea9f1154add9c7acfced66f22a4"
format_stamp: "Formatted at 2026-08-12 01:08:17 on dist-test-slave-bndk"
server_key: "ad824dfc2aa9b5c758ae278b0d040a10"
server_key_iv: "5c89dd885f00384ccb82e9ef6e4a67af"
server_key_version: "encryptionkey@0"
I20260812 01:08:17.827322 27273 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260812 01:08:17.830674 27300 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:17.831924 27273 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 01:08:17.832080 27273 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-2/wal
uuid: "754ffea9f1154add9c7acfced66f22a4"
format_stamp: "Formatted at 2026-08-12 01:08:17 on dist-test-slave-bndk"
server_key: "ad824dfc2aa9b5c758ae278b0d040a10"
server_key_iv: "5c89dd885f00384ccb82e9ef6e4a67af"
server_key_version: "encryptionkey@0"
I20260812 01:08:17.832247 27273 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:08:17.832831 27139 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46307 } attempt: 3
I20260812 01:08:17.834036 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.833485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46307 (local address 127.0.0.1:33224)
0812 01:08:17.833727 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:17.833832 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260812 01:08:17.835038 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.834652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46307 (local address 127.0.0.1:33230)
0812 01:08:17.834798 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:17.834892 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260812 01:08:17.835268 27139 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.124:46307: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46307: connect: Connection refused (error 111)
I20260812 01:08:17.869377 27273 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:08:17.873407 27273 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:08:17.873660 27273 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:08:17.891590 27273 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.124:46307
I20260812 01:08:17.891597 27383 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.124:46307 every 8 connection(s)
I20260812 01:08:17.892863 27273 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-2/data/info.pb
I20260812 01:08:17.894690 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 27273
I20260812 01:08:17.894858 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786496689953932-4901-0/minicluster-data/master-2/wal/instance
I20260812 01:08:17.895334 4901 external_mini_cluster.cc:1428] Setting key 87a867d600839fed72840da1272e203a
I20260812 01:08:17.896792 27384 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:08:17.904228 27384 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43859 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 01:08:17 dist-test-slave-bndk krb5kdc[27008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496896, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.124@KRBTEST.COM
Aug 12 01:08:17 dist-test-slave-bndk krb5kdc[27008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496897, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.124@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:08:17.918517 27387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.897136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33246 (local address 127.4.201.124:46307)
0812 01:08:17.897933 (+ 797us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:17.897945 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:17.897999 (+ 54us) server_negotiation.cc:407] Connection header received
0812 01:08:17.899549 (+ 1550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:17.899571 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:17.899931 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:17.900299 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:17.901810 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.903129 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.904491 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.905541 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.905707 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:17.910422 (+ 4715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:17.910438 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:17.910455 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:17.910512 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:17.914251 (+ 3739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:17.914956 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:17.914963 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:17.914969 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:17.915129 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:17.915551 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:17.915555 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:17.915557 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:17.916126 (+ 569us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:17.916407 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:17.916784 (+ 377us) server_negotiation.cc:299] Negotiation successful
0812 01:08:17.917173 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":599,"thread_start_us":343,"threads_started":1}
I20260812 01:08:17.922212 27388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.906657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:43859 (local address 127.0.0.1:35430)
0812 01:08:17.907469 (+ 812us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:17.907519 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:17.907666 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:17.908071 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:17.908076 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:17.908611 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:08:17.908876 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:17.908885 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.910303 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.910338 (+ 35us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:17.911950 (+ 1612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:17.911965 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.912834 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.912841 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:17.913027 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:17.913591 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:08:17.913620 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:08:17.915907 (+ 2287us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:08:17.919508 (+ 3601us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:17.919518 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:17.919525 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:17.919962 (+ 437us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:17.920403 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:17.920407 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:17.920409 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:17.920551 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:17.921113 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:08:17.921120 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:08:17.921335 (+ 215us) client_negotiation.cc:769] Sending connection context
0812 01:08:17.921535 (+ 200us) client_negotiation.cc:240] Negotiation successful
0812 01:08:17.921841 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":425,"threads_started":1}
I20260812 01:08:17.922770 27142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.906722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35430 (local address 127.4.201.126:43859)
0812 01:08:17.906952 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:17.906959 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:17.907618 (+ 659us) server_negotiation.cc:407] Connection header received
0812 01:08:17.907815 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:17.907822 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:17.907907 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:17.908025 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:17.909027 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.910085 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.912106 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.912645 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.912738 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:17.916094 (+ 3356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:17.916101 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:17.916105 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:17.916143 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:17.919380 (+ 3237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:17.920089 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:17.920094 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:17.920098 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:17.920266 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:17.920659 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:17.920663 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:17.920665 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:17.920959 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:17.921114 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:17.921748 (+ 634us) server_negotiation.cc:299] Negotiation successful
0812 01:08:17.922144 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 01:08:17.924090 27384 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.201.125" port: 33311 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 01:08:17 dist-test-slave-bndk krb5kdc[27008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496896, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
Aug 12 01:08:17 dist-test-slave-bndk krb5kdc[27008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496897, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.124@KRBTEST.COM for kudu/127.4.201.125@KRBTEST.COM
I20260812 01:08:17.936060 27388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.924812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:33311 (local address 127.0.0.1:37144)
0812 01:08:17.924981 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:17.924999 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:17.925088 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:17.925384 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:17.925389 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:17.925779 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:08:17.925909 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:17.925917 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.926815 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.926821 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:17.927639 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:17.927650 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.928334 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.928339 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:17.928522 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:17.928974 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:08:17.928989 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:08:17.931171 (+ 2182us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:08:17.933916 (+ 2745us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:17.933921 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:17.933925 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:17.934269 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:17.934628 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:17.934633 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:17.934637 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:17.934764 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:17.935228 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:08:17.935232 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:08:17.935393 (+ 161us) client_negotiation.cc:769] Sending connection context
0812 01:08:17.935507 (+ 114us) client_negotiation.cc:240] Negotiation successful
0812 01:08:17.935746 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57}
I20260812 01:08:17.936167 27270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.924847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37144 (local address 127.4.201.125:33311)
0812 01:08:17.925035 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:17.925040 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:17.925057 (+ 17us) server_negotiation.cc:407] Connection header received
0812 01:08:17.925184 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:17.925188 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:17.925272 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:17.925350 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:17.926048 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.926684 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.927770 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.928188 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.928292 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:17.931353 (+ 3061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:17.931358 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:17.931362 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:17.931393 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:17.933793 (+ 2400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:17.934377 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:17.934382 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:17.934385 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:17.934526 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:17.934869 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:17.934873 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:17.934875 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:17.935117 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:17.935242 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:17.935613 (+ 371us) server_negotiation.cc:299] Negotiation successful
0812 01:08:17.935826 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 01:08:17.936416 27389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.921819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35444 (local address 127.4.201.126:43859)
0812 01:08:17.922742 (+ 923us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:17.922748 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:17.922775 (+ 27us) server_negotiation.cc:407] Connection header received
0812 01:08:17.922823 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:17.922827 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:17.922894 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:17.922997 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:17.924415 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.925529 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.926717 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.927113 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.927219 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:17.931150 (+ 3931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:17.931154 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:17.931157 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:17.931187 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:17.933706 (+ 2519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:17.934322 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:17.934326 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:17.934328 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:17.934439 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:17.934786 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:17.934791 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:17.934794 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:17.935055 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:17.935294 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:17.935595 (+ 301us) server_negotiation.cc:299] Negotiation successful
0812 01:08:17.935796 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":773,"thread_start_us":296,"threads_started":1}
I20260812 01:08:17.937492 27384 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46307 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 01:08:17 dist-test-slave-bndk krb5kdc[27008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496897, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.124@KRBTEST.COM for kudu/127.4.201.124@KRBTEST.COM
Aug 12 01:08:17 dist-test-slave-bndk krb5kdc[27008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496896, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.125@KRBTEST.COM
I20260812 01:08:17.950433 27388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.938093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46307 (local address 127.0.0.1:33260)
0812 01:08:17.938495 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:17.938511 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:17.938601 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:17.938901 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:17.938905 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:17.939328 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:08:17.939504 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:17.939516 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.940524 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.940528 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:17.941608 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:17.941623 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.942321 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.942328 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:17.942496 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:17.942992 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:08:17.943013 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:08:17.945277 (+ 2264us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:08:17.948191 (+ 2914us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:17.948196 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:17.948200 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:17.948537 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:17.948869 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:17.948874 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:17.948878 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:17.948997 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:17.949507 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:08:17.949511 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:08:17.949639 (+ 128us) client_negotiation.cc:769] Sending connection context
0812 01:08:17.949761 (+ 122us) client_negotiation.cc:240] Negotiation successful
0812 01:08:17.950038 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301}
I20260812 01:08:17.950503 27387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.938145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33260 (local address 127.4.201.124:46307)
0812 01:08:17.938279 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:17.938283 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:17.938558 (+ 275us) server_negotiation.cc:407] Connection header received
0812 01:08:17.938702 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:17.938706 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:17.938771 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:17.938859 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:17.939634 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.940400 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.941740 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.942153 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.942243 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:17.945433 (+ 3190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:17.945437 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:17.945440 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:17.945467 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:17.948078 (+ 2611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:17.948639 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:17.948644 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:17.948646 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:17.948756 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:17.949092 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:17.949097 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:17.949100 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:17.949394 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:17.949519 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:17.949854 (+ 335us) server_negotiation.cc:299] Negotiation successful
0812 01:08:17.950208 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":141,"server-negotiator.queue_time_us":32}
I20260812 01:08:17.952612 27270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.938074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37158 (local address 127.4.201.125:33311)
0812 01:08:17.938349 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:17.938355 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:17.938372 (+ 17us) server_negotiation.cc:407] Connection header received
0812 01:08:17.938542 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:17.938547 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:17.938615 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:17.938708 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:17.940139 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.940922 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.942397 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.942858 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.942966 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:17.947543 (+ 4577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:17.947548 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:17.947551 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:17.947580 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:17.949919 (+ 2339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:17.950705 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:17.950711 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:17.950714 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:17.950879 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:17.951317 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:17.951320 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:17.951322 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:17.951598 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:17.951859 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:17.952090 (+ 231us) server_negotiation.cc:299] Negotiation successful
0812 01:08:17.952301 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142}
I20260812 01:08:17.955672 27384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 754ffea9f1154add9c7acfced66f22a4: Bootstrap starting.
I20260812 01:08:17.957275 4901 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:08:17.958931 27384 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 754ffea9f1154add9c7acfced66f22a4: Neither blocks nor log segments found. Creating new log.
I20260812 01:08:17.959918 27384 log.cc:824] T 00000000000000000000000000000000 P 754ffea9f1154add9c7acfced66f22a4: Log is configured to *not* fsync() on all Append() calls
I20260812 01:08:17.962779 27384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 754ffea9f1154add9c7acfced66f22a4: No bootstrap required, opened a new log
I20260812 01:08:17.974016 27384 raft_consensus.cc:348] T 00000000000000000000000000000000 P 754ffea9f1154add9c7acfced66f22a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0eade5586114f76902cf78a13ab40ae" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43859 } } peers { permanent_uuid: "1c2c11b0199849a0b3023ac6e979b18b" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 33311 } } peers { permanent_uuid: "754ffea9f1154add9c7acfced66f22a4" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46307 } }
I20260812 01:08:17.974473 27384 raft_consensus.cc:374] T 00000000000000000000000000000000 P 754ffea9f1154add9c7acfced66f22a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:08:17.974597 27384 raft_consensus.cc:729] T 00000000000000000000000000000000 P 754ffea9f1154add9c7acfced66f22a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 754ffea9f1154add9c7acfced66f22a4, State: Initialized, Role: FOLLOWER
I20260812 01:08:17.975451 27384 consensus_queue.cc:260] T 00000000000000000000000000000000 P 754ffea9f1154add9c7acfced66f22a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0eade5586114f76902cf78a13ab40ae" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43859 } } peers { permanent_uuid: "1c2c11b0199849a0b3023ac6e979b18b" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 33311 } } peers { permanent_uuid: "754ffea9f1154add9c7acfced66f22a4" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46307 } }
I20260812 01:08:17.979774 27389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.962283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35454 (local address 127.4.201.126:43859)
0812 01:08:17.962465 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:17.962471 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:17.962605 (+ 134us) server_negotiation.cc:407] Connection header received
0812 01:08:17.962828 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:17.962834 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:17.962924 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:17.963012 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:17.964711 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.965545 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.967583 (+ 2038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.968196 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.968319 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:17.971913 (+ 3594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:17.971919 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:17.971924 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:17.971965 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:17.975325 (+ 3360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:17.977110 (+ 1785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:17.977116 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:17.977120 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:17.977309 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:17.977791 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:17.977797 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:17.977800 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:17.978195 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:17.978425 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:17.979217 (+ 792us) server_negotiation.cc:299] Negotiation successful
0812 01:08:17.979435 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 01:08:17.979607 27403 sys_catalog.cc:455] T 00000000000000000000000000000000 P 754ffea9f1154add9c7acfced66f22a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0eade5586114f76902cf78a13ab40ae" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43859 } } peers { permanent_uuid: "1c2c11b0199849a0b3023ac6e979b18b" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 33311 } } peers { permanent_uuid: "754ffea9f1154add9c7acfced66f22a4" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46307 } } }
I20260812 01:08:17.980005 27403 sys_catalog.cc:458] T 00000000000000000000000000000000 P 754ffea9f1154add9c7acfced66f22a4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:08:17.981099 27384 sys_catalog.cc:564] T 00000000000000000000000000000000 P 754ffea9f1154add9c7acfced66f22a4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:08:17.982771 27270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.961973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37168 (local address 127.4.201.125:33311)
0812 01:08:17.962126 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:17.962132 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:17.965726 (+ 3594us) server_negotiation.cc:407] Connection header received
0812 01:08:17.965968 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:17.965973 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:17.966045 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:17.966107 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:17.968361 (+ 2254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.969408 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.971568 (+ 2160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.972144 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.972234 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:17.975581 (+ 3347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:17.975588 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:17.975593 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:17.975632 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:17.978708 (+ 3076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:17.980242 (+ 1534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:17.980248 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:17.980251 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:17.980414 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:17.980914 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:17.980919 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:17.980922 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:17.981330 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:17.981552 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:17.982204 (+ 652us) server_negotiation.cc:299] Negotiation successful
0812 01:08:17.982439 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260812 01:08:17.991685 27419 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 754ffea9f1154add9c7acfced66f22a4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 01:08:17.991819 27419 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 01:08:17.995126 27387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:17.965967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33272 (local address 127.4.201.124:46307)
0812 01:08:17.966147 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:17.966153 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:17.977665 (+ 11512us) server_negotiation.cc:407] Connection header received
0812 01:08:17.978068 (+ 403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:17.978075 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:17.978159 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:17.978227 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:17.980954 (+ 2727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.982007 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.984503 (+ 2496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:17.985308 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:17.985449 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:17.988540 (+ 3091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:17.988547 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:17.988552 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:17.988589 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:17.992406 (+ 3817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:17.993077 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:17.993081 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:17.993084 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:17.993292 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:17.993665 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:17.993671 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:17.993674 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:17.993968 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:17.994222 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:17.994528 (+ 306us) server_negotiation.cc:299] Negotiation successful
0812 01:08:17.994755 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":60}
I20260812 01:08:17.989156 27273 master_runner.cc:186] Error getting master registration for 127.4.201.126:43859: OK, instance_id { permanent_uuid: "a0eade5586114f76902cf78a13ab40ae" instance_seqno: 1786496896876931 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 01:08:18.000300 27273 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:08:18.012496 27139 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46307 } attempt: 4
Aug 12 01:08:18 dist-test-slave-bndk krb5kdc[27008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496896, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for kudu/127.4.201.124@KRBTEST.COM
I20260812 01:08:18.027665 27387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:18.013779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33274 (local address 127.4.201.124:46307)
0812 01:08:18.013974 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:18.013980 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:18.013998 (+ 18us) server_negotiation.cc:407] Connection header received
0812 01:08:18.014048 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:18.014053 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:18.014143 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:18.014239 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:18.014996 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:18.016157 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:18.017428 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:18.018134 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:18.018960 (+ 826us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:18.022192 (+ 3232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:18.022198 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:18.022202 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:18.022236 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:18.025005 (+ 2769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:18.025817 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:18.025822 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:18.025824 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:18.025970 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:18.026361 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:18.026366 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:18.026370 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:18.026640 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:18.026752 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:18.027181 (+ 429us) server_negotiation.cc:299] Negotiation successful
0812 01:08:18.027360 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 01:08:18.027762 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:18.013044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46307 (local address 127.0.0.1:33274)
0812 01:08:18.013400 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:18.013422 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:18.013527 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:18.014298 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:18.014302 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:18.014688 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:08:18.014846 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:18.014855 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:18.016265 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:18.016269 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:18.017275 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:18.017289 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:18.018360 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:18.018368 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:18.018555 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:18.019217 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:08:18.019242 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:08:18.021987 (+ 2745us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:08:18.025139 (+ 3152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:18.025145 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:18.025150 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:18.025700 (+ 550us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:18.026077 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:18.026082 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:18.026086 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:18.026248 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:18.026765 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:08:18.026771 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:08:18.026941 (+ 170us) client_negotiation.cc:769] Sending connection context
0812 01:08:18.027089 (+ 148us) client_negotiation.cc:240] Negotiation successful
0812 01:08:18.027379 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205}
I20260812 01:08:18.032900 27139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0eade5586114f76902cf78a13ab40ae: Bootstrap starting.
I20260812 01:08:18.036038 27139 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a0eade5586114f76902cf78a13ab40ae: Neither blocks nor log segments found. Creating new log.
I20260812 01:08:18.037127 27139 log.cc:824] T 00000000000000000000000000000000 P a0eade5586114f76902cf78a13ab40ae: Log is configured to *not* fsync() on all Append() calls
I20260812 01:08:18.039803 27139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0eade5586114f76902cf78a13ab40ae: No bootstrap required, opened a new log
I20260812 01:08:18.047492 27139 raft_consensus.cc:348] T 00000000000000000000000000000000 P a0eade5586114f76902cf78a13ab40ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0eade5586114f76902cf78a13ab40ae" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43859 } } peers { permanent_uuid: "1c2c11b0199849a0b3023ac6e979b18b" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 33311 } } peers { permanent_uuid: "754ffea9f1154add9c7acfced66f22a4" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46307 } }
I20260812 01:08:18.047787 27139 raft_consensus.cc:374] T 00000000000000000000000000000000 P a0eade5586114f76902cf78a13ab40ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:08:18.047894 27139 raft_consensus.cc:729] T 00000000000000000000000000000000 P a0eade5586114f76902cf78a13ab40ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0eade5586114f76902cf78a13ab40ae, State: Initialized, Role: FOLLOWER
I20260812 01:08:18.048379 27139 consensus_queue.cc:260] T 00000000000000000000000000000000 P a0eade5586114f76902cf78a13ab40ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0eade5586114f76902cf78a13ab40ae" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43859 } } peers { permanent_uuid: "1c2c11b0199849a0b3023ac6e979b18b" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 33311 } } peers { permanent_uuid: "754ffea9f1154add9c7acfced66f22a4" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46307 } }
I20260812 01:08:18.049294 27422 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0eade5586114f76902cf78a13ab40ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0eade5586114f76902cf78a13ab40ae" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43859 } } peers { permanent_uuid: "1c2c11b0199849a0b3023ac6e979b18b" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 33311 } } peers { permanent_uuid: "754ffea9f1154add9c7acfced66f22a4" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46307 } } }
I20260812 01:08:18.049726 27422 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0eade5586114f76902cf78a13ab40ae [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:08:18.050416 27139 sys_catalog.cc:564] T 00000000000000000000000000000000 P a0eade5586114f76902cf78a13ab40ae [sys.catalog]: configured and running, proceeding with master startup.
W20260812 01:08:18.064005 27447 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a0eade5586114f76902cf78a13ab40ae: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 01:08:18.064139 27447 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 01:08:18.059757 27028 master_runner.cc:186] Error getting master registration for 127.4.201.125:33311: OK, instance_id { permanent_uuid: "1c2c11b0199849a0b3023ac6e979b18b" instance_seqno: 1786496897369812 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 01:08:18.072456 27028 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:08:18.092332 27262 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46307 } attempt: 5
Aug 12 01:08:18 dist-test-slave-bndk krb5kdc[27008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496897, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.125@KRBTEST.COM for kudu/127.4.201.124@KRBTEST.COM
I20260812 01:08:18.110316 27265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:18.092955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46307 (local address 127.0.0.1:33284)
0812 01:08:18.093246 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:18.093269 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:18.093395 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:18.093780 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:18.093785 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:18.094342 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:08:18.094551 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:18.094564 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:18.096651 (+ 2087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:18.096657 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:18.098116 (+ 1459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:18.098133 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:18.099155 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:18.099162 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:18.099398 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:18.100089 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:08:18.100113 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:08:18.102989 (+ 2876us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:08:18.107260 (+ 4271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:18.107265 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:18.107269 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:18.107820 (+ 551us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:18.108289 (+ 469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:18.108294 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:18.108298 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:18.108469 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:18.109281 (+ 812us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:08:18.109287 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:08:18.109457 (+ 170us) client_negotiation.cc:769] Sending connection context
0812 01:08:18.109608 (+ 151us) client_negotiation.cc:240] Negotiation successful
0812 01:08:18.109913 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135}
I20260812 01:08:18.111426 27387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:18.093072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33284 (local address 127.4.201.124:46307)
0812 01:08:18.093276 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:18.093283 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:18.093332 (+ 49us) server_negotiation.cc:407] Connection header received
0812 01:08:18.093525 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:18.093531 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:18.093620 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:18.093738 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:18.094726 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:18.095978 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:18.098276 (+ 2298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:18.098984 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:18.099119 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:18.103189 (+ 4070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:18.103197 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:18.103203 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:18.103243 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:18.107129 (+ 3886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:18.107960 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:18.107966 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:18.107970 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:18.108135 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:18.108613 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:18.108618 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:18.108622 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:18.109015 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:18.109186 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:18.110778 (+ 1592us) server_negotiation.cc:299] Negotiation successful
0812 01:08:18.111036 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260812 01:08:18.117360 27060 tablet.cc:2369] T 00000000000000000000000000000000 P a0eade5586114f76902cf78a13ab40ae: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:08:18.117811 27262 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b: Bootstrap starting.
I20260812 01:08:18.122066 27262 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b: Neither blocks nor log segments found. Creating new log.
I20260812 01:08:18.123390 27262 log.cc:824] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b: Log is configured to *not* fsync() on all Append() calls
W20260812 01:08:18.125722 27310 tablet.cc:2369] T 00000000000000000000000000000000 P 754ffea9f1154add9c7acfced66f22a4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:08:18.126726 27262 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b: No bootstrap required, opened a new log
I20260812 01:08:18.137780 27262 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0eade5586114f76902cf78a13ab40ae" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43859 } } peers { permanent_uuid: "1c2c11b0199849a0b3023ac6e979b18b" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 33311 } } peers { permanent_uuid: "754ffea9f1154add9c7acfced66f22a4" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46307 } }
I20260812 01:08:18.138211 27262 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:08:18.138329 27262 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c2c11b0199849a0b3023ac6e979b18b, State: Initialized, Role: FOLLOWER
I20260812 01:08:18.139073 27262 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0eade5586114f76902cf78a13ab40ae" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43859 } } peers { permanent_uuid: "1c2c11b0199849a0b3023ac6e979b18b" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 33311 } } peers { permanent_uuid: "754ffea9f1154add9c7acfced66f22a4" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46307 } }
I20260812 01:08:18.140046 27455 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0eade5586114f76902cf78a13ab40ae" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43859 } } peers { permanent_uuid: "1c2c11b0199849a0b3023ac6e979b18b" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 33311 } } peers { permanent_uuid: "754ffea9f1154add9c7acfced66f22a4" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46307 } } }
I20260812 01:08:18.140532 27455 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:08:18.141326 27262 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:08:18.162648 27147 master_runner.cc:263] No leader master found from master 1c2c11b0199849a0b3023ac6e979b18b
I20260812 01:08:18.162814 27147 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 01:08:18.171960 27471 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 01:08:18.172115 27471 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 01:08:18.303395 27455 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:08:18.303761 27455 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0eade5586114f76902cf78a13ab40ae" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43859 } } peers { permanent_uuid: "1c2c11b0199849a0b3023ac6e979b18b" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 33311 } } peers { permanent_uuid: "754ffea9f1154add9c7acfced66f22a4" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46307 } }
I20260812 01:08:18.305672 27455 leader_election.cc:288] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0eade5586114f76902cf78a13ab40ae (127.4.201.126:43859), 754ffea9f1154add9c7acfced66f22a4 (127.4.201.124:46307)
I20260812 01:08:18.306923 27096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1c2c11b0199849a0b3023ac6e979b18b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0eade5586114f76902cf78a13ab40ae" is_pre_election: true
I20260812 01:08:18.307595 27096 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a0eade5586114f76902cf78a13ab40ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c2c11b0199849a0b3023ac6e979b18b in term 0.
I20260812 01:08:18.308459 27180 leader_election.cc:302] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c2c11b0199849a0b3023ac6e979b18b, a0eade5586114f76902cf78a13ab40ae; no voters:
I20260812 01:08:18.309008 27455 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:08:18.309162 27455 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:08:18.309296 27455 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:08:18.312717 27455 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0eade5586114f76902cf78a13ab40ae" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43859 } } peers { permanent_uuid: "1c2c11b0199849a0b3023ac6e979b18b" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 33311 } } peers { permanent_uuid: "754ffea9f1154add9c7acfced66f22a4" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46307 } }
I20260812 01:08:18.314291 27339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1c2c11b0199849a0b3023ac6e979b18b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "754ffea9f1154add9c7acfced66f22a4" is_pre_election: true
I20260812 01:08:18.314988 27339 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 754ffea9f1154add9c7acfced66f22a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c2c11b0199849a0b3023ac6e979b18b in term 0.
I20260812 01:08:18.319566 27096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1c2c11b0199849a0b3023ac6e979b18b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0eade5586114f76902cf78a13ab40ae"
I20260812 01:08:18.319814 27096 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a0eade5586114f76902cf78a13ab40ae [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:08:18.323375 27096 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a0eade5586114f76902cf78a13ab40ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c2c11b0199849a0b3023ac6e979b18b in term 1.
I20260812 01:08:18.323928 27180 leader_election.cc:302] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c2c11b0199849a0b3023ac6e979b18b, a0eade5586114f76902cf78a13ab40ae; no voters:
I20260812 01:08:18.327914 27339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1c2c11b0199849a0b3023ac6e979b18b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "754ffea9f1154add9c7acfced66f22a4"
I20260812 01:08:18.328166 27339 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 754ffea9f1154add9c7acfced66f22a4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:08:18.330835 27455 leader_election.cc:288] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b [CANDIDATE]: Term 1 election: Requested vote from peers a0eade5586114f76902cf78a13ab40ae (127.4.201.126:43859), 754ffea9f1154add9c7acfced66f22a4 (127.4.201.124:46307)
I20260812 01:08:18.331092 27455 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:08:18.331248 27455 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b [term 1 LEADER]: Becoming Leader. State: Replica: 1c2c11b0199849a0b3023ac6e979b18b, State: Running, Role: LEADER
I20260812 01:08:18.331945 27339 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 754ffea9f1154add9c7acfced66f22a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c2c11b0199849a0b3023ac6e979b18b in term 1.
I20260812 01:08:18.331890 27455 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0eade5586114f76902cf78a13ab40ae" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43859 } } peers { permanent_uuid: "1c2c11b0199849a0b3023ac6e979b18b" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 33311 } } peers { permanent_uuid: "754ffea9f1154add9c7acfced66f22a4" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46307 } }
I20260812 01:08:18.345602 27474 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c2c11b0199849a0b3023ac6e979b18b. Latest consensus state: current_term: 1 leader_uuid: "1c2c11b0199849a0b3023ac6e979b18b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0eade5586114f76902cf78a13ab40ae" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43859 } } peers { permanent_uuid: "1c2c11b0199849a0b3023ac6e979b18b" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 33311 } } peers { permanent_uuid: "754ffea9f1154add9c7acfced66f22a4" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46307 } } }
I20260812 01:08:18.346112 27474 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b [sys.catalog]: This master's current role is: LEADER
I20260812 01:08:18.353190 27477 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:08:18.355584 27477 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260812 01:08:18.360419 27183 tablet.cc:2369] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:08:18.377478 27339 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 754ffea9f1154add9c7acfced66f22a4 [term 1 FOLLOWER]: Refusing update from remote peer 1c2c11b0199849a0b3023ac6e979b18b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:08:18.378671 27474 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "754ffea9f1154add9c7acfced66f22a4" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:08:18.385942 27096 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a0eade5586114f76902cf78a13ab40ae [term 1 FOLLOWER]: Refusing update from remote peer 1c2c11b0199849a0b3023ac6e979b18b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:08:18.386858 27474 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0eade5586114f76902cf78a13ab40ae" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:08:18.413048 27422 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0eade5586114f76902cf78a13ab40ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c2c11b0199849a0b3023ac6e979b18b. Latest consensus state: current_term: 1 leader_uuid: "1c2c11b0199849a0b3023ac6e979b18b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0eade5586114f76902cf78a13ab40ae" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43859 } } peers { permanent_uuid: "1c2c11b0199849a0b3023ac6e979b18b" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 33311 } } peers { permanent_uuid: "754ffea9f1154add9c7acfced66f22a4" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46307 } } }
I20260812 01:08:18.413414 27422 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0eade5586114f76902cf78a13ab40ae [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:08:18.416949 27479 mvcc.cc:205] Tried to move back new op lower bound from 7317491295739621376 to 7317491295572500480. Current Snapshot: MvccSnapshot[applied={T|T < 7317491295739621376}]
I20260812 01:08:18.418110 27485 mvcc.cc:205] Tried to move back new op lower bound from 7317491295739621376 to 7317491295572500480. Current Snapshot: MvccSnapshot[applied={T|T < 7317491295739621376}]
I20260812 01:08:18.421898 27455 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1c2c11b0199849a0b3023ac6e979b18b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0eade5586114f76902cf78a13ab40ae" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43859 } } peers { permanent_uuid: "1c2c11b0199849a0b3023ac6e979b18b" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 33311 } } peers { permanent_uuid: "754ffea9f1154add9c7acfced66f22a4" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46307 } } }
I20260812 01:08:18.422192 27455 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b [sys.catalog]: This master's current role is: LEADER
I20260812 01:08:18.423552 27403 sys_catalog.cc:455] T 00000000000000000000000000000000 P 754ffea9f1154add9c7acfced66f22a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c2c11b0199849a0b3023ac6e979b18b. Latest consensus state: current_term: 1 leader_uuid: "1c2c11b0199849a0b3023ac6e979b18b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0eade5586114f76902cf78a13ab40ae" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43859 } } peers { permanent_uuid: "1c2c11b0199849a0b3023ac6e979b18b" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 33311 } } peers { permanent_uuid: "754ffea9f1154add9c7acfced66f22a4" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46307 } } }
I20260812 01:08:18.423873 27403 sys_catalog.cc:458] T 00000000000000000000000000000000 P 754ffea9f1154add9c7acfced66f22a4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:08:18.425055 27477 catalog_manager.cc:1347] Generated new cluster ID: 05c1978015d54597a4f586e03473c679
I20260812 01:08:18.425145 27477 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:08:18.432837 27422 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0eade5586114f76902cf78a13ab40ae [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1c2c11b0199849a0b3023ac6e979b18b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0eade5586114f76902cf78a13ab40ae" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43859 } } peers { permanent_uuid: "1c2c11b0199849a0b3023ac6e979b18b" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 33311 } } peers { permanent_uuid: "754ffea9f1154add9c7acfced66f22a4" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46307 } } }
I20260812 01:08:18.433099 27422 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0eade5586114f76902cf78a13ab40ae [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:08:18.438865 27474 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1c2c11b0199849a0b3023ac6e979b18b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0eade5586114f76902cf78a13ab40ae" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43859 } } peers { permanent_uuid: "1c2c11b0199849a0b3023ac6e979b18b" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 33311 } } peers { permanent_uuid: "754ffea9f1154add9c7acfced66f22a4" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46307 } } }
I20260812 01:08:18.439601 27474 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b [sys.catalog]: This master's current role is: LEADER
I20260812 01:08:18.439747 27480 mvcc.cc:205] Tried to move back new op lower bound from 7317491295739621376 to 7317491295572500480. Current Snapshot: MvccSnapshot[applied={T|T < 7317491295739621376}]
I20260812 01:08:18.445921 27403 sys_catalog.cc:455] T 00000000000000000000000000000000 P 754ffea9f1154add9c7acfced66f22a4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1c2c11b0199849a0b3023ac6e979b18b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0eade5586114f76902cf78a13ab40ae" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43859 } } peers { permanent_uuid: "1c2c11b0199849a0b3023ac6e979b18b" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 33311 } } peers { permanent_uuid: "754ffea9f1154add9c7acfced66f22a4" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46307 } } }
I20260812 01:08:18.446185 27403 sys_catalog.cc:458] T 00000000000000000000000000000000 P 754ffea9f1154add9c7acfced66f22a4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:08:18.490351 27477 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:08:18.492465 27477 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:08:18.520161 27477 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1c2c11b0199849a0b3023ac6e979b18b: Generated new TSK 0
I20260812 01:08:18.521258 27477 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:08:18.993906 27419 catalog_manager.cc:1259] Loaded cluster ID: 05c1978015d54597a4f586e03473c679
I20260812 01:08:18.994019 27419 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 754ffea9f1154add9c7acfced66f22a4: loading cluster ID for follower catalog manager: success
I20260812 01:08:18.996490 27419 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 754ffea9f1154add9c7acfced66f22a4: acquiring CA information for follower catalog manager: success
I20260812 01:08:18.998252 27419 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 754ffea9f1154add9c7acfced66f22a4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 01:08:19.066121 27447 catalog_manager.cc:1259] Loaded cluster ID: 05c1978015d54597a4f586e03473c679
I20260812 01:08:19.066218 27447 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a0eade5586114f76902cf78a13ab40ae: loading cluster ID for follower catalog manager: success
I20260812 01:08:19.068595 27447 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a0eade5586114f76902cf78a13ab40ae: acquiring CA information for follower catalog manager: success
I20260812 01:08:19.070345 27447 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a0eade5586114f76902cf78a13ab40ae: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 01:08:19.107417 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 27028
I20260812 01:08:19.108654 27130 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:08:19.216727 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 27028
I20260812 01:08:19.239239 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 27147
I20260812 01:08:19.240353 27253 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:08:19.348742 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 27147
I20260812 01:08:19.374861 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 27273
I20260812 01:08:19.376019 27375 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:08:19.483522 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 27273
2026-08-12T01:08:19Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (4523 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:08:19 dist-test-slave-bndk krb5kdc[27507](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:08:19 dist-test-slave-bndk krb5kdc[27507](info): set up 2 sockets
Aug 12 01:08:19 dist-test-slave-bndk krb5kdc[27507](info): commencing operation
krb5kdc: starting...
W20260812 01:08:20.718408 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.189s user 0.004s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:08:20 dist-test-slave-bndk krb5kdc[27507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496900, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:08:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:08:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.201.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
I20260812 01:08:20.968770 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:34619
--webserver_interface=127.4.201.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:33583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:34619
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:08:21.303790 27527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:08:21.304069 27527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:08:21.304201 27527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:08:21.311259 27527 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:08:21.311383 27527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:08:21.311460 27527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:08:21.311537 27527 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:08:21.311597 27527 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:08:21.321210 27527 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:33583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:34619
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:34619
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:08:21.322551 27527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:08:21.323845 27527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:08:21.335383 27540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:21.335443 27533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:21.335408 27535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:08:21.336318 27527 server_base.cc:1034] running on GCE node
I20260812 01:08:21.337109 27527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:08:21.338541 27527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:08:21.339752 27527 hybrid_clock.cc:648] HybridClock initialized: now 1786496901339698 us; error 45 us; skew 500 ppm
I20260812 01:08:21.340095 27527 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:08:21 dist-test-slave-bndk krb5kdc[27507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496901, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:08:21.343273 27527 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:08:21.344725 27527 webserver.cc:460] Webserver started at http://127.4.201.126:46495/ using document root <none> and password file <none>
I20260812 01:08:21.345468 27527 fs_manager.cc:359] Metadata directory not provided
I20260812 01:08:21.345595 27527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:08:21.345932 27527 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:08:21.348922 27527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "9edd12858d0840f1986b8c40b5bac4b8"
format_stamp: "Formatted at 2026-08-12 01:08:21 on dist-test-slave-bndk"
server_key: "9f8292d59d0dae33f4923c49ebe673a5"
server_key_iv: "409521ef7a3a071e03efefdf3c52ae5b"
server_key_version: "encryptionkey@0"
I20260812 01:08:21.349675 27527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "9edd12858d0840f1986b8c40b5bac4b8"
format_stamp: "Formatted at 2026-08-12 01:08:21 on dist-test-slave-bndk"
server_key: "9f8292d59d0dae33f4923c49ebe673a5"
server_key_iv: "409521ef7a3a071e03efefdf3c52ae5b"
server_key_version: "encryptionkey@0"
I20260812 01:08:21.354952 27527 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260812 01:08:21.358409 27549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:21.359741 27527 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 01:08:21.359907 27527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "9edd12858d0840f1986b8c40b5bac4b8"
format_stamp: "Formatted at 2026-08-12 01:08:21 on dist-test-slave-bndk"
server_key: "9f8292d59d0dae33f4923c49ebe673a5"
server_key_iv: "409521ef7a3a071e03efefdf3c52ae5b"
server_key_version: "encryptionkey@0"
I20260812 01:08:21.360116 27527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:08:21.380929 27527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:08:21.384974 27527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:08:21.385283 27527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:08:21.403157 27527 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:34619
I20260812 01:08:21.403167 27638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:34619 every 8 connection(s)
I20260812 01:08:21.404560 27527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:08:21.408289 27639 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:08:21.414207 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 27527
I20260812 01:08:21.414469 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:08:21.415349 4901 external_mini_cluster.cc:1428] Setting key b5a8b8ffb7278419deb81663c1cc598f
I20260812 01:08:21.419598 27639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9edd12858d0840f1986b8c40b5bac4b8: Bootstrap starting.
I20260812 01:08:21.422631 27639 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9edd12858d0840f1986b8c40b5bac4b8: Neither blocks nor log segments found. Creating new log.
I20260812 01:08:21.423655 27639 log.cc:824] T 00000000000000000000000000000000 P 9edd12858d0840f1986b8c40b5bac4b8: Log is configured to *not* fsync() on all Append() calls
I20260812 01:08:21.426400 27639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9edd12858d0840f1986b8c40b5bac4b8: No bootstrap required, opened a new log
Aug 12 01:08:21 dist-test-slave-bndk krb5kdc[27507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496900, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:08:21.434387 27639 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9edd12858d0840f1986b8c40b5bac4b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9edd12858d0840f1986b8c40b5bac4b8" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 34619 } }
I20260812 01:08:21.434757 27639 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9edd12858d0840f1986b8c40b5bac4b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:08:21.434850 27639 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9edd12858d0840f1986b8c40b5bac4b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9edd12858d0840f1986b8c40b5bac4b8, State: Initialized, Role: FOLLOWER
I20260812 01:08:21.435441 27639 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9edd12858d0840f1986b8c40b5bac4b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9edd12858d0840f1986b8c40b5bac4b8" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 34619 } }
I20260812 01:08:21.435701 27639 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9edd12858d0840f1986b8c40b5bac4b8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:08:21.435837 27639 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9edd12858d0840f1986b8c40b5bac4b8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:08:21.436017 27639 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9edd12858d0840f1986b8c40b5bac4b8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:08:21.437528 27643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:21.417331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54596 (local address 127.4.201.126:34619)
0812 01:08:21.418121 (+ 790us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:21.418132 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:21.418171 (+ 39us) server_negotiation.cc:407] Connection header received
0812 01:08:21.419871 (+ 1700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:21.419896 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:21.420269 (+ 373us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:21.420619 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:21.422134 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:21.423489 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:21.425131 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:21.425829 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:21.426010 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:21.430305 (+ 4295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:21.430314 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:21.430329 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:21.430366 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:21.433472 (+ 3106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:21.434151 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:21.434158 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:21.434165 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:21.434328 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:21.434696 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:21.434699 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:21.434702 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:21.435287 (+ 585us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:21.435592 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:21.436057 (+ 465us) server_negotiation.cc:299] Negotiation successful
0812 01:08:21.436463 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":352,"threads_started":1}
I20260812 01:08:21.438830 27639 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9edd12858d0840f1986b8c40b5bac4b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9edd12858d0840f1986b8c40b5bac4b8" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 34619 } }
I20260812 01:08:21.439323 27639 leader_election.cc:302] T 00000000000000000000000000000000 P 9edd12858d0840f1986b8c40b5bac4b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9edd12858d0840f1986b8c40b5bac4b8; no voters:
I20260812 01:08:21.439913 27639 leader_election.cc:288] T 00000000000000000000000000000000 P 9edd12858d0840f1986b8c40b5bac4b8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:08:21.440013 27647 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9edd12858d0840f1986b8c40b5bac4b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:08:21.441253 27647 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9edd12858d0840f1986b8c40b5bac4b8 [term 1 LEADER]: Becoming Leader. State: Replica: 9edd12858d0840f1986b8c40b5bac4b8, State: Running, Role: LEADER
I20260812 01:08:21.441841 4901 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:08:21.441885 27647 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9edd12858d0840f1986b8c40b5bac4b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9edd12858d0840f1986b8c40b5bac4b8" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 34619 } }
I20260812 01:08:21.442233 27639 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9edd12858d0840f1986b8c40b5bac4b8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:08:21.444485 27651 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9edd12858d0840f1986b8c40b5bac4b8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9edd12858d0840f1986b8c40b5bac4b8. Latest consensus state: current_term: 1 leader_uuid: "9edd12858d0840f1986b8c40b5bac4b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9edd12858d0840f1986b8c40b5bac4b8" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 34619 } } }
I20260812 01:08:21.444849 27651 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9edd12858d0840f1986b8c40b5bac4b8 [sys.catalog]: This master's current role is: LEADER
I20260812 01:08:21.447371 27656 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:08:21.447337 27648 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9edd12858d0840f1986b8c40b5bac4b8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9edd12858d0840f1986b8c40b5bac4b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9edd12858d0840f1986b8c40b5bac4b8" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 34619 } } }
I20260812 01:08:21.447638 27648 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9edd12858d0840f1986b8c40b5bac4b8 [sys.catalog]: This master's current role is: LEADER
I20260812 01:08:21.453070 27656 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:08:21.461488 27656 catalog_manager.cc:1347] Generated new cluster ID: 15ce46b352c44d78b006f4a18be433e4
I20260812 01:08:21.461593 27656 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:08:21.476583 27656 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:08:21.477916 27656 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:08:21.488744 27656 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9edd12858d0840f1986b8c40b5bac4b8: Generated new TSK 0
I20260812 01:08:21.489615 27656 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:08:21.503351 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 27527
I20260812 01:08:21.504534 27631 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:08:21.594784 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 27527
2026-08-12T01:08:21Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2108 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:08:21 dist-test-slave-bndk krb5kdc[27691](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:08:21 dist-test-slave-bndk krb5kdc[27691](info): set up 2 sockets
Aug 12 01:08:21 dist-test-slave-bndk krb5kdc[27691](info): commencing operation
krb5kdc: starting...
W20260812 01:08:22.819690 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.183s user 0.000s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:08:22 dist-test-slave-bndk krb5kdc[27691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496902, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:08:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:08:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.201.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
I20260812 01:08:23.088805 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:45265
--webserver_interface=127.4.201.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:39757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:45265
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:08:23.433923 27712 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:08:23.434213 27712 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:08:23.434351 27712 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:08:23.441463 27712 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:08:23.441576 27712 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:08:23.441655 27712 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:08:23.441733 27712 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:08:23.441797 27712 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:08:23.451376 27712 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:39757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:45265
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:45265
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:08:23.452680 27712 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:08:23.454025 27712 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:08:23.465415 27722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:23.465461 27726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:23.465502 27724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:08:23.466379 27712 server_base.cc:1034] running on GCE node
I20260812 01:08:23.467149 27712 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:08:23.468533 27712 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:08:23.469753 27712 hybrid_clock.cc:648] HybridClock initialized: now 1786496903469716 us; error 45 us; skew 500 ppm
I20260812 01:08:23.470109 27712 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:08:23 dist-test-slave-bndk krb5kdc[27691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496903, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:08:23.473323 27712 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:08:23.474790 27712 webserver.cc:460] Webserver started at http://127.4.201.126:42529/ using document root <none> and password file <none>
I20260812 01:08:23.475453 27712 fs_manager.cc:359] Metadata directory not provided
I20260812 01:08:23.475576 27712 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:08:23.475865 27712 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:08:23.478859 27712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "5a646e194b6a4b18956286a1634c775d"
format_stamp: "Formatted at 2026-08-12 01:08:23 on dist-test-slave-bndk"
server_key: "3a9bacd6cb7f04582508b60c73296fc7"
server_key_iv: "da8906e46d657a8b95315cc5200a63a6"
server_key_version: "encryptionkey@0"
I20260812 01:08:23.479602 27712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "5a646e194b6a4b18956286a1634c775d"
format_stamp: "Formatted at 2026-08-12 01:08:23 on dist-test-slave-bndk"
server_key: "3a9bacd6cb7f04582508b60c73296fc7"
server_key_iv: "da8906e46d657a8b95315cc5200a63a6"
server_key_version: "encryptionkey@0"
I20260812 01:08:23.484545 27712 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260812 01:08:23.487950 27738 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:23.489291 27712 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 01:08:23.489455 27712 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "5a646e194b6a4b18956286a1634c775d"
format_stamp: "Formatted at 2026-08-12 01:08:23 on dist-test-slave-bndk"
server_key: "3a9bacd6cb7f04582508b60c73296fc7"
server_key_iv: "da8906e46d657a8b95315cc5200a63a6"
server_key_version: "encryptionkey@0"
I20260812 01:08:23.489631 27712 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:08:23.505040 27712 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:08:23.508816 27712 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:08:23.509089 27712 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:08:23.526247 27712 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:45265
I20260812 01:08:23.526278 27814 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:45265 every 8 connection(s)
I20260812 01:08:23.527544 27712 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:08:23.531747 27815 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:08:23.531864 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 27712
I20260812 01:08:23.532122 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:08:23.532961 4901 external_mini_cluster.cc:1428] Setting key 10b186fce1552e720f229c26590345ed
I20260812 01:08:23.545135 27815 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d: Bootstrap starting.
I20260812 01:08:23.548988 27815 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d: Neither blocks nor log segments found. Creating new log.
I20260812 01:08:23.550316 27815 log.cc:824] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d: Log is configured to *not* fsync() on all Append() calls
Aug 12 01:08:23 dist-test-slave-bndk krb5kdc[27691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496902, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:08:23.553440 27815 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d: No bootstrap required, opened a new log
I20260812 01:08:23.560607 27815 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a646e194b6a4b18956286a1634c775d" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45265 } }
I20260812 01:08:23.560954 27815 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:08:23.561043 27815 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a646e194b6a4b18956286a1634c775d, State: Initialized, Role: FOLLOWER
I20260812 01:08:23.561646 27815 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a646e194b6a4b18956286a1634c775d" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45265 } }
I20260812 01:08:23.561862 27815 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:08:23.561986 27815 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:08:23.562145 27815 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:08:23.564188 27815 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a646e194b6a4b18956286a1634c775d" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45265 } }
I20260812 01:08:23.564663 27815 leader_election.cc:302] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a646e194b6a4b18956286a1634c775d; no voters:
I20260812 01:08:23.565241 27815 leader_election.cc:288] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:08:23.565363 27827 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:08:23.565974 27827 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [term 1 LEADER]: Becoming Leader. State: Replica: 5a646e194b6a4b18956286a1634c775d, State: Running, Role: LEADER
I20260812 01:08:23.566543 27827 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a646e194b6a4b18956286a1634c775d" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45265 } }
I20260812 01:08:23.567250 27815 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:08:23.569288 27828 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5a646e194b6a4b18956286a1634c775d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a646e194b6a4b18956286a1634c775d" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45265 } } }
I20260812 01:08:23.569727 27828 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [sys.catalog]: This master's current role is: LEADER
I20260812 01:08:23.574517 27830 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5a646e194b6a4b18956286a1634c775d. Latest consensus state: current_term: 1 leader_uuid: "5a646e194b6a4b18956286a1634c775d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a646e194b6a4b18956286a1634c775d" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45265 } } }
I20260812 01:08:23.575353 27830 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [sys.catalog]: This master's current role is: LEADER
I20260812 01:08:23.577346 27824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:23.537614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35708 (local address 127.4.201.126:45265)
0812 01:08:23.538411 (+ 797us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:23.538427 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:23.538476 (+ 49us) server_negotiation.cc:407] Connection header received
0812 01:08:23.540585 (+ 2109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:23.540610 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:23.541009 (+ 399us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:23.541391 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:23.543109 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:23.544436 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:23.546278 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:23.546955 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:23.547116 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:23.552168 (+ 5052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:23.552176 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:23.552191 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:23.552226 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:23.570777 (+ 18551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:23.571887 (+ 1110us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:23.571897 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:23.571907 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:23.572156 (+ 249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:23.572670 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:23.572676 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:23.572679 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:23.573479 (+ 800us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:23.573808 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:23.575397 (+ 1589us) server_negotiation.cc:299] Negotiation successful
0812 01:08:23.575892 (+ 495us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":563,"thread_start_us":345,"threads_started":1}
I20260812 01:08:23.580612 27833 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:08:23.586220 27833 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:08:23.594152 27833 catalog_manager.cc:1347] Generated new cluster ID: d8355cf3ac2f4827a0ed6ad1a3e4f2cd
I20260812 01:08:23.594259 27833 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:08:23.610929 27833 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:08:23.612677 27833 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:08:23.625327 27833 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d: Generated new TSK 0
I20260812 01:08:23.626380 27833 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.201.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
I20260812 01:08:23.698715 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:0
--local_ip_for_outbound_sockets=127.4.201.65
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:45265
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:39757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:08:24.031622 27862 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:08:24.031920 27862 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:08:24.032051 27862 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:08:24.039340 27862 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:08:24.039464 27862 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:08:24.039618 27862 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:08:24.049103 27862 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:39757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:45265
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:08:24.050377 27862 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:08:24.051728 27862 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:08:24.064349 27867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:24.064563 27869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:24.064545 27873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:08:24.065626 27862 server_base.cc:1034] running on GCE node
I20260812 01:08:24.066246 27862 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:08:24.067162 27862 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:08:24.068418 27862 hybrid_clock.cc:648] HybridClock initialized: now 1786496904068360 us; error 43 us; skew 500 ppm
I20260812 01:08:24.068763 27862 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:08:24 dist-test-slave-bndk krb5kdc[27691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496904, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:08:24.071873 27862 init.cc:377] Logged in from keytab as kudu/127.4.201.65@KRBTEST.COM (short username kudu)
I20260812 01:08:24.073345 27862 webserver.cc:460] Webserver started at http://127.4.201.65:40895/ using document root <none> and password file <none>
I20260812 01:08:24.074046 27862 fs_manager.cc:359] Metadata directory not provided
I20260812 01:08:24.074169 27862 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:08:24.074502 27862 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:08:24.077584 27862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/data/instance:
uuid: "caf24535df4048b8a4f8508475c18b8f"
format_stamp: "Formatted at 2026-08-12 01:08:24 on dist-test-slave-bndk"
server_key: "c5fec1faec26c0023f647b111faac504"
server_key_iv: "d3b5c9c17f58677e215e8ce48f0b0728"
server_key_version: "encryptionkey@0"
I20260812 01:08:24.078464 27862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance:
uuid: "caf24535df4048b8a4f8508475c18b8f"
format_stamp: "Formatted at 2026-08-12 01:08:24 on dist-test-slave-bndk"
server_key: "c5fec1faec26c0023f647b111faac504"
server_key_iv: "d3b5c9c17f58677e215e8ce48f0b0728"
server_key_version: "encryptionkey@0"
I20260812 01:08:24.083969 27862 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 01:08:24.087524 27885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:24.088812 27862 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 01:08:24.088970 27862 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "caf24535df4048b8a4f8508475c18b8f"
format_stamp: "Formatted at 2026-08-12 01:08:24 on dist-test-slave-bndk"
server_key: "c5fec1faec26c0023f647b111faac504"
server_key_iv: "d3b5c9c17f58677e215e8ce48f0b0728"
server_key_version: "encryptionkey@0"
I20260812 01:08:24.089151 27862 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:08:24.115429 27862 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:08:24.119249 27862 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:08:24.119536 27862 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:08:24.120500 27862 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:08:24.121881 27862 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:08:24.121961 27862 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:24.122078 27862 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:08:24.122130 27862 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:24.152031 27862 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:40519
I20260812 01:08:24.152099 28090 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:40519 every 8 connection(s)
I20260812 01:08:24.153313 27862 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:08:24.155169 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 27862
I20260812 01:08:24.155375 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance
I20260812 01:08:24.156189 4901 external_mini_cluster.cc:1428] Setting key efd4ebd0c60cea28154e513b3580ef2e
Aug 12 01:08:24 dist-test-slave-bndk krb5kdc[27691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496904, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:08:24.173138 28095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:24.155965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:35001 (local address 127.4.201.126:45265)
0812 01:08:24.156470 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:24.156477 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:24.157537 (+ 1060us) server_negotiation.cc:407] Connection header received
0812 01:08:24.159378 (+ 1841us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:24.159383 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:24.159464 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:24.159578 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:24.161024 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:24.161982 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:24.163493 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:24.164007 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:24.164136 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:24.167405 (+ 3269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:24.167411 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:24.167415 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:24.167452 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:24.170146 (+ 2694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:24.170973 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:24.170977 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:24.170980 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:24.171094 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:24.171553 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:24.171556 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:24.171558 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:24.171803 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:24.171909 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:24.172705 (+ 796us) server_negotiation.cc:299] Negotiation successful
0812 01:08:24.172873 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":238,"threads_started":1}
I20260812 01:08:24.174553 28096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:24.156515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.65:35001)
0812 01:08:24.157369 (+ 854us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:24.157424 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:24.159112 (+ 1688us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:24.159777 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:24.159785 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:24.160301 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:08:24.160853 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:24.160870 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:24.162125 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:24.162129 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:24.163328 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:24.163341 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:24.164222 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:24.164227 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:24.164415 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:24.165051 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:08:24.165073 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:08:24.167199 (+ 2126us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:08:24.170289 (+ 3090us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:24.170300 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:24.170317 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:24.170873 (+ 556us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:24.171189 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:24.171194 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:24.171198 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:24.171456 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:24.171925 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:08:24.171933 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:08:24.172340 (+ 407us) client_negotiation.cc:769] Sending connection context
0812 01:08:24.172631 (+ 291us) client_negotiation.cc:240] Negotiation successful
0812 01:08:24.173199 (+ 568us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":326,"threads_started":1}
I20260812 01:08:24.176095 28092 heartbeater.cc:347] Connected to a master server at 127.4.201.126:45265
I20260812 01:08:24.176379 28092 heartbeater.cc:464] Registering TS with master...
I20260812 01:08:24.177076 28092 heartbeater.cc:511] Master 127.4.201.126:45265 requested a full tablet report, sending...
I20260812 01:08:24.179407 27759 ts_manager.cc:194] Registered new tserver with Master: caf24535df4048b8a4f8508475c18b8f (127.4.201.65:40519)
I20260812 01:08:24.181429 27759 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.65@KRBTEST.COM'} at 127.4.201.65:35001
WARNING: no policy specified for kudu/127.4.201.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
I20260812 01:08:24.217726 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:0
--local_ip_for_outbound_sockets=127.4.201.66
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:45265
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:39757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:08:24.553339 28101 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:08:24.553597 28101 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:08:24.553738 28101 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:08:24.560804 28101 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:08:24.560914 28101 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:08:24.561069 28101 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:08:24.571017 28101 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:39757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:45265
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:08:24.572414 28101 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:08:24.573814 28101 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:08:24.586450 28111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:24.586527 28110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:24.586557 28113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:08:24.587393 28101 server_base.cc:1034] running on GCE node
I20260812 01:08:24.587984 28101 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:08:24.588872 28101 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:08:24.590076 28101 hybrid_clock.cc:648] HybridClock initialized: now 1786496904590027 us; error 39 us; skew 500 ppm
I20260812 01:08:24.590368 28101 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:08:24 dist-test-slave-bndk krb5kdc[27691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496904, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:08:24.593477 28101 init.cc:377] Logged in from keytab as kudu/127.4.201.66@KRBTEST.COM (short username kudu)
I20260812 01:08:24.594995 28101 webserver.cc:460] Webserver started at http://127.4.201.66:43165/ using document root <none> and password file <none>
I20260812 01:08:24.595665 28101 fs_manager.cc:359] Metadata directory not provided
I20260812 01:08:24.595781 28101 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:08:24.596071 28101 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:08:24.599090 28101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/data/instance:
uuid: "d98a4b1da66649e5ba176b2c8f9f5b63"
format_stamp: "Formatted at 2026-08-12 01:08:24 on dist-test-slave-bndk"
server_key: "20051032efe04dc29dc617b6bc7a20c7"
server_key_iv: "b092b3f0fbfa09d280023a19f82efeff"
server_key_version: "encryptionkey@0"
I20260812 01:08:24.599856 28101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance:
uuid: "d98a4b1da66649e5ba176b2c8f9f5b63"
format_stamp: "Formatted at 2026-08-12 01:08:24 on dist-test-slave-bndk"
server_key: "20051032efe04dc29dc617b6bc7a20c7"
server_key_iv: "b092b3f0fbfa09d280023a19f82efeff"
server_key_version: "encryptionkey@0"
I20260812 01:08:24.604887 28101 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260812 01:08:24.608227 28125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:24.609573 28101 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:08:24.609726 28101 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "d98a4b1da66649e5ba176b2c8f9f5b63"
format_stamp: "Formatted at 2026-08-12 01:08:24 on dist-test-slave-bndk"
server_key: "20051032efe04dc29dc617b6bc7a20c7"
server_key_iv: "b092b3f0fbfa09d280023a19f82efeff"
server_key_version: "encryptionkey@0"
I20260812 01:08:24.609922 28101 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:08:24.637303 28101 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:08:24.640973 28101 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:08:24.641254 28101 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:08:24.642161 28101 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:08:24.643443 28101 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:08:24.643528 28101 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:24.643652 28101 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:08:24.643718 28101 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:24.673992 28101 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:44917
I20260812 01:08:24.674024 28318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:44917 every 8 connection(s)
I20260812 01:08:24.675258 28101 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:08:24.680868 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 28101
I20260812 01:08:24.681051 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance
I20260812 01:08:24.681541 4901 external_mini_cluster.cc:1428] Setting key 0a2f3a18c5ca67e8b7ec3d9c96500aed
Aug 12 01:08:24 dist-test-slave-bndk krb5kdc[27691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496904, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:08:24.695242 28322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:24.677861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:57341 (local address 127.4.201.126:45265)
0812 01:08:24.678276 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:24.678281 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:24.679289 (+ 1008us) server_negotiation.cc:407] Connection header received
0812 01:08:24.681098 (+ 1809us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:24.681104 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:24.681188 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:24.681309 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:24.682965 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:24.683856 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:24.685370 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:24.685783 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:24.685894 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:24.689516 (+ 3622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:24.689521 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:24.689524 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:24.689556 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:24.691965 (+ 2409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:24.692887 (+ 922us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:24.692891 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:24.692893 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:24.693025 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:24.693492 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:24.693495 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:24.693497 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:24.693811 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:24.693971 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:24.694750 (+ 779us) server_negotiation.cc:299] Negotiation successful
0812 01:08:24.694975 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":198,"threads_started":1}
I20260812 01:08:24.696421 28323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:24.678435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.66:57341)
0812 01:08:24.679133 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:24.679170 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:24.680822 (+ 1652us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:24.681549 (+ 727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:24.681557 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:24.682129 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:08:24.682787 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:24.682810 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:24.684006 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:24.684010 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:24.685205 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:24.685255 (+ 50us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:24.686004 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:24.686012 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:24.686227 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:24.686842 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:08:24.686864 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:08:24.689294 (+ 2430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:08:24.692119 (+ 2825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:24.692128 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:24.692143 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:24.692723 (+ 580us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:24.693127 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:24.693131 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:24.693134 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:24.693400 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:24.694039 (+ 639us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:08:24.694045 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:08:24.694376 (+ 331us) client_negotiation.cc:769] Sending connection context
0812 01:08:24.694607 (+ 231us) client_negotiation.cc:240] Negotiation successful
0812 01:08:24.695070 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":268,"threads_started":1}
I20260812 01:08:24.697789 28319 heartbeater.cc:347] Connected to a master server at 127.4.201.126:45265
I20260812 01:08:24.698100 28319 heartbeater.cc:464] Registering TS with master...
I20260812 01:08:24.698984 28319 heartbeater.cc:511] Master 127.4.201.126:45265 requested a full tablet report, sending...
I20260812 01:08:24.700539 27759 ts_manager.cc:194] Registered new tserver with Master: d98a4b1da66649e5ba176b2c8f9f5b63 (127.4.201.66:44917)
I20260812 01:08:24.701388 27759 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.66@KRBTEST.COM'} at 127.4.201.66:57341
WARNING: no policy specified for kudu/127.4.201.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
I20260812 01:08:24.742179 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:0
--local_ip_for_outbound_sockets=127.4.201.67
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:45265
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:39757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:08:25.069132 28331 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:08:25.069460 28331 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:08:25.069600 28331 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:08:25.076738 28331 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:08:25.076838 28331 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:08:25.076982 28331 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:08:25.086967 28331 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:39757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:45265
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:08:25.088253 28331 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:08:25.089653 28331 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:08:25.102806 28343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:25.102742 28346 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:25.102845 28340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:08:25.103494 28331 server_base.cc:1034] running on GCE node
I20260812 01:08:25.104085 28331 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:08:25.105012 28331 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:08:25.106240 28331 hybrid_clock.cc:648] HybridClock initialized: now 1786496905106165 us; error 52 us; skew 500 ppm
I20260812 01:08:25.106616 28331 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:08:25 dist-test-slave-bndk krb5kdc[27691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496905, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:08:25.109898 28331 init.cc:377] Logged in from keytab as kudu/127.4.201.67@KRBTEST.COM (short username kudu)
I20260812 01:08:25.111325 28331 webserver.cc:460] Webserver started at http://127.4.201.67:39883/ using document root <none> and password file <none>
I20260812 01:08:25.112025 28331 fs_manager.cc:359] Metadata directory not provided
I20260812 01:08:25.112147 28331 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:08:25.112442 28331 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:08:25.115610 28331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/data/instance:
uuid: "0e7039af958f404d9c846bf53395533d"
format_stamp: "Formatted at 2026-08-12 01:08:25 on dist-test-slave-bndk"
server_key: "c15a70379c8d728cdb5f6f7dbc58a42b"
server_key_iv: "d1f209c1da94d77ff7a8ad05a6242710"
server_key_version: "encryptionkey@0"
I20260812 01:08:25.116364 28331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance:
uuid: "0e7039af958f404d9c846bf53395533d"
format_stamp: "Formatted at 2026-08-12 01:08:25 on dist-test-slave-bndk"
server_key: "c15a70379c8d728cdb5f6f7dbc58a42b"
server_key_iv: "d1f209c1da94d77ff7a8ad05a6242710"
server_key_version: "encryptionkey@0"
I20260812 01:08:25.121609 28331 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260812 01:08:25.125056 28362 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:25.126401 28331 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:08:25.126554 28331 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "0e7039af958f404d9c846bf53395533d"
format_stamp: "Formatted at 2026-08-12 01:08:25 on dist-test-slave-bndk"
server_key: "c15a70379c8d728cdb5f6f7dbc58a42b"
server_key_iv: "d1f209c1da94d77ff7a8ad05a6242710"
server_key_version: "encryptionkey@0"
I20260812 01:08:25.126735 28331 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:08:25.138705 28331 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:08:25.142802 28331 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:08:25.143071 28331 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:08:25.143956 28331 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:08:25.145295 28331 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:08:25.145376 28331 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:25.145499 28331 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:08:25.145557 28331 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:25.176123 28331 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:37335
I20260812 01:08:25.176165 28554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:37335 every 8 connection(s)
I20260812 01:08:25.177500 28331 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:08:25.184461 28092 heartbeater.cc:503] Master 127.4.201.126:45265 was elected leader, sending a full tablet report...
I20260812 01:08:25.187681 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 28331
I20260812 01:08:25.187865 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance
I20260812 01:08:25.188441 4901 external_mini_cluster.cc:1428] Setting key eb705a1db6a758a6f175455796728e01
Aug 12 01:08:25 dist-test-slave-bndk krb5kdc[27691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496905, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:08:25.197753 28322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:25.180043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:50727 (local address 127.4.201.126:45265)
0812 01:08:25.180209 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:25.180214 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:25.181318 (+ 1104us) server_negotiation.cc:407] Connection header received
0812 01:08:25.183304 (+ 1986us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:25.183310 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:25.183405 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:25.183495 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:25.185264 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.186316 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.187865 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.188418 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.188567 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:25.192414 (+ 3847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:25.192419 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:25.192423 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:25.192453 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:25.195046 (+ 2593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:25.195715 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:25.195718 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:25.195721 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:25.195838 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:25.196185 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:25.196188 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:25.196190 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:25.196445 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:25.196585 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:25.197331 (+ 746us) server_negotiation.cc:299] Negotiation successful
0812 01:08:25.197523 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 01:08:25.198733 28560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:25.180424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.67:50727)
0812 01:08:25.181142 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:25.181186 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:25.183026 (+ 1840us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:25.183745 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:25.183753 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:25.184301 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:08:25.185046 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:25.185072 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.186460 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.186464 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:25.187675 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:25.187688 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.188634 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.188640 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:25.188830 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:25.189503 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:08:25.189534 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:08:25.192224 (+ 2690us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:08:25.195186 (+ 2962us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:25.195193 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:25.195206 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:25.195609 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:25.195915 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:25.195918 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:25.195920 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:25.196106 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:25.196544 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:08:25.196550 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:08:25.196890 (+ 340us) client_negotiation.cc:769] Sending connection context
0812 01:08:25.197210 (+ 320us) client_negotiation.cc:240] Negotiation successful
0812 01:08:25.197646 (+ 436us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":275,"threads_started":1}
I20260812 01:08:25.200078 28556 heartbeater.cc:347] Connected to a master server at 127.4.201.126:45265
I20260812 01:08:25.200354 28556 heartbeater.cc:464] Registering TS with master...
I20260812 01:08:25.201061 28556 heartbeater.cc:511] Master 127.4.201.126:45265 requested a full tablet report, sending...
I20260812 01:08:25.202648 27758 ts_manager.cc:194] Registered new tserver with Master: 0e7039af958f404d9c846bf53395533d (127.4.201.67:37335)
I20260812 01:08:25.203660 27758 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.67@KRBTEST.COM'} at 127.4.201.67:50727
I20260812 01:08:25.203727 4901 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:08:25.219691 28322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:25.208244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35716 (local address 127.4.201.126:45265)
0812 01:08:25.208390 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:25.208394 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:25.208864 (+ 470us) server_negotiation.cc:407] Connection header received
0812 01:08:25.209016 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:25.209020 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:25.209098 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:25.209172 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:25.210560 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.211251 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.212476 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.212867 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.212952 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:25.215286 (+ 2334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:25.215291 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:25.215294 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:25.215324 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:25.217571 (+ 2247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:25.218184 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:25.218187 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:25.218189 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:25.218303 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:25.218580 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:25.218583 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:25.218585 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:25.218863 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:25.219050 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:25.219281 (+ 231us) server_negotiation.cc:299] Negotiation successful
0812 01:08:25.219439 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 01:08:25.223400 27758 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35716:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:08:25.230211 27758 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:08:25.265527 28578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:25.242050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53876 (local address 127.4.201.66:44917)
0812 01:08:25.254300 (+ 12250us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:25.254311 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:25.255095 (+ 784us) server_negotiation.cc:407] Connection header received
0812 01:08:25.255570 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:25.255579 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:25.255850 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:25.256062 (+ 212us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:08:25.257122 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.258850 (+ 1728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.261902 (+ 3052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.263483 (+ 1581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.263603 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:25.263815 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:25.264920 (+ 1105us) server_negotiation.cc:299] Negotiation successful
0812 01:08:25.265126 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12033,"thread_start_us":12256,"threads_started":1}
I20260812 01:08:25.266664 28579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:25.241799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:44917 (local address 127.0.0.1:53876)
0812 01:08:25.254914 (+ 13115us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:25.254956 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:25.255356 (+ 400us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:25.256395 (+ 1039us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:25.256403 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:25.256436 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:08:25.256899 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:25.256912 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.259074 (+ 2162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.259080 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:25.261700 (+ 2620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:25.261718 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.264376 (+ 2658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.264383 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:25.264618 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:25.264673 (+ 55us) client_negotiation.cc:769] Sending connection context
0812 01:08:25.266072 (+ 1399us) client_negotiation.cc:240] Negotiation successful
0812 01:08:25.266290 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12827,"thread_start_us":12868,"threads_started":1}
I20260812 01:08:25.268103 28574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:25.242178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:37335 (local address 127.0.0.1:37930)
0812 01:08:25.254969 (+ 12791us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:25.254989 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:25.255203 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:25.259203 (+ 4000us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:25.259209 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:25.259240 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:08:25.259753 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:25.259767 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.262345 (+ 2578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.262351 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:25.264913 (+ 2562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:25.264930 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.267301 (+ 2371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.267309 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:25.267509 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:25.267546 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 01:08:25.267650 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 01:08:25.267773 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12651,"thread_start_us":12942,"threads_started":1}
I20260812 01:08:25.268326 28581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:25.242418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37930 (local address 127.4.201.67:37335)
0812 01:08:25.257689 (+ 15271us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:25.257699 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:25.257737 (+ 38us) server_negotiation.cc:407] Connection header received
0812 01:08:25.257835 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:25.257843 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:25.258706 (+ 863us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:25.258908 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:08:25.260003 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.262134 (+ 2131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.265123 (+ 2989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.266594 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.266720 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:25.266960 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:25.267752 (+ 792us) server_negotiation.cc:299] Negotiation successful
0812 01:08:25.267949 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15072,"thread_start_us":15938,"threads_started":1}
I20260812 01:08:25.272745 28449 tablet_service.cc:1467] Processing CreateTablet for tablet 1930c27a1e69448cbbebc612f7791fe5 (DEFAULT_TABLE table=test-table [id=af6301edc61b4d3994346ffad4ac64fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:08:25.274574 28449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1930c27a1e69448cbbebc612f7791fe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:08:25.274811 28579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:25.255515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:40519 (local address 127.0.0.1:58006)
0812 01:08:25.267229 (+ 11714us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:25.267251 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:25.267367 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:25.268911 (+ 1544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:25.268917 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:25.268948 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:08:25.269128 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:25.269138 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.271034 (+ 1896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.271037 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:25.272385 (+ 1348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:25.272398 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.274125 (+ 1727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.274132 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:25.274330 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:25.274365 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 01:08:25.274436 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 01:08:25.274569 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11595,"thread_start_us":13800,"threads_started":1}
I20260812 01:08:25.275872 28585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:25.255913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58006 (local address 127.4.201.65:40519)
0812 01:08:25.268071 (+ 12158us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:25.268080 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:25.268110 (+ 30us) server_negotiation.cc:407] Connection header received
0812 01:08:25.268207 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:25.268215 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:25.268463 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:25.268904 (+ 441us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:08:25.269366 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.270894 (+ 1528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.272533 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.273936 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.275066 (+ 1130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:25.275306 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:25.275389 (+ 83us) server_negotiation.cc:299] Negotiation successful
0812 01:08:25.275554 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11971,"thread_start_us":12674,"threads_started":1}
I20260812 01:08:25.277014 28199 tablet_service.cc:1467] Processing CreateTablet for tablet 1930c27a1e69448cbbebc612f7791fe5 (DEFAULT_TABLE table=test-table [id=af6301edc61b4d3994346ffad4ac64fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:08:25.278396 28199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1930c27a1e69448cbbebc612f7791fe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:08:25.279568 27967 tablet_service.cc:1467] Processing CreateTablet for tablet 1930c27a1e69448cbbebc612f7791fe5 (DEFAULT_TABLE table=test-table [id=af6301edc61b4d3994346ffad4ac64fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:08:25.280961 27967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1930c27a1e69448cbbebc612f7791fe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:08:25.290051 28587 tablet_bootstrap.cc:492] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d: Bootstrap starting.
I20260812 01:08:25.291831 28590 tablet_bootstrap.cc:492] T 1930c27a1e69448cbbebc612f7791fe5 P d98a4b1da66649e5ba176b2c8f9f5b63: Bootstrap starting.
I20260812 01:08:25.295063 28587 tablet_bootstrap.cc:654] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d: Neither blocks nor log segments found. Creating new log.
I20260812 01:08:25.295109 28591 tablet_bootstrap.cc:492] T 1930c27a1e69448cbbebc612f7791fe5 P caf24535df4048b8a4f8508475c18b8f: Bootstrap starting.
I20260812 01:08:25.295218 28590 tablet_bootstrap.cc:654] T 1930c27a1e69448cbbebc612f7791fe5 P d98a4b1da66649e5ba176b2c8f9f5b63: Neither blocks nor log segments found. Creating new log.
I20260812 01:08:25.296451 28587 log.cc:824] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d: Log is configured to *not* fsync() on all Append() calls
I20260812 01:08:25.296828 28590 log.cc:824] T 1930c27a1e69448cbbebc612f7791fe5 P d98a4b1da66649e5ba176b2c8f9f5b63: Log is configured to *not* fsync() on all Append() calls
I20260812 01:08:25.298666 28591 tablet_bootstrap.cc:654] T 1930c27a1e69448cbbebc612f7791fe5 P caf24535df4048b8a4f8508475c18b8f: Neither blocks nor log segments found. Creating new log.
I20260812 01:08:25.299937 28591 log.cc:824] T 1930c27a1e69448cbbebc612f7791fe5 P caf24535df4048b8a4f8508475c18b8f: Log is configured to *not* fsync() on all Append() calls
I20260812 01:08:25.302747 28590 tablet_bootstrap.cc:492] T 1930c27a1e69448cbbebc612f7791fe5 P d98a4b1da66649e5ba176b2c8f9f5b63: No bootstrap required, opened a new log
I20260812 01:08:25.302999 28590 ts_tablet_manager.cc:1397] T 1930c27a1e69448cbbebc612f7791fe5 P d98a4b1da66649e5ba176b2c8f9f5b63: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260812 01:08:25.303016 28587 tablet_bootstrap.cc:492] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d: No bootstrap required, opened a new log
I20260812 01:08:25.303016 28591 tablet_bootstrap.cc:492] T 1930c27a1e69448cbbebc612f7791fe5 P caf24535df4048b8a4f8508475c18b8f: No bootstrap required, opened a new log
I20260812 01:08:25.303265 28587 ts_tablet_manager.cc:1397] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.006s
I20260812 01:08:25.303265 28591 ts_tablet_manager.cc:1397] T 1930c27a1e69448cbbebc612f7791fe5 P caf24535df4048b8a4f8508475c18b8f: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260812 01:08:25.310550 28590 raft_consensus.cc:348] T 1930c27a1e69448cbbebc612f7791fe5 P d98a4b1da66649e5ba176b2c8f9f5b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d98a4b1da66649e5ba176b2c8f9f5b63" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 44917 } } peers { permanent_uuid: "0e7039af958f404d9c846bf53395533d" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37335 } } peers { permanent_uuid: "caf24535df4048b8a4f8508475c18b8f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 40519 } }
I20260812 01:08:25.310926 28590 raft_consensus.cc:374] T 1930c27a1e69448cbbebc612f7791fe5 P d98a4b1da66649e5ba176b2c8f9f5b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:08:25.311059 28590 raft_consensus.cc:729] T 1930c27a1e69448cbbebc612f7791fe5 P d98a4b1da66649e5ba176b2c8f9f5b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d98a4b1da66649e5ba176b2c8f9f5b63, State: Initialized, Role: FOLLOWER
I20260812 01:08:25.311707 28590 consensus_queue.cc:260] T 1930c27a1e69448cbbebc612f7791fe5 P d98a4b1da66649e5ba176b2c8f9f5b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d98a4b1da66649e5ba176b2c8f9f5b63" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 44917 } } peers { permanent_uuid: "0e7039af958f404d9c846bf53395533d" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37335 } } peers { permanent_uuid: "caf24535df4048b8a4f8508475c18b8f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 40519 } }
I20260812 01:08:25.312819 28319 heartbeater.cc:503] Master 127.4.201.126:45265 was elected leader, sending a full tablet report...
I20260812 01:08:25.313534 28590 ts_tablet_manager.cc:1428] T 1930c27a1e69448cbbebc612f7791fe5 P d98a4b1da66649e5ba176b2c8f9f5b63: Time spent starting tablet: real 0.010s user 0.012s sys 0.000s
I20260812 01:08:25.313704 28587 raft_consensus.cc:348] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d98a4b1da66649e5ba176b2c8f9f5b63" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 44917 } } peers { permanent_uuid: "0e7039af958f404d9c846bf53395533d" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37335 } } peers { permanent_uuid: "caf24535df4048b8a4f8508475c18b8f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 40519 } }
I20260812 01:08:25.314215 28587 raft_consensus.cc:374] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:08:25.314422 28587 raft_consensus.cc:729] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e7039af958f404d9c846bf53395533d, State: Initialized, Role: FOLLOWER
I20260812 01:08:25.314847 28591 raft_consensus.cc:348] T 1930c27a1e69448cbbebc612f7791fe5 P caf24535df4048b8a4f8508475c18b8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d98a4b1da66649e5ba176b2c8f9f5b63" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 44917 } } peers { permanent_uuid: "0e7039af958f404d9c846bf53395533d" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37335 } } peers { permanent_uuid: "caf24535df4048b8a4f8508475c18b8f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 40519 } }
I20260812 01:08:25.315181 28591 raft_consensus.cc:374] T 1930c27a1e69448cbbebc612f7791fe5 P caf24535df4048b8a4f8508475c18b8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:08:25.315084 28587 consensus_queue.cc:260] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d98a4b1da66649e5ba176b2c8f9f5b63" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 44917 } } peers { permanent_uuid: "0e7039af958f404d9c846bf53395533d" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37335 } } peers { permanent_uuid: "caf24535df4048b8a4f8508475c18b8f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 40519 } }
I20260812 01:08:25.315286 28591 raft_consensus.cc:729] T 1930c27a1e69448cbbebc612f7791fe5 P caf24535df4048b8a4f8508475c18b8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caf24535df4048b8a4f8508475c18b8f, State: Initialized, Role: FOLLOWER
I20260812 01:08:25.315869 28591 consensus_queue.cc:260] T 1930c27a1e69448cbbebc612f7791fe5 P caf24535df4048b8a4f8508475c18b8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d98a4b1da66649e5ba176b2c8f9f5b63" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 44917 } } peers { permanent_uuid: "0e7039af958f404d9c846bf53395533d" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37335 } } peers { permanent_uuid: "caf24535df4048b8a4f8508475c18b8f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 40519 } }
I20260812 01:08:25.316922 28587 ts_tablet_manager.cc:1428] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
I20260812 01:08:25.317101 28556 heartbeater.cc:503] Master 127.4.201.126:45265 was elected leader, sending a full tablet report...
I20260812 01:08:25.317649 28591 ts_tablet_manager.cc:1428] T 1930c27a1e69448cbbebc612f7791fe5 P caf24535df4048b8a4f8508475c18b8f: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
W20260812 01:08:25.405591 28094 tablet.cc:2369] T 1930c27a1e69448cbbebc612f7791fe5 P caf24535df4048b8a4f8508475c18b8f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:08:25.427218 28320 tablet.cc:2369] T 1930c27a1e69448cbbebc612f7791fe5 P d98a4b1da66649e5ba176b2c8f9f5b63: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:08:25.429005 28558 tablet.cc:2369] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:08:25.485875 28599 raft_consensus.cc:482] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:08:25.486179 28599 raft_consensus.cc:504] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d98a4b1da66649e5ba176b2c8f9f5b63" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 44917 } } peers { permanent_uuid: "0e7039af958f404d9c846bf53395533d" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37335 } } peers { permanent_uuid: "caf24535df4048b8a4f8508475c18b8f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 40519 } }
I20260812 01:08:25.487866 28599 leader_election.cc:288] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d98a4b1da66649e5ba176b2c8f9f5b63 (127.4.201.66:44917), caf24535df4048b8a4f8508475c18b8f (127.4.201.65:40519)
I20260812 01:08:25.494200 28560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:25.488249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:44917 (local address 127.4.201.67:57717)
0812 01:08:25.488461 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:25.488490 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:25.488621 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:25.489283 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:25.489288 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:25.489319 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:08:25.489531 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:25.489544 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.490756 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.490762 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:25.492142 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:25.492156 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.493409 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.493416 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:25.493606 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:25.493658 (+ 52us) client_negotiation.cc:769] Sending connection context
0812 01:08:25.493767 (+ 109us) client_negotiation.cc:240] Negotiation successful
0812 01:08:25.493924 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260812 01:08:25.494190 28578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:25.488383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:57717 (local address 127.4.201.66:44917)
0812 01:08:25.488615 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:25.488622 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:25.488644 (+ 22us) server_negotiation.cc:407] Connection header received
0812 01:08:25.489003 (+ 359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:25.489010 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:25.489095 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:25.489191 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:08:25.489913 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.490622 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.492295 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.493274 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.493428 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:25.493504 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:25.493809 (+ 305us) server_negotiation.cc:299] Negotiation successful
0812 01:08:25.493935 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 01:08:25.494480 28585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:25.488818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:43263 (local address 127.4.201.65:40519)
0812 01:08:25.489025 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:25.489031 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:25.489499 (+ 468us) server_negotiation.cc:407] Connection header received
0812 01:08:25.489653 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:25.489656 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:25.489711 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:25.489780 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:08:25.490261 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.490957 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.492663 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.493549 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.493730 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:25.493801 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:25.494125 (+ 324us) server_negotiation.cc:299] Negotiation successful
0812 01:08:25.494245 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 01:08:25.494587 28602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:25.488655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:40519 (local address 127.4.201.67:43263)
0812 01:08:25.489402 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:25.489418 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:25.489545 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:25.489802 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:25.489805 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:25.489825 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:08:25.490104 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:25.490111 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.491114 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.491120 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:25.492461 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:25.492482 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.493745 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.493751 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:25.493970 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:25.493996 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 01:08:25.494085 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 01:08:25.494268 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":623,"thread_start_us":388,"threads_started":1}
I20260812 01:08:25.495343 28232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1930c27a1e69448cbbebc612f7791fe5" candidate_uuid: "0e7039af958f404d9c846bf53395533d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d98a4b1da66649e5ba176b2c8f9f5b63" is_pre_election: true
I20260812 01:08:25.495654 28002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1930c27a1e69448cbbebc612f7791fe5" candidate_uuid: "0e7039af958f404d9c846bf53395533d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caf24535df4048b8a4f8508475c18b8f" is_pre_election: true
I20260812 01:08:25.495818 28232 raft_consensus.cc:2454] T 1930c27a1e69448cbbebc612f7791fe5 P d98a4b1da66649e5ba176b2c8f9f5b63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e7039af958f404d9c846bf53395533d in term 0.
I20260812 01:08:25.496126 28002 raft_consensus.cc:2454] T 1930c27a1e69448cbbebc612f7791fe5 P caf24535df4048b8a4f8508475c18b8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e7039af958f404d9c846bf53395533d in term 0.
I20260812 01:08:25.496500 28370 leader_election.cc:302] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e7039af958f404d9c846bf53395533d, d98a4b1da66649e5ba176b2c8f9f5b63; no voters:
I20260812 01:08:25.496866 28599 raft_consensus.cc:2781] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:08:25.497010 28599 raft_consensus.cc:482] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:08:25.497112 28599 raft_consensus.cc:3037] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:08:25.499409 28599 raft_consensus.cc:504] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d98a4b1da66649e5ba176b2c8f9f5b63" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 44917 } } peers { permanent_uuid: "0e7039af958f404d9c846bf53395533d" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37335 } } peers { permanent_uuid: "caf24535df4048b8a4f8508475c18b8f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 40519 } }
I20260812 01:08:25.499998 28599 leader_election.cc:288] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d [CANDIDATE]: Term 1 election: Requested vote from peers d98a4b1da66649e5ba176b2c8f9f5b63 (127.4.201.66:44917), caf24535df4048b8a4f8508475c18b8f (127.4.201.65:40519)
I20260812 01:08:25.500417 28232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1930c27a1e69448cbbebc612f7791fe5" candidate_uuid: "0e7039af958f404d9c846bf53395533d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d98a4b1da66649e5ba176b2c8f9f5b63"
I20260812 01:08:25.500491 28002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1930c27a1e69448cbbebc612f7791fe5" candidate_uuid: "0e7039af958f404d9c846bf53395533d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caf24535df4048b8a4f8508475c18b8f"
I20260812 01:08:25.500615 28232 raft_consensus.cc:3037] T 1930c27a1e69448cbbebc612f7791fe5 P d98a4b1da66649e5ba176b2c8f9f5b63 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:08:25.500679 28002 raft_consensus.cc:3037] T 1930c27a1e69448cbbebc612f7791fe5 P caf24535df4048b8a4f8508475c18b8f [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:08:25.502866 28002 raft_consensus.cc:2454] T 1930c27a1e69448cbbebc612f7791fe5 P caf24535df4048b8a4f8508475c18b8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e7039af958f404d9c846bf53395533d in term 1.
I20260812 01:08:25.502868 28232 raft_consensus.cc:2454] T 1930c27a1e69448cbbebc612f7791fe5 P d98a4b1da66649e5ba176b2c8f9f5b63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e7039af958f404d9c846bf53395533d in term 1.
I20260812 01:08:25.503237 28370 leader_election.cc:302] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e7039af958f404d9c846bf53395533d, d98a4b1da66649e5ba176b2c8f9f5b63; no voters:
I20260812 01:08:25.503515 28599 raft_consensus.cc:2781] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:08:25.503937 28599 raft_consensus.cc:686] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d [term 1 LEADER]: Becoming Leader. State: Replica: 0e7039af958f404d9c846bf53395533d, State: Running, Role: LEADER
I20260812 01:08:25.504408 28599 consensus_queue.cc:237] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d98a4b1da66649e5ba176b2c8f9f5b63" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 44917 } } peers { permanent_uuid: "0e7039af958f404d9c846bf53395533d" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37335 } } peers { permanent_uuid: "caf24535df4048b8a4f8508475c18b8f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 40519 } }
I20260812 01:08:25.509287 27759 catalog_manager.cc:5495] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e7039af958f404d9c846bf53395533d (127.4.201.67). New cstate: current_term: 1 leader_uuid: "0e7039af958f404d9c846bf53395533d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d98a4b1da66649e5ba176b2c8f9f5b63" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 44917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e7039af958f404d9c846bf53395533d" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37335 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "caf24535df4048b8a4f8508475c18b8f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 40519 } health_report { overall_health: UNKNOWN } } }
I20260812 01:08:25.580253 28581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:25.575003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37938 (local address 127.4.201.67:37335)
0812 01:08:25.575205 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:25.575210 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:25.575229 (+ 19us) server_negotiation.cc:407] Connection header received
0812 01:08:25.575337 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:25.575341 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:25.575418 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:25.575546 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:08:25.575947 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.576665 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.578154 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.578551 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.578665 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:25.579156 (+ 491us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:08:25.579646 (+ 490us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:08:25.579785 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:25.579892 (+ 107us) server_negotiation.cc:299] Negotiation successful
0812 01:08:25.579984 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 01:08:25.588475 28232 raft_consensus.cc:1261] T 1930c27a1e69448cbbebc612f7791fe5 P d98a4b1da66649e5ba176b2c8f9f5b63 [term 1 FOLLOWER]: Refusing update from remote peer 0e7039af958f404d9c846bf53395533d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:08:25.588488 28002 raft_consensus.cc:1261] T 1930c27a1e69448cbbebc612f7791fe5 P caf24535df4048b8a4f8508475c18b8f [term 1 FOLLOWER]: Refusing update from remote peer 0e7039af958f404d9c846bf53395533d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:08:25.589375 28605 consensus_queue.cc:1035] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d [LEADER]: Connected to new peer: Peer: permanent_uuid: "caf24535df4048b8a4f8508475c18b8f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 40519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:08:25.589721 28599 consensus_queue.cc:1035] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d98a4b1da66649e5ba176b2c8f9f5b63" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 44917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:08:25.609756 28617 mvcc.cc:205] Tried to move back new op lower bound from 7317491325280178176 to 7317491324949868544. Current Snapshot: MvccSnapshot[applied={T|T < 7317491325280178176}]
I20260812 01:08:25.617385 27757 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35716:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:08:25.617726 27757 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35716:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:08:25.621729 27757 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d: Sending DeleteTablet for 3 replicas of tablet 1930c27a1e69448cbbebc612f7791fe5
I20260812 01:08:25.622984 28199 tablet_service.cc:1514] Processing DeleteTablet for tablet 1930c27a1e69448cbbebc612f7791fe5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:08:25 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:53876
I20260812 01:08:25.622987 28449 tablet_service.cc:1514] Processing DeleteTablet for tablet 1930c27a1e69448cbbebc612f7791fe5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:08:25 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:37930
I20260812 01:08:25.623102 27967 tablet_service.cc:1514] Processing DeleteTablet for tablet 1930c27a1e69448cbbebc612f7791fe5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:08:25 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:58006
I20260812 01:08:25.625262 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 27862
I20260812 01:08:25.635464 28633 tablet_replica.cc:330] T 1930c27a1e69448cbbebc612f7791fe5 P caf24535df4048b8a4f8508475c18b8f: stopping tablet replica
I20260812 01:08:25.635574 28629 tablet_replica.cc:330] T 1930c27a1e69448cbbebc612f7791fe5 P d98a4b1da66649e5ba176b2c8f9f5b63: stopping tablet replica
I20260812 01:08:25.636235 28629 raft_consensus.cc:2229] T 1930c27a1e69448cbbebc612f7791fe5 P d98a4b1da66649e5ba176b2c8f9f5b63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:08:25.636516 28633 raft_consensus.cc:2229] T 1930c27a1e69448cbbebc612f7791fe5 P caf24535df4048b8a4f8508475c18b8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:08:25.636910 28629 raft_consensus.cc:2258] T 1930c27a1e69448cbbebc612f7791fe5 P d98a4b1da66649e5ba176b2c8f9f5b63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:08:25.636941 28633 raft_consensus.cc:2258] T 1930c27a1e69448cbbebc612f7791fe5 P caf24535df4048b8a4f8508475c18b8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:08:25.639477 28629 ts_tablet_manager.cc:1905] T 1930c27a1e69448cbbebc612f7791fe5 P d98a4b1da66649e5ba176b2c8f9f5b63: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:08:25.640116 28631 tablet_replica.cc:330] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d: stopping tablet replica
I20260812 01:08:25.640499 28631 raft_consensus.cc:2229] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:08:25.641136 28631 raft_consensus.cc:2258] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:08:25.643091 28631 ts_tablet_manager.cc:1905] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:08:25.644814 28633 ts_tablet_manager.cc:1905] T 1930c27a1e69448cbbebc612f7791fe5 P caf24535df4048b8a4f8508475c18b8f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:08:25.648422 28629 ts_tablet_manager.cc:1918] T 1930c27a1e69448cbbebc612f7791fe5 P d98a4b1da66649e5ba176b2c8f9f5b63: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:08:25.650285 28631 ts_tablet_manager.cc:1918] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:08:25.650550 28631 log.cc:1196] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/wal/wals/1930c27a1e69448cbbebc612f7791fe5
Aug 12 01:08:25 dist-test-slave-bndk krb5kdc[27691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496902, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.65@KRBTEST.COM
I20260812 01:08:25.651207 28631 ts_tablet_manager.cc:1939] T 1930c27a1e69448cbbebc612f7791fe5 P 0e7039af958f404d9c846bf53395533d: Deleting consensus metadata
I20260812 01:08:25.653263 27739 catalog_manager.cc:4841] TS 0e7039af958f404d9c846bf53395533d (127.4.201.67:37335): tablet 1930c27a1e69448cbbebc612f7791fe5 (table test-table [id=af6301edc61b4d3994346ffad4ac64fa]) successfully deleted
I20260812 01:08:25.653360 28629 log.cc:1196] T 1930c27a1e69448cbbebc612f7791fe5 P d98a4b1da66649e5ba176b2c8f9f5b63: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/wal/wals/1930c27a1e69448cbbebc612f7791fe5
I20260812 01:08:25.653873 28629 ts_tablet_manager.cc:1939] T 1930c27a1e69448cbbebc612f7791fe5 P d98a4b1da66649e5ba176b2c8f9f5b63: Deleting consensus metadata
I20260812 01:08:25.655364 27744 catalog_manager.cc:4841] TS d98a4b1da66649e5ba176b2c8f9f5b63 (127.4.201.66:44917): tablet 1930c27a1e69448cbbebc612f7791fe5 (table test-table [id=af6301edc61b4d3994346ffad4ac64fa]) successfully deleted
I20260812 01:08:25.657665 28633 ts_tablet_manager.cc:1918] T 1930c27a1e69448cbbebc612f7791fe5 P caf24535df4048b8a4f8508475c18b8f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:08:25.657847 28633 log.cc:1196] T 1930c27a1e69448cbbebc612f7791fe5 P caf24535df4048b8a4f8508475c18b8f: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/wal/wals/1930c27a1e69448cbbebc612f7791fe5
I20260812 01:08:25.658371 28633 ts_tablet_manager.cc:1939] T 1930c27a1e69448cbbebc612f7791fe5 P caf24535df4048b8a4f8508475c18b8f: Deleting consensus metadata
I20260812 01:08:25.659909 27744 catalog_manager.cc:4841] TS caf24535df4048b8a4f8508475c18b8f (127.4.201.65:40519): tablet 1930c27a1e69448cbbebc612f7791fe5 (table test-table [id=af6301edc61b4d3994346ffad4ac64fa]) successfully deleted
I20260812 01:08:25.662048 28585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:25.626590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58022 (local address 127.4.201.65:40519)
0812 01:08:25.626791 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:25.626800 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:25.639481 (+ 12681us) server_negotiation.cc:407] Connection header received
0812 01:08:25.639965 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:25.639971 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:25.640061 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:25.640139 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:25.642535 (+ 2396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.643667 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.645626 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.646264 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.646364 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:25.652106 (+ 5742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:25.652124 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:25.652144 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:25.652194 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:25.658461 (+ 6267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:25.659802 (+ 1341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:25.659811 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:25.659814 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:25.659988 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:25.660462 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:25.660467 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:25.660470 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:25.660826 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:25.661127 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:25.661467 (+ 340us) server_negotiation.cc:299] Negotiation successful
0812 01:08:25.661681 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 01:08:25.662734 28070 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:08:25.766235 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 27862
I20260812 01:08:25.794349 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 28101
Aug 12 01:08:25 dist-test-slave-bndk krb5kdc[27691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496902, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.66@KRBTEST.COM
I20260812 01:08:25.811306 28578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:25.795187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53882 (local address 127.4.201.66:44917)
0812 01:08:25.795368 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:25.795373 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:25.795392 (+ 19us) server_negotiation.cc:407] Connection header received
0812 01:08:25.795543 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:25.795548 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:25.795624 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:25.795705 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:25.797284 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.798060 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.799892 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.800268 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.800386 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:25.805670 (+ 5284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:25.805686 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:25.805702 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:25.805736 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:25.808536 (+ 2800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:25.809403 (+ 867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:25.809411 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:25.809414 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:25.809551 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:25.809918 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:25.809921 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:25.809923 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:25.810283 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:25.810553 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:25.810852 (+ 299us) server_negotiation.cc:299] Negotiation successful
0812 01:08:25.811014 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 01:08:25.811995 28311 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:08:25.938234 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 28101
I20260812 01:08:25.961839 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 28331
Aug 12 01:08:25 dist-test-slave-bndk krb5kdc[27691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496902, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.67@KRBTEST.COM
I20260812 01:08:25.981523 28581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:25.966694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37952 (local address 127.4.201.67:37335)
0812 01:08:25.966873 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:25.966879 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:25.966928 (+ 49us) server_negotiation.cc:407] Connection header received
0812 01:08:25.967155 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:25.967159 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:25.967229 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:25.967322 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:25.968712 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.969618 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.970867 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:25.971349 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:25.971473 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:25.975694 (+ 4221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:25.975710 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:25.975728 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:25.975767 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:25.978634 (+ 2867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:25.979302 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:25.979310 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:25.979315 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:25.979476 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:25.979848 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:25.979852 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:25.979854 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:25.980244 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:25.980554 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:25.980897 (+ 343us) server_negotiation.cc:299] Negotiation successful
0812 01:08:25.981129 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 01:08:25.982252 28544 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:08:26.106600 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 28331
I20260812 01:08:26.132033 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 27712
I20260812 01:08:26.133127 27808 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:08:26.241581 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 27712
I20260812 01:08:26.270135 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:45265
--webserver_interface=127.4.201.126
--webserver_port=42529
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:39757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:45265
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:08:26.605311 28644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:08:26.605638 28644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:08:26.605769 28644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:08:26.612926 28644 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:08:26.613041 28644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:08:26.613121 28644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:08:26.613200 28644 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:08:26.613289 28644 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:08:26.622896 28644 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:39757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:45265
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:45265
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=42529
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:08:26.624182 28644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:08:26.625468 28644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:08:26.649411 28656 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:26.649448 28657 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:26.649482 28659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:08:26.650424 28644 server_base.cc:1034] running on GCE node
I20260812 01:08:26.651324 28644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:08:26.652932 28644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:08:26.654156 28644 hybrid_clock.cc:648] HybridClock initialized: now 1786496906654092 us; error 49 us; skew 500 ppm
I20260812 01:08:26.654618 28644 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:08:26 dist-test-slave-bndk krb5kdc[27691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496906, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:08:26.658228 28644 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:08:26.659909 28644 webserver.cc:460] Webserver started at http://127.4.201.126:42529/ using document root <none> and password file <none>
I20260812 01:08:26.660696 28644 fs_manager.cc:359] Metadata directory not provided
I20260812 01:08:26.660827 28644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:08:26.666965 28644 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 01:08:26.670054 28672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:26.671571 28644 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:08:26.671731 28644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "5a646e194b6a4b18956286a1634c775d"
format_stamp: "Formatted at 2026-08-12 01:08:23 on dist-test-slave-bndk"
server_key: "3a9bacd6cb7f04582508b60c73296fc7"
server_key_iv: "da8906e46d657a8b95315cc5200a63a6"
server_key_version: "encryptionkey@0"
I20260812 01:08:26.672789 28644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:08:26.700721 28644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:08:26.705492 28644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:08:26.705752 28644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:08:26.724020 28644 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:45265
I20260812 01:08:26.724037 28751 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:45265 every 8 connection(s)
I20260812 01:08:26.725643 28644 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:08:26.733477 28752 sys_catalog.cc:263] Verifying existing consensus state
I20260812 01:08:26.735693 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 28644
I20260812 01:08:26.736569 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:40519
--local_ip_for_outbound_sockets=127.4.201.65
--tserver_master_addrs=127.4.201.126:45265
--webserver_port=40895
--webserver_interface=127.4.201.65
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:39757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:08:26.737277 28752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d: Bootstrap starting.
I20260812 01:08:26.757321 28752 log.cc:824] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d: Log is configured to *not* fsync() on all Append() calls
I20260812 01:08:26.770229 28752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 01:08:26.770769 28752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d: Bootstrap complete.
I20260812 01:08:26.780450 28752 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a646e194b6a4b18956286a1634c775d" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45265 } }
I20260812 01:08:26.781353 28752 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a646e194b6a4b18956286a1634c775d, State: Initialized, Role: FOLLOWER
I20260812 01:08:26.782027 28752 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a646e194b6a4b18956286a1634c775d" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45265 } }
I20260812 01:08:26.782254 28752 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:08:26.782382 28752 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:08:26.782568 28752 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [term 1 FOLLOWER]: Advancing to term 2
I20260812 01:08:26.786456 28752 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a646e194b6a4b18956286a1634c775d" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45265 } }
I20260812 01:08:26.786971 28752 leader_election.cc:302] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a646e194b6a4b18956286a1634c775d; no voters:
I20260812 01:08:26.787575 28752 leader_election.cc:288] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 01:08:26.787714 28766 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [term 2 FOLLOWER]: Leader election won for term 2
I20260812 01:08:26.788877 28766 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [term 2 LEADER]: Becoming Leader. State: Replica: 5a646e194b6a4b18956286a1634c775d, State: Running, Role: LEADER
I20260812 01:08:26.789492 28766 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a646e194b6a4b18956286a1634c775d" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45265 } }
I20260812 01:08:26.789925 28752 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:08:26.792328 28768 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5a646e194b6a4b18956286a1634c775d. Latest consensus state: current_term: 2 leader_uuid: "5a646e194b6a4b18956286a1634c775d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a646e194b6a4b18956286a1634c775d" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45265 } } }
I20260812 01:08:26.792358 28767 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "5a646e194b6a4b18956286a1634c775d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a646e194b6a4b18956286a1634c775d" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45265 } } }
I20260812 01:08:26.792773 28767 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [sys.catalog]: This master's current role is: LEADER
I20260812 01:08:26.792769 28768 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [sys.catalog]: This master's current role is: LEADER
I20260812 01:08:26.796008 28777 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:08:26.804898 28777 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:08:26.806712 28777 catalog_manager.cc:1259] Loaded cluster ID: d8355cf3ac2f4827a0ed6ad1a3e4f2cd
I20260812 01:08:26.806821 28777 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:08:26.810235 28777 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260812 01:08:26.829618 28777 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260812 01:08:26.839709 28777 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:08:26.841676 28777 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d: Loaded TSK: 0
I20260812 01:08:26.843303 28777 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 01:08:27.109694 28759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:08:27.109987 28759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:08:27.110121 28759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:08:27.117357 28759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:08:27.117477 28759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:08:27.117640 28759 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:08:27.127401 28759 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:39757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:40519
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=40895
--tserver_master_addrs=127.4.201.126:45265
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:08:27.128698 28759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:08:27.130015 28759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:08:27.142758 28808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:27.142750 28804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:27.142920 28812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:08:27.143414 28759 server_base.cc:1034] running on GCE node
I20260812 01:08:27.144176 28759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:08:27.145159 28759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:08:27.146390 28759 hybrid_clock.cc:648] HybridClock initialized: now 1786496907146328 us; error 50 us; skew 500 ppm
I20260812 01:08:27.146685 28759 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:08:27 dist-test-slave-bndk krb5kdc[27691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496907, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:08:27.149932 28759 init.cc:377] Logged in from keytab as kudu/127.4.201.65@KRBTEST.COM (short username kudu)
I20260812 01:08:27.151597 28759 webserver.cc:460] Webserver started at http://127.4.201.65:40895/ using document root <none> and password file <none>
I20260812 01:08:27.152505 28759 fs_manager.cc:359] Metadata directory not provided
I20260812 01:08:27.152668 28759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:08:27.159472 28759 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 01:08:27.162849 28824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:27.164364 28759 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260812 01:08:27.164529 28759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "caf24535df4048b8a4f8508475c18b8f"
format_stamp: "Formatted at 2026-08-12 01:08:24 on dist-test-slave-bndk"
server_key: "c5fec1faec26c0023f647b111faac504"
server_key_iv: "d3b5c9c17f58677e215e8ce48f0b0728"
server_key_version: "encryptionkey@0"
I20260812 01:08:27.165869 28759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:08:27.191581 28759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:08:27.195580 28759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:08:27.195803 28759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:08:27.196720 28759 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:08:27.198132 28759 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:08:27.198218 28759 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:27.198375 28759 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:08:27.198463 28759 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:27.226593 28759 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:40519
I20260812 01:08:27.226660 29025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:40519 every 8 connection(s)
I20260812 01:08:27.227953 28759 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:08:27.234192 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 28759
I20260812 01:08:27.234930 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:44917
--local_ip_for_outbound_sockets=127.4.201.66
--tserver_master_addrs=127.4.201.126:45265
--webserver_port=43165
--webserver_interface=127.4.201.66
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:39757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 01:08:27 dist-test-slave-bndk krb5kdc[27691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496907, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:08:27.251305 29029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:27.230814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.65:51999)
0812 01:08:27.231617 (+ 803us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:27.231663 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:27.233428 (+ 1765us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:27.234789 (+ 1361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:27.234799 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:27.235504 (+ 705us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:08:27.236234 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:27.236259 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:27.237953 (+ 1694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:27.237958 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:27.239633 (+ 1675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:27.239650 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:27.240593 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:27.240601 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:27.240863 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:27.241559 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:08:27.241594 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:08:27.244125 (+ 2531us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:08:27.247472 (+ 3347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:27.247478 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:27.247489 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:27.247887 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:27.248350 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:27.248353 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:27.248355 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:27.248523 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:27.249397 (+ 874us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:08:27.249402 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:08:27.249702 (+ 300us) client_negotiation.cc:769] Sending connection context
0812 01:08:27.249934 (+ 232us) client_negotiation.cc:240] Negotiation successful
0812 01:08:27.250309 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":318,"threads_started":1}
I20260812 01:08:27.251695 29028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:27.230679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:51999 (local address 127.4.201.126:45265)
0812 01:08:27.231260 (+ 581us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:27.231271 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:27.231779 (+ 508us) server_negotiation.cc:407] Connection header received
0812 01:08:27.233919 (+ 2140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:27.233932 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:27.234233 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:27.234562 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:27.236467 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:27.237772 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:27.239758 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:27.240364 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:27.240489 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:27.244458 (+ 3969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:27.244469 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:27.244487 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:27.244535 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:27.247347 (+ 2812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:27.248031 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:27.248040 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:27.248048 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:27.248253 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:27.248616 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:27.248621 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:27.248623 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:27.249257 (+ 634us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:27.249488 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:27.250152 (+ 664us) server_negotiation.cc:299] Negotiation successful
0812 01:08:27.250593 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":255,"threads_started":1}
I20260812 01:08:27.254192 29026 heartbeater.cc:347] Connected to a master server at 127.4.201.126:45265
I20260812 01:08:27.254492 29026 heartbeater.cc:464] Registering TS with master...
I20260812 01:08:27.255182 29026 heartbeater.cc:511] Master 127.4.201.126:45265 requested a full tablet report, sending...
I20260812 01:08:27.257335 28701 ts_manager.cc:194] Registered new tserver with Master: caf24535df4048b8a4f8508475c18b8f (127.4.201.65:40519)
I20260812 01:08:27.258876 28701 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.65@KRBTEST.COM'} at 127.4.201.65:51999
W20260812 01:08:27.569481 29030 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:08:27.569751 29030 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:08:27.569850 29030 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:08:27.576870 29030 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:08:27.576968 29030 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:08:27.577082 29030 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:08:27.586398 29030 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:39757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:44917
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=43165
--tserver_master_addrs=127.4.201.126:45265
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:08:27.587589 29030 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:08:27.588841 29030 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:08:27.601490 29037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:27.601446 29040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:27.601518 29038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:08:27.602629 29030 server_base.cc:1034] running on GCE node
I20260812 01:08:27.603204 29030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:08:27.604146 29030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:08:27.605372 29030 hybrid_clock.cc:648] HybridClock initialized: now 1786496907605323 us; error 36 us; skew 500 ppm
I20260812 01:08:27.605665 29030 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:08:27 dist-test-slave-bndk krb5kdc[27691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496907, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:08:27.608727 29030 init.cc:377] Logged in from keytab as kudu/127.4.201.66@KRBTEST.COM (short username kudu)
I20260812 01:08:27.610062 29030 webserver.cc:460] Webserver started at http://127.4.201.66:43165/ using document root <none> and password file <none>
I20260812 01:08:27.610687 29030 fs_manager.cc:359] Metadata directory not provided
I20260812 01:08:27.610792 29030 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:08:27.615881 29030 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 01:08:27.618386 29048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:27.619654 29030 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:08:27.619798 29030 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "d98a4b1da66649e5ba176b2c8f9f5b63"
format_stamp: "Formatted at 2026-08-12 01:08:24 on dist-test-slave-bndk"
server_key: "20051032efe04dc29dc617b6bc7a20c7"
server_key_iv: "b092b3f0fbfa09d280023a19f82efeff"
server_key_version: "encryptionkey@0"
I20260812 01:08:27.620724 29030 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:08:27.647392 29030 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:08:27.651263 29030 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:08:27.651520 29030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:08:27.652510 29030 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:08:27.653825 29030 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:08:27.653914 29030 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:27.654006 29030 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:08:27.654060 29030 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:27.684504 29030 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:44917
I20260812 01:08:27.684576 29227 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:44917 every 8 connection(s)
I20260812 01:08:27.686026 29030 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:08:27.695426 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 29030
I20260812 01:08:27.696192 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:37335
--local_ip_for_outbound_sockets=127.4.201.67
--tserver_master_addrs=127.4.201.126:45265
--webserver_port=39883
--webserver_interface=127.4.201.67
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:39757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 01:08:27 dist-test-slave-bndk krb5kdc[27691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496907, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:08:27.706188 29028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:27.688433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:34719 (local address 127.4.201.126:45265)
0812 01:08:27.688606 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:27.688611 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:27.689769 (+ 1158us) server_negotiation.cc:407] Connection header received
0812 01:08:27.691808 (+ 2039us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:27.691814 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:27.691900 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:27.691995 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:27.693513 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:27.694533 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:27.696757 (+ 2224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:27.697312 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:27.697432 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:27.700762 (+ 3330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:27.700768 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:27.700771 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:27.700806 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:27.703176 (+ 2370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:27.703861 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:27.703868 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:27.703871 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:27.704002 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:27.704405 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:27.704410 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:27.704413 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:27.704686 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:27.704821 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:27.705621 (+ 800us) server_negotiation.cc:299] Negotiation successful
0812 01:08:27.705855 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 01:08:27.707332 29230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:27.688867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.66:34719)
0812 01:08:27.689610 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:27.689655 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:27.691528 (+ 1873us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:27.692240 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:27.692248 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:27.692754 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:08:27.693344 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:27.693364 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:27.694731 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:27.694738 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:27.696607 (+ 1869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:27.696624 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:27.697536 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:27.697545 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:27.697778 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:27.698428 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:08:27.698451 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:08:27.700548 (+ 2097us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:08:27.703307 (+ 2759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:27.703316 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:27.703332 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:27.703744 (+ 412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:27.704107 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:27.704112 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:27.704116 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:27.704298 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:27.704820 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:08:27.704828 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:08:27.705156 (+ 328us) client_negotiation.cc:769] Sending connection context
0812 01:08:27.705438 (+ 282us) client_negotiation.cc:240] Negotiation successful
0812 01:08:27.705969 (+ 531us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":295,"threads_started":1}
I20260812 01:08:27.708798 29228 heartbeater.cc:347] Connected to a master server at 127.4.201.126:45265
I20260812 01:08:27.709100 29228 heartbeater.cc:464] Registering TS with master...
I20260812 01:08:27.709836 29228 heartbeater.cc:511] Master 127.4.201.126:45265 requested a full tablet report, sending...
I20260812 01:08:27.711256 28701 ts_manager.cc:194] Registered new tserver with Master: d98a4b1da66649e5ba176b2c8f9f5b63 (127.4.201.66:44917)
I20260812 01:08:27.712057 28701 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.66@KRBTEST.COM'} at 127.4.201.66:34719
W20260812 01:08:28.033179 29231 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:08:28.033495 29231 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:08:28.033638 29231 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:08:28.040701 29231 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:08:28.040804 29231 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:08:28.040956 29231 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:08:28.050925 29231 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:39757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:37335
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=39883
--tserver_master_addrs=127.4.201.126:45265
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:08:28.052258 29231 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:08:28.053627 29231 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:08:28.065909 29240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:28.065989 29244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:28.065961 29239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:08:28.067039 29231 server_base.cc:1034] running on GCE node
I20260812 01:08:28.067590 29231 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:08:28.068460 29231 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:08:28.069646 29231 hybrid_clock.cc:648] HybridClock initialized: now 1786496908069590 us; error 48 us; skew 500 ppm
I20260812 01:08:28.069924 29231 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:08:28 dist-test-slave-bndk krb5kdc[27691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496908, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:08:28.073068 29231 init.cc:377] Logged in from keytab as kudu/127.4.201.67@KRBTEST.COM (short username kudu)
I20260812 01:08:28.074445 29231 webserver.cc:460] Webserver started at http://127.4.201.67:39883/ using document root <none> and password file <none>
I20260812 01:08:28.075104 29231 fs_manager.cc:359] Metadata directory not provided
I20260812 01:08:28.075212 29231 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:08:28.080395 29231 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.002s
I20260812 01:08:28.082983 29260 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:28.084254 29231 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 01:08:28.084389 29231 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "0e7039af958f404d9c846bf53395533d"
format_stamp: "Formatted at 2026-08-12 01:08:25 on dist-test-slave-bndk"
server_key: "c15a70379c8d728cdb5f6f7dbc58a42b"
server_key_iv: "d1f209c1da94d77ff7a8ad05a6242710"
server_key_version: "encryptionkey@0"
I20260812 01:08:28.085310 29231 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:08:28.104462 29231 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:08:28.108654 29231 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:08:28.108904 29231 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:08:28.109865 29231 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:08:28.111179 29231 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:08:28.111267 29231 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:28.111390 29231 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:08:28.111455 29231 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:28.139901 29231 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:37335
I20260812 01:08:28.139953 29458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:37335 every 8 connection(s)
I20260812 01:08:28.141356 29231 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:08:28.143466 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 29231
Aug 12 01:08:28 dist-test-slave-bndk krb5kdc[27691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496908, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:08:28.161839 29467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:28.144351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43624 (local address 127.4.201.126:45265)
0812 01:08:28.144826 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:28.144833 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:28.148337 (+ 3504us) server_negotiation.cc:407] Connection header received
0812 01:08:28.148462 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:28.148466 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:28.148541 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:28.148657 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:28.150203 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.150900 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.152540 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.153076 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.153167 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:28.156048 (+ 2881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:28.156055 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:28.156060 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:28.156096 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:28.159205 (+ 3109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:28.159840 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:28.159846 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:28.159848 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:28.159975 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:28.160351 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:28.160356 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:28.160359 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:28.160663 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:28.160891 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:28.161210 (+ 319us) server_negotiation.cc:299] Negotiation successful
0812 01:08:28.161454 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":358,"thread_start_us":240,"threads_started":1}
I20260812 01:08:28.162181 29028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:28.143920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:34123 (local address 127.4.201.126:45265)
0812 01:08:28.144144 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:28.144151 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:28.145486 (+ 1335us) server_negotiation.cc:407] Connection header received
0812 01:08:28.147416 (+ 1930us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:28.147424 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:28.147522 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:28.147646 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:28.149364 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.150088 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.151980 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.152400 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.152527 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:28.156091 (+ 3564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:28.156096 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:28.156099 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:28.156144 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:28.159130 (+ 2986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:28.159859 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:28.159863 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:28.159866 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:28.159996 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:28.160405 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:28.160409 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:28.160414 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:28.160709 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:28.160853 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:28.161717 (+ 864us) server_negotiation.cc:299] Negotiation successful
0812 01:08:28.161869 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":71,"server-negotiator.queue_time_us":73}
I20260812 01:08:28.163396 29469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:28.144414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.67:34123)
0812 01:08:28.145315 (+ 901us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:28.145370 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:28.147081 (+ 1711us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:28.147889 (+ 808us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:28.147898 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:28.148471 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:08:28.149165 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:28.149185 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.150241 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.150245 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:28.151818 (+ 1573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:28.151835 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.152631 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.152639 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:28.152848 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:28.153543 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:08:28.153570 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:08:28.155876 (+ 2306us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:08:28.159258 (+ 3382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:28.159267 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:28.159285 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:28.159727 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:28.160098 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:28.160102 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:28.160104 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:28.160284 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:28.160848 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:08:28.160856 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:08:28.161259 (+ 403us) client_negotiation.cc:769] Sending connection context
0812 01:08:28.161619 (+ 360us) client_negotiation.cc:240] Negotiation successful
0812 01:08:28.162145 (+ 526us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":340,"threads_started":1}
I20260812 01:08:28.164793 29460 heartbeater.cc:347] Connected to a master server at 127.4.201.126:45265
I20260812 01:08:28.165094 29460 heartbeater.cc:464] Registering TS with master...
I20260812 01:08:28.165822 29460 heartbeater.cc:511] Master 127.4.201.126:45265 requested a full tablet report, sending...
I20260812 01:08:28.167238 28699 ts_manager.cc:194] Registered new tserver with Master: 0e7039af958f404d9c846bf53395533d (127.4.201.67:37335)
I20260812 01:08:28.168118 28699 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.67@KRBTEST.COM'} at 127.4.201.67:34123
I20260812 01:08:28.176752 4901 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:08:28.183269 29028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:28.177649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43638 (local address 127.4.201.126:45265)
0812 01:08:28.177841 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:28.177847 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:28.178377 (+ 530us) server_negotiation.cc:407] Connection header received
0812 01:08:28.178565 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:28.178569 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:28.178701 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:28.178813 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:08:28.179187 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.179915 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.181337 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.181785 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.181875 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:28.182332 (+ 457us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:08:28.182815 (+ 483us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:08:28.182928 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:28.182964 (+ 36us) server_negotiation.cc:299] Negotiation successful
0812 01:08:28.183040 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 01:08:28.184162 28699 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:43638:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:08:28.191622 28699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:08:28.214380 29483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:28.204279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:40519 (local address 127.0.0.1:46166)
0812 01:08:28.206212 (+ 1933us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:28.206230 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:28.206349 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:28.207566 (+ 1217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:28.207569 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:28.207592 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:08:28.207985 (+ 393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:28.207997 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.209284 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.209290 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:28.211962 (+ 2672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:28.211978 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.213354 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.213360 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:28.213546 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:28.213600 (+ 54us) client_negotiation.cc:769] Sending connection context
0812 01:08:28.213739 (+ 139us) client_negotiation.cc:240] Negotiation successful
0812 01:08:28.213931 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1821,"mutex_wait_us":252,"thread_start_us":645,"threads_started":1}
I20260812 01:08:28.215082 29488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:28.204789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46166 (local address 127.4.201.65:40519)
0812 01:08:28.205775 (+ 986us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:28.205786 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:28.206702 (+ 916us) server_negotiation.cc:407] Connection header received
0812 01:08:28.206914 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:28.206922 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:28.207165 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:28.207346 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:08:28.208169 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.209137 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.212156 (+ 3019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.213143 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.213298 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:28.213522 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:28.214632 (+ 1110us) server_negotiation.cc:299] Negotiation successful
0812 01:08:28.214788 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":808,"thread_start_us":673,"threads_started":1}
I20260812 01:08:28.214507 29487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:28.203742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:37335 (local address 127.0.0.1:39156)
0812 01:08:28.204860 (+ 1118us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:28.204880 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:28.205018 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:28.207229 (+ 2211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:28.207234 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:28.207263 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:08:28.207673 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:28.207687 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.209837 (+ 2150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.209842 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:28.211930 (+ 2088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:28.211944 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.213725 (+ 1781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.213731 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:28.213909 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:28.213939 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 01:08:28.214030 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 01:08:28.214156 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":972,"mutex_wait_us":42,"thread_start_us":2233,"threads_started":1}
I20260812 01:08:28.214854 29475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:28.202786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:44917 (local address 127.0.0.1:50690)
0812 01:08:28.203632 (+ 846us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:28.203687 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:28.203884 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:28.206821 (+ 2937us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:28.206828 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:28.206859 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:08:28.207373 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:28.207386 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.209671 (+ 2285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.209676 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:28.212146 (+ 2470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:28.212158 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.213964 (+ 1806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.213969 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:28.214132 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:28.214164 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 01:08:28.214245 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 01:08:28.214385 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"mutex_wait_us":264,"thread_start_us":652,"threads_started":1}
I20260812 01:08:28.215651 29486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:28.204105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39156 (local address 127.4.201.67:37335)
0812 01:08:28.206672 (+ 2567us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:28.206680 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:28.206710 (+ 30us) server_negotiation.cc:407] Connection header received
0812 01:08:28.206808 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:28.206815 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:28.207017 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:28.207927 (+ 910us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:08:28.208198 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.209705 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.212090 (+ 2385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.213454 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.213640 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:28.213862 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:28.215005 (+ 1143us) server_negotiation.cc:299] Negotiation successful
0812 01:08:28.215161 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2405,"thread_start_us":2214,"threads_started":1}
I20260812 01:08:28.216900 29482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:28.203185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50690 (local address 127.4.201.66:44917)
0812 01:08:28.206105 (+ 2920us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:28.206113 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:28.206151 (+ 38us) server_negotiation.cc:407] Connection header received
0812 01:08:28.206258 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:28.206266 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:28.206584 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:28.207594 (+ 1010us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:08:28.207876 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.209535 (+ 1659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.212305 (+ 2770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.213720 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.214993 (+ 1273us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:28.215177 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:28.216543 (+ 1366us) server_negotiation.cc:299] Negotiation successful
0812 01:08:28.216686 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2752,"thread_start_us":2623,"threads_started":1}
I20260812 01:08:28.219442 28899 tablet_service.cc:1467] Processing CreateTablet for tablet 2d56deef5d5f4184bbf50c1e2c43fa69 (DEFAULT_TABLE table=test-table [id=1dceb0a39cd843b6b6c633ddbfca1246]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:08:28.219444 29344 tablet_service.cc:1467] Processing CreateTablet for tablet 2d56deef5d5f4184bbf50c1e2c43fa69 (DEFAULT_TABLE table=test-table [id=1dceb0a39cd843b6b6c633ddbfca1246]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:08:28.219678 29130 tablet_service.cc:1467] Processing CreateTablet for tablet 2d56deef5d5f4184bbf50c1e2c43fa69 (DEFAULT_TABLE table=test-table [id=1dceb0a39cd843b6b6c633ddbfca1246]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:08:28.220939 28899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d56deef5d5f4184bbf50c1e2c43fa69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:08:28.220940 29130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d56deef5d5f4184bbf50c1e2c43fa69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:08:28.220939 29344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d56deef5d5f4184bbf50c1e2c43fa69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:08:28.239490 29494 tablet_bootstrap.cc:492] T 2d56deef5d5f4184bbf50c1e2c43fa69 P 0e7039af958f404d9c846bf53395533d: Bootstrap starting.
I20260812 01:08:28.241341 29489 tablet_bootstrap.cc:492] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63: Bootstrap starting.
I20260812 01:08:28.242314 29501 tablet_bootstrap.cc:492] T 2d56deef5d5f4184bbf50c1e2c43fa69 P caf24535df4048b8a4f8508475c18b8f: Bootstrap starting.
I20260812 01:08:28.244100 29494 tablet_bootstrap.cc:654] T 2d56deef5d5f4184bbf50c1e2c43fa69 P 0e7039af958f404d9c846bf53395533d: Neither blocks nor log segments found. Creating new log.
I20260812 01:08:28.244779 29489 tablet_bootstrap.cc:654] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63: Neither blocks nor log segments found. Creating new log.
I20260812 01:08:28.244827 29501 tablet_bootstrap.cc:654] T 2d56deef5d5f4184bbf50c1e2c43fa69 P caf24535df4048b8a4f8508475c18b8f: Neither blocks nor log segments found. Creating new log.
I20260812 01:08:28.245432 29494 log.cc:824] T 2d56deef5d5f4184bbf50c1e2c43fa69 P 0e7039af958f404d9c846bf53395533d: Log is configured to *not* fsync() on all Append() calls
I20260812 01:08:28.245846 29501 log.cc:824] T 2d56deef5d5f4184bbf50c1e2c43fa69 P caf24535df4048b8a4f8508475c18b8f: Log is configured to *not* fsync() on all Append() calls
I20260812 01:08:28.246014 29489 log.cc:824] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63: Log is configured to *not* fsync() on all Append() calls
I20260812 01:08:28.250249 29501 tablet_bootstrap.cc:492] T 2d56deef5d5f4184bbf50c1e2c43fa69 P caf24535df4048b8a4f8508475c18b8f: No bootstrap required, opened a new log
I20260812 01:08:28.250510 29501 ts_tablet_manager.cc:1397] T 2d56deef5d5f4184bbf50c1e2c43fa69 P caf24535df4048b8a4f8508475c18b8f: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260812 01:08:28.251212 29489 tablet_bootstrap.cc:492] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63: No bootstrap required, opened a new log
I20260812 01:08:28.251514 29489 ts_tablet_manager.cc:1397] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20260812 01:08:28.255035 29494 tablet_bootstrap.cc:492] T 2d56deef5d5f4184bbf50c1e2c43fa69 P 0e7039af958f404d9c846bf53395533d: No bootstrap required, opened a new log
I20260812 01:08:28.255311 29494 ts_tablet_manager.cc:1397] T 2d56deef5d5f4184bbf50c1e2c43fa69 P 0e7039af958f404d9c846bf53395533d: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.008s
I20260812 01:08:28.257797 29501 raft_consensus.cc:348] T 2d56deef5d5f4184bbf50c1e2c43fa69 P caf24535df4048b8a4f8508475c18b8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d98a4b1da66649e5ba176b2c8f9f5b63" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 44917 } } peers { permanent_uuid: "caf24535df4048b8a4f8508475c18b8f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 40519 } } peers { permanent_uuid: "0e7039af958f404d9c846bf53395533d" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37335 } }
I20260812 01:08:28.258139 29501 raft_consensus.cc:374] T 2d56deef5d5f4184bbf50c1e2c43fa69 P caf24535df4048b8a4f8508475c18b8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:08:28.258237 29501 raft_consensus.cc:729] T 2d56deef5d5f4184bbf50c1e2c43fa69 P caf24535df4048b8a4f8508475c18b8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caf24535df4048b8a4f8508475c18b8f, State: Initialized, Role: FOLLOWER
I20260812 01:08:28.258809 29501 consensus_queue.cc:260] T 2d56deef5d5f4184bbf50c1e2c43fa69 P caf24535df4048b8a4f8508475c18b8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d98a4b1da66649e5ba176b2c8f9f5b63" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 44917 } } peers { permanent_uuid: "caf24535df4048b8a4f8508475c18b8f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 40519 } } peers { permanent_uuid: "0e7039af958f404d9c846bf53395533d" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37335 } }
I20260812 01:08:28.259842 29026 heartbeater.cc:503] Master 127.4.201.126:45265 was elected leader, sending a full tablet report...
I20260812 01:08:28.260545 29501 ts_tablet_manager.cc:1428] T 2d56deef5d5f4184bbf50c1e2c43fa69 P caf24535df4048b8a4f8508475c18b8f: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20260812 01:08:28.262866 29489 raft_consensus.cc:348] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d98a4b1da66649e5ba176b2c8f9f5b63" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 44917 } } peers { permanent_uuid: "caf24535df4048b8a4f8508475c18b8f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 40519 } } peers { permanent_uuid: "0e7039af958f404d9c846bf53395533d" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37335 } }
I20260812 01:08:28.263270 29489 raft_consensus.cc:374] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:08:28.263362 29489 raft_consensus.cc:729] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d98a4b1da66649e5ba176b2c8f9f5b63, State: Initialized, Role: FOLLOWER
I20260812 01:08:28.263967 29489 consensus_queue.cc:260] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d98a4b1da66649e5ba176b2c8f9f5b63" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 44917 } } peers { permanent_uuid: "caf24535df4048b8a4f8508475c18b8f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 40519 } } peers { permanent_uuid: "0e7039af958f404d9c846bf53395533d" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37335 } }
I20260812 01:08:28.265985 29228 heartbeater.cc:503] Master 127.4.201.126:45265 was elected leader, sending a full tablet report...
I20260812 01:08:28.266065 29494 raft_consensus.cc:348] T 2d56deef5d5f4184bbf50c1e2c43fa69 P 0e7039af958f404d9c846bf53395533d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d98a4b1da66649e5ba176b2c8f9f5b63" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 44917 } } peers { permanent_uuid: "caf24535df4048b8a4f8508475c18b8f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 40519 } } peers { permanent_uuid: "0e7039af958f404d9c846bf53395533d" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37335 } }
I20260812 01:08:28.266490 29494 raft_consensus.cc:374] T 2d56deef5d5f4184bbf50c1e2c43fa69 P 0e7039af958f404d9c846bf53395533d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:08:28.266604 29494 raft_consensus.cc:729] T 2d56deef5d5f4184bbf50c1e2c43fa69 P 0e7039af958f404d9c846bf53395533d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e7039af958f404d9c846bf53395533d, State: Initialized, Role: FOLLOWER
I20260812 01:08:28.266640 29489 ts_tablet_manager.cc:1428] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63: Time spent starting tablet: real 0.015s user 0.004s sys 0.011s
I20260812 01:08:28.267190 29494 consensus_queue.cc:260] T 2d56deef5d5f4184bbf50c1e2c43fa69 P 0e7039af958f404d9c846bf53395533d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d98a4b1da66649e5ba176b2c8f9f5b63" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 44917 } } peers { permanent_uuid: "caf24535df4048b8a4f8508475c18b8f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 40519 } } peers { permanent_uuid: "0e7039af958f404d9c846bf53395533d" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37335 } }
I20260812 01:08:28.268208 29460 heartbeater.cc:503] Master 127.4.201.126:45265 was elected leader, sending a full tablet report...
I20260812 01:08:28.268738 29494 ts_tablet_manager.cc:1428] T 2d56deef5d5f4184bbf50c1e2c43fa69 P 0e7039af958f404d9c846bf53395533d: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20260812 01:08:28.374485 29508 raft_consensus.cc:482] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:08:28.374779 29508 raft_consensus.cc:504] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d98a4b1da66649e5ba176b2c8f9f5b63" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 44917 } } peers { permanent_uuid: "caf24535df4048b8a4f8508475c18b8f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 40519 } } peers { permanent_uuid: "0e7039af958f404d9c846bf53395533d" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37335 } }
I20260812 01:08:28.376490 29508 leader_election.cc:288] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers caf24535df4048b8a4f8508475c18b8f (127.4.201.65:40519), 0e7039af958f404d9c846bf53395533d (127.4.201.67:37335)
I20260812 01:08:28.384483 29486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:28.377063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:50691 (local address 127.4.201.67:37335)
0812 01:08:28.377312 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:28.377320 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:28.377917 (+ 597us) server_negotiation.cc:407] Connection header received
0812 01:08:28.378425 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:28.378429 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:28.378501 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:28.378567 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:08:28.379125 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.380074 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.382413 (+ 2339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.383588 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.383722 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:28.383784 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:28.384095 (+ 311us) server_negotiation.cc:299] Negotiation successful
0812 01:08:28.384219 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 01:08:28.384495 29488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:28.377150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:56263 (local address 127.4.201.65:40519)
0812 01:08:28.377381 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:28.377386 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:28.377974 (+ 588us) server_negotiation.cc:407] Connection header received
0812 01:08:28.378125 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:28.378129 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:28.378193 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:28.378271 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:08:28.378777 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.379770 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.382291 (+ 2521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.383500 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.383662 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:28.383735 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:28.384109 (+ 374us) server_negotiation.cc:299] Negotiation successful
0812 01:08:28.384237 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260812 01:08:28.384660 29510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:28.376896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:40519 (local address 127.4.201.66:56263)
0812 01:08:28.377898 (+ 1002us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:28.377912 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:28.378016 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:28.378296 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:28.378299 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:28.378333 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:08:28.378622 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:28.378633 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.379902 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.379905 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:28.382141 (+ 2236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:28.382157 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.383709 (+ 1552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.383720 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:28.383896 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:28.383958 (+ 62us) client_negotiation.cc:769] Sending connection context
0812 01:08:28.384059 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 01:08:28.384214 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":887,"mutex_wait_us":23,"thread_start_us":512,"threads_started":1}
I20260812 01:08:28.385021 29513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:28.376833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:37335 (local address 127.4.201.66:50691)
0812 01:08:28.377801 (+ 968us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:28.377822 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:28.377995 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:28.378629 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:28.378633 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:28.378662 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:08:28.378981 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:28.378989 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.380200 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.380205 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:28.382282 (+ 2077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:28.382294 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.383771 (+ 1477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.383777 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:28.383957 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:28.383983 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 01:08:28.384060 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 01:08:28.384214 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":819,"mutex_wait_us":53,"thread_start_us":718,"threads_started":1}
I20260812 01:08:28.385689 28946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d56deef5d5f4184bbf50c1e2c43fa69" candidate_uuid: "d98a4b1da66649e5ba176b2c8f9f5b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caf24535df4048b8a4f8508475c18b8f" is_pre_election: true
I20260812 01:08:28.385927 29377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d56deef5d5f4184bbf50c1e2c43fa69" candidate_uuid: "d98a4b1da66649e5ba176b2c8f9f5b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e7039af958f404d9c846bf53395533d" is_pre_election: true
I20260812 01:08:28.386184 28946 raft_consensus.cc:2454] T 2d56deef5d5f4184bbf50c1e2c43fa69 P caf24535df4048b8a4f8508475c18b8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d98a4b1da66649e5ba176b2c8f9f5b63 in term 0.
I20260812 01:08:28.386408 29377 raft_consensus.cc:2454] T 2d56deef5d5f4184bbf50c1e2c43fa69 P 0e7039af958f404d9c846bf53395533d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d98a4b1da66649e5ba176b2c8f9f5b63 in term 0.
I20260812 01:08:28.386816 29053 leader_election.cc:302] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: caf24535df4048b8a4f8508475c18b8f, d98a4b1da66649e5ba176b2c8f9f5b63; no voters:
I20260812 01:08:28.387240 29508 raft_consensus.cc:2781] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:08:28.387365 29508 raft_consensus.cc:482] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:08:28.387458 29508 raft_consensus.cc:3037] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:08:28.389775 29508 raft_consensus.cc:504] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d98a4b1da66649e5ba176b2c8f9f5b63" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 44917 } } peers { permanent_uuid: "caf24535df4048b8a4f8508475c18b8f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 40519 } } peers { permanent_uuid: "0e7039af958f404d9c846bf53395533d" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37335 } }
I20260812 01:08:28.390340 29508 leader_election.cc:288] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63 [CANDIDATE]: Term 1 election: Requested vote from peers caf24535df4048b8a4f8508475c18b8f (127.4.201.65:40519), 0e7039af958f404d9c846bf53395533d (127.4.201.67:37335)
I20260812 01:08:28.390795 28946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d56deef5d5f4184bbf50c1e2c43fa69" candidate_uuid: "d98a4b1da66649e5ba176b2c8f9f5b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caf24535df4048b8a4f8508475c18b8f"
I20260812 01:08:28.390794 29377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d56deef5d5f4184bbf50c1e2c43fa69" candidate_uuid: "d98a4b1da66649e5ba176b2c8f9f5b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e7039af958f404d9c846bf53395533d"
I20260812 01:08:28.390966 28946 raft_consensus.cc:3037] T 2d56deef5d5f4184bbf50c1e2c43fa69 P caf24535df4048b8a4f8508475c18b8f [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:08:28.390971 29377 raft_consensus.cc:3037] T 2d56deef5d5f4184bbf50c1e2c43fa69 P 0e7039af958f404d9c846bf53395533d [term 0 FOLLOWER]: Advancing to term 1
W20260812 01:08:28.392905 29462 tablet.cc:2369] T 2d56deef5d5f4184bbf50c1e2c43fa69 P 0e7039af958f404d9c846bf53395533d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:08:28.393190 29377 raft_consensus.cc:2454] T 2d56deef5d5f4184bbf50c1e2c43fa69 P 0e7039af958f404d9c846bf53395533d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d98a4b1da66649e5ba176b2c8f9f5b63 in term 1.
I20260812 01:08:28.393419 28946 raft_consensus.cc:2454] T 2d56deef5d5f4184bbf50c1e2c43fa69 P caf24535df4048b8a4f8508475c18b8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d98a4b1da66649e5ba176b2c8f9f5b63 in term 1.
I20260812 01:08:28.393618 29050 leader_election.cc:302] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e7039af958f404d9c846bf53395533d, d98a4b1da66649e5ba176b2c8f9f5b63; no voters:
I20260812 01:08:28.393913 29508 raft_consensus.cc:2781] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:08:28.394347 29508 raft_consensus.cc:686] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63 [term 1 LEADER]: Becoming Leader. State: Replica: d98a4b1da66649e5ba176b2c8f9f5b63, State: Running, Role: LEADER
I20260812 01:08:28.394788 29508 consensus_queue.cc:237] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d98a4b1da66649e5ba176b2c8f9f5b63" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 44917 } } peers { permanent_uuid: "caf24535df4048b8a4f8508475c18b8f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 40519 } } peers { permanent_uuid: "0e7039af958f404d9c846bf53395533d" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37335 } }
I20260812 01:08:28.399678 28699 catalog_manager.cc:5495] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63 reported cstate change: term changed from 0 to 1, leader changed from <none> to d98a4b1da66649e5ba176b2c8f9f5b63 (127.4.201.66). New cstate: current_term: 1 leader_uuid: "d98a4b1da66649e5ba176b2c8f9f5b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d98a4b1da66649e5ba176b2c8f9f5b63" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 44917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "caf24535df4048b8a4f8508475c18b8f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 40519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e7039af958f404d9c846bf53395533d" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37335 } health_report { overall_health: UNKNOWN } } }
W20260812 01:08:28.437938 29229 tablet.cc:2369] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:08:28.459424 29482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:28.454553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50696 (local address 127.4.201.66:44917)
0812 01:08:28.454742 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:28.454747 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:28.454805 (+ 58us) server_negotiation.cc:407] Connection header received
0812 01:08:28.454992 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:28.454997 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:28.455077 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:28.455202 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:08:28.455522 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.456218 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.457584 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.457999 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.458089 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:28.458507 (+ 418us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:08:28.459004 (+ 497us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:08:28.459112 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:28.459152 (+ 40us) server_negotiation.cc:299] Negotiation successful
0812 01:08:28.459214 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 01:08:28.467810 29377 raft_consensus.cc:1261] T 2d56deef5d5f4184bbf50c1e2c43fa69 P 0e7039af958f404d9c846bf53395533d [term 1 FOLLOWER]: Refusing update from remote peer d98a4b1da66649e5ba176b2c8f9f5b63: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:08:28.467835 28946 raft_consensus.cc:1261] T 2d56deef5d5f4184bbf50c1e2c43fa69 P caf24535df4048b8a4f8508475c18b8f [term 1 FOLLOWER]: Refusing update from remote peer d98a4b1da66649e5ba176b2c8f9f5b63: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:08:28.468761 29516 consensus_queue.cc:1035] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e7039af958f404d9c846bf53395533d" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:08:28.469113 29508 consensus_queue.cc:1035] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caf24535df4048b8a4f8508475c18b8f" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 40519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 01:08:28.480247 29027 tablet.cc:2369] T 2d56deef5d5f4184bbf50c1e2c43fa69 P caf24535df4048b8a4f8508475c18b8f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:08:28.498849 28701 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:43638:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:08:28.499145 28701 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:43638:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:08:28.502729 28701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d: Sending DeleteTablet for 3 replicas of tablet 2d56deef5d5f4184bbf50c1e2c43fa69
I20260812 01:08:28.503990 28899 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d56deef5d5f4184bbf50c1e2c43fa69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:08:28 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:46166
I20260812 01:08:28.504006 29344 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d56deef5d5f4184bbf50c1e2c43fa69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:08:28 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:39156
I20260812 01:08:28.504226 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 28759
I20260812 01:08:28.504766 29130 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d56deef5d5f4184bbf50c1e2c43fa69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:08:28 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:50690
I20260812 01:08:28.505100 29537 tablet_replica.cc:330] T 2d56deef5d5f4184bbf50c1e2c43fa69 P caf24535df4048b8a4f8508475c18b8f: stopping tablet replica
I20260812 01:08:28.505654 29537 raft_consensus.cc:2229] T 2d56deef5d5f4184bbf50c1e2c43fa69 P caf24535df4048b8a4f8508475c18b8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:08:28.506323 29537 raft_consensus.cc:2258] T 2d56deef5d5f4184bbf50c1e2c43fa69 P caf24535df4048b8a4f8508475c18b8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:08:28.508497 29537 ts_tablet_manager.cc:1905] T 2d56deef5d5f4184bbf50c1e2c43fa69 P caf24535df4048b8a4f8508475c18b8f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:08:28.515190 29540 tablet_replica.cc:330] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63: stopping tablet replica
I20260812 01:08:28.515430 29537 ts_tablet_manager.cc:1918] T 2d56deef5d5f4184bbf50c1e2c43fa69 P caf24535df4048b8a4f8508475c18b8f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:08:28.515601 29537 log.cc:1196] T 2d56deef5d5f4184bbf50c1e2c43fa69 P caf24535df4048b8a4f8508475c18b8f: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/wal/wals/2d56deef5d5f4184bbf50c1e2c43fa69
I20260812 01:08:28.515566 29540 raft_consensus.cc:2229] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63 [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:08:28.516207 29537 ts_tablet_manager.cc:1939] T 2d56deef5d5f4184bbf50c1e2c43fa69 P caf24535df4048b8a4f8508475c18b8f: Deleting consensus metadata
I20260812 01:08:28.516239 29540 raft_consensus.cc:2258] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:08:28.518175 28679 catalog_manager.cc:4841] TS caf24535df4048b8a4f8508475c18b8f (127.4.201.65:40519): tablet 2d56deef5d5f4184bbf50c1e2c43fa69 (table test-table [id=1dceb0a39cd843b6b6c633ddbfca1246]) successfully deleted
I20260812 01:08:28.518884 29540 ts_tablet_manager.cc:1905] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:08:28.519379 29539 tablet_replica.cc:330] T 2d56deef5d5f4184bbf50c1e2c43fa69 P 0e7039af958f404d9c846bf53395533d: stopping tablet replica
I20260812 01:08:28.519815 29539 raft_consensus.cc:2229] T 2d56deef5d5f4184bbf50c1e2c43fa69 P 0e7039af958f404d9c846bf53395533d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:08:28.520319 29539 raft_consensus.cc:2258] T 2d56deef5d5f4184bbf50c1e2c43fa69 P 0e7039af958f404d9c846bf53395533d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:08:28.522451 29539 ts_tablet_manager.cc:1905] T 2d56deef5d5f4184bbf50c1e2c43fa69 P 0e7039af958f404d9c846bf53395533d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:08:28.523342 29488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:28.505336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46170 (local address 127.4.201.65:40519)
0812 01:08:28.505536 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:28.505543 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:28.505564 (+ 21us) server_negotiation.cc:407] Connection header received
0812 01:08:28.505628 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:28.505634 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:28.505747 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:28.505865 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:28.507738 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.508817 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.510724 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.511334 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.511449 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:28.515046 (+ 3597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:28.515065 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:28.515085 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:28.515127 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:28.519238 (+ 4111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:28.520373 (+ 1135us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:28.520382 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:28.520438 (+ 56us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:28.520600 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:28.521083 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:28.521089 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:28.521092 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:28.521593 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:28.521891 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:28.522755 (+ 864us) server_negotiation.cc:299] Negotiation successful
0812 01:08:28.522998 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 01:08:28.524705 29016 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:08:28.530334 29540 ts_tablet_manager.cc:1918] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:08:28.530509 29539 ts_tablet_manager.cc:1918] T 2d56deef5d5f4184bbf50c1e2c43fa69 P 0e7039af958f404d9c846bf53395533d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:08:28.530536 29540 log.cc:1196] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/wal/wals/2d56deef5d5f4184bbf50c1e2c43fa69
I20260812 01:08:28.530661 29539 log.cc:1196] T 2d56deef5d5f4184bbf50c1e2c43fa69 P 0e7039af958f404d9c846bf53395533d: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/wal/wals/2d56deef5d5f4184bbf50c1e2c43fa69
I20260812 01:08:28.531118 29540 ts_tablet_manager.cc:1939] T 2d56deef5d5f4184bbf50c1e2c43fa69 P d98a4b1da66649e5ba176b2c8f9f5b63: Deleting consensus metadata
I20260812 01:08:28.531170 29539 ts_tablet_manager.cc:1939] T 2d56deef5d5f4184bbf50c1e2c43fa69 P 0e7039af958f404d9c846bf53395533d: Deleting consensus metadata
I20260812 01:08:28.532832 28679 catalog_manager.cc:4841] TS d98a4b1da66649e5ba176b2c8f9f5b63 (127.4.201.66:44917): tablet 2d56deef5d5f4184bbf50c1e2c43fa69 (table test-table [id=1dceb0a39cd843b6b6c633ddbfca1246]) successfully deleted
I20260812 01:08:28.532858 28674 catalog_manager.cc:4841] TS 0e7039af958f404d9c846bf53395533d (127.4.201.67:37335): tablet 2d56deef5d5f4184bbf50c1e2c43fa69 (table test-table [id=1dceb0a39cd843b6b6c633ddbfca1246]) successfully deleted
I20260812 01:08:28.665071 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 28759
I20260812 01:08:28.696470 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 29030
I20260812 01:08:28.716987 29482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:28.697370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50706 (local address 127.4.201.66:44917)
0812 01:08:28.697598 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:28.697605 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:28.697687 (+ 82us) server_negotiation.cc:407] Connection header received
0812 01:08:28.697885 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:28.697891 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:28.697974 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:28.698080 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:28.699814 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.701066 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.702885 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.703590 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.703727 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:28.710016 (+ 6289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:28.710031 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:28.710050 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:28.710102 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:28.714046 (+ 3944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:28.714733 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:28.714743 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:28.714747 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:28.714918 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:28.715251 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:28.715256 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:28.715260 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:28.715754 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:28.716054 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:28.716371 (+ 317us) server_negotiation.cc:299] Negotiation successful
0812 01:08:28.716608 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260812 01:08:28.717836 29222 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:08:28.838598 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 29030
I20260812 01:08:28.868024 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 29231
I20260812 01:08:28.880633 29486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:28.868786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39172 (local address 127.4.201.67:37335)
0812 01:08:28.868970 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:28.868977 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:28.868997 (+ 20us) server_negotiation.cc:407] Connection header received
0812 01:08:28.869150 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:28.869154 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:28.869253 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:28.869344 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:28.870705 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.871404 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.872738 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:28.873108 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:28.873192 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:28.875805 (+ 2613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:28.875820 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:28.875838 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:28.875874 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:28.878412 (+ 2538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:28.879014 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:28.879020 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:28.879023 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:28.879145 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:28.879420 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:28.879422 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:28.879424 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:28.879782 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:28.880005 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:28.880175 (+ 170us) server_negotiation.cc:299] Negotiation successful
0812 01:08:28.880332 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 01:08:28.881268 29448 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:08:28.967233 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 29231
I20260812 01:08:28.989408 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 28644
I20260812 01:08:28.990573 28746 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:08:29.102947 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 28644
I20260812 01:08:29.134796 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:45265
--webserver_interface=127.4.201.126
--webserver_port=42529
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:39757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:45265
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:08:29.474159 29547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:08:29.474493 29547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:08:29.474726 29547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:08:29.481921 29547 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:08:29.482026 29547 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:08:29.482097 29547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:08:29.482178 29547 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:08:29.482241 29547 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:08:29.491935 29547 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:39757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:45265
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:45265
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=42529
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:08:29.493273 29547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:08:29.494617 29547 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:08:29.505956 29559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:29.506012 29556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:29.506014 29557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:08:29.507201 29547 server_base.cc:1034] running on GCE node
I20260812 01:08:29.508000 29547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:08:29.509477 29547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:08:29.510692 29547 hybrid_clock.cc:648] HybridClock initialized: now 1786496909510634 us; error 46 us; skew 500 ppm
I20260812 01:08:29.511049 29547 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:08:29 dist-test-slave-bndk krb5kdc[27691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496909, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:08:29.514151 29547 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:08:29.515641 29547 webserver.cc:460] Webserver started at http://127.4.201.126:42529/ using document root <none> and password file <none>
I20260812 01:08:29.516363 29547 fs_manager.cc:359] Metadata directory not provided
I20260812 01:08:29.516496 29547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:08:29.522195 29547 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 01:08:29.524871 29566 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:29.526142 29547 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 01:08:29.526292 29547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "5a646e194b6a4b18956286a1634c775d"
format_stamp: "Formatted at 2026-08-12 01:08:23 on dist-test-slave-bndk"
server_key: "3a9bacd6cb7f04582508b60c73296fc7"
server_key_iv: "da8906e46d657a8b95315cc5200a63a6"
server_key_version: "encryptionkey@0"
I20260812 01:08:29.527230 29547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:08:29.549428 29547 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:08:29.553447 29547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:08:29.553689 29547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:08:29.571271 29547 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:45265
I20260812 01:08:29.571303 29645 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:45265 every 8 connection(s)
I20260812 01:08:29.572822 29547 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:08:29.579526 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 29547
I20260812 01:08:29.579581 29646 sys_catalog.cc:263] Verifying existing consensus state
I20260812 01:08:29.580327 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:40519
--local_ip_for_outbound_sockets=127.4.201.65
--tserver_master_addrs=127.4.201.126:45265
--webserver_port=40895
--webserver_interface=127.4.201.65
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:39757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:08:29.582878 29646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d: Bootstrap starting.
I20260812 01:08:29.602770 29646 log.cc:824] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d: Log is configured to *not* fsync() on all Append() calls
I20260812 01:08:29.619213 29646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 01:08:29.619727 29646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d: Bootstrap complete.
I20260812 01:08:29.628692 29646 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a646e194b6a4b18956286a1634c775d" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45265 } }
I20260812 01:08:29.629642 29646 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a646e194b6a4b18956286a1634c775d, State: Initialized, Role: FOLLOWER
I20260812 01:08:29.630285 29646 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a646e194b6a4b18956286a1634c775d" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45265 } }
I20260812 01:08:29.630509 29646 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:08:29.630685 29646 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:08:29.630852 29646 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [term 2 FOLLOWER]: Advancing to term 3
I20260812 01:08:29.634719 29646 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a646e194b6a4b18956286a1634c775d" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45265 } }
I20260812 01:08:29.635186 29646 leader_election.cc:302] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a646e194b6a4b18956286a1634c775d; no voters:
I20260812 01:08:29.635856 29646 leader_election.cc:288] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 01:08:29.635993 29652 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [term 3 FOLLOWER]: Leader election won for term 3
I20260812 01:08:29.637203 29652 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [term 3 LEADER]: Becoming Leader. State: Replica: 5a646e194b6a4b18956286a1634c775d, State: Running, Role: LEADER
I20260812 01:08:29.637848 29652 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a646e194b6a4b18956286a1634c775d" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45265 } }
I20260812 01:08:29.638262 29646 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:08:29.640460 29655 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5a646e194b6a4b18956286a1634c775d. Latest consensus state: current_term: 3 leader_uuid: "5a646e194b6a4b18956286a1634c775d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a646e194b6a4b18956286a1634c775d" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45265 } } }
I20260812 01:08:29.640796 29655 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [sys.catalog]: This master's current role is: LEADER
I20260812 01:08:29.640996 29654 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "5a646e194b6a4b18956286a1634c775d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a646e194b6a4b18956286a1634c775d" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45265 } } }
I20260812 01:08:29.641363 29654 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a646e194b6a4b18956286a1634c775d [sys.catalog]: This master's current role is: LEADER
I20260812 01:08:29.651059 29660 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:08:29.660755 29660 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:08:29.662346 29660 catalog_manager.cc:1259] Loaded cluster ID: d8355cf3ac2f4827a0ed6ad1a3e4f2cd
I20260812 01:08:29.662518 29660 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260812 01:08:29.664942 29660 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f3232aa69ad google::LogMessage::Fail() at ??:0
@ 0x7f3232aa988a google::LogMessage::SendToLog() at ??:0
@ 0x7f3232aa64de google::LogMessage::Flush() at ??:0
@ 0x7f3232aa7a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f32484d9512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f32484d6976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f324855e610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f324855e439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f32356f2345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f32356f591c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f32356f5799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
I20260812 01:08:29.741755 29691 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
@ 0x7f32356d0eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f32389aa6db start_thread at ??:0
@ 0x7f323194061f clone at ??:0
W20260812 01:08:29.955044 29649 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:08:29.955334 29649 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:08:29.955484 29649 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:08:29.962963 29649 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:08:29.963095 29649 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:08:29.963248 29649 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:08:29.976058 29649 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:39757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:40519
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=40895
--tserver_master_addrs=127.4.201.126:45265
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:08:29.977813 29649 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:08:29.979676 29649 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:08:29.994975 29718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:29.995234 29717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:29.995138 29722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:08:29.995774 29649 server_base.cc:1034] running on GCE node
I20260812 01:08:29.996390 29649 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:08:29.997375 29649 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:08:29.998579 29649 hybrid_clock.cc:648] HybridClock initialized: now 1786496909998526 us; error 44 us; skew 500 ppm
I20260812 01:08:29.998873 29649 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:08:30 dist-test-slave-bndk krb5kdc[27691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496910, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:08:30.002058 29649 init.cc:377] Logged in from keytab as kudu/127.4.201.65@KRBTEST.COM (short username kudu)
I20260812 01:08:30.003432 29649 webserver.cc:460] Webserver started at http://127.4.201.65:40895/ using document root <none> and password file <none>
I20260812 01:08:30.004128 29649 fs_manager.cc:359] Metadata directory not provided
I20260812 01:08:30.004231 29649 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:08:30.009609 29649 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260812 01:08:30.012236 29734 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:30.013561 29649 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:08:30.013707 29649 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "caf24535df4048b8a4f8508475c18b8f"
format_stamp: "Formatted at 2026-08-12 01:08:24 on dist-test-slave-bndk"
server_key: "c5fec1faec26c0023f647b111faac504"
server_key_iv: "d3b5c9c17f58677e215e8ce48f0b0728"
server_key_version: "encryptionkey@0"
I20260812 01:08:30.014662 29649 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:08:30.038727 29649 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:08:30.042465 29649 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:08:30.042711 29649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:08:30.043660 29649 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:08:30.044965 29649 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:08:30.045071 29649 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:30.045176 29649 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:08:30.045287 29649 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260812 01:08:30.077683 29649 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:40519
I20260812 01:08:30.077801 29901 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:40519 every 8 connection(s)
I20260812 01:08:30.079137 29649 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:08:30.083134 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 29649
I20260812 01:08:30.083770 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:44917
--local_ip_for_outbound_sockets=127.4.201.66
--tserver_master_addrs=127.4.201.126:45265
--webserver_port=43165
--webserver_interface=127.4.201.66
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:39757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:08:30.084057 29905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:30.082097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.65:33127)
0812 01:08:30.082852 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:30.083127 (+ 275us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":284,"threads_started":1}
W20260812 01:08:30.084690 29903 heartbeater.cc:644] Failed to heartbeat to 127.4.201.126:45265 (0 consecutive failures): Network error: Failed to ping master at 127.4.201.126:45265: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
I20260812 01:08:30.085515 29905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:30.085177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.65:44865)
0812 01:08:30.085338 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:30.085411 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260812 01:08:30.086330 29905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:30.086016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.65:58919)
0812 01:08:30.086148 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:30.086225 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260812 01:08:30.086571 29903 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 01:08:30.423630 29907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:08:30.423903 29907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:08:30.423996 29907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:08:30.431100 29907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:08:30.431203 29907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:08:30.431342 29907 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:08:30.440714 29907 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:39757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:44917
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=43165
--tserver_master_addrs=127.4.201.126:45265
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:08:30.441972 29907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:08:30.443229 29907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:08:30.456187 29917 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:30.456141 29920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:30.456202 29918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:08:30.457024 29907 server_base.cc:1034] running on GCE node
I20260812 01:08:30.457623 29907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:08:30.458467 29907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:08:30.459671 29907 hybrid_clock.cc:648] HybridClock initialized: now 1786496910459617 us; error 40 us; skew 500 ppm
I20260812 01:08:30.459966 29907 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:08:30 dist-test-slave-bndk krb5kdc[27691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496910, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:08:30.462913 29907 init.cc:377] Logged in from keytab as kudu/127.4.201.66@KRBTEST.COM (short username kudu)
I20260812 01:08:30.464253 29907 webserver.cc:460] Webserver started at http://127.4.201.66:43165/ using document root <none> and password file <none>
I20260812 01:08:30.464912 29907 fs_manager.cc:359] Metadata directory not provided
I20260812 01:08:30.465030 29907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:08:30.470369 29907 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260812 01:08:30.472921 29929 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:30.474159 29907 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 01:08:30.474311 29907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "d98a4b1da66649e5ba176b2c8f9f5b63"
format_stamp: "Formatted at 2026-08-12 01:08:24 on dist-test-slave-bndk"
server_key: "20051032efe04dc29dc617b6bc7a20c7"
server_key_iv: "b092b3f0fbfa09d280023a19f82efeff"
server_key_version: "encryptionkey@0"
I20260812 01:08:30.475243 29907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:08:30.494243 29907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:08:30.497951 29907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:08:30.498202 29907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:08:30.499178 29907 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:08:30.500509 29907 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:08:30.500614 29907 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:30.500730 29907 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:08:30.500808 29907 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:30.531260 29907 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:44917
I20260812 01:08:30.531339 30105 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:44917 every 8 connection(s)
I20260812 01:08:30.532720 29907 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:08:30.537585 30111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:30.535674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.66:57719)
0812 01:08:30.536401 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:30.536678 (+ 277us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":258,"threads_started":1}
W20260812 01:08:30.538196 30106 heartbeater.cc:644] Failed to heartbeat to 127.4.201.126:45265 (0 consecutive failures): Network error: Failed to ping master at 127.4.201.126:45265: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
I20260812 01:08:30.538987 30111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:30.538684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.66:58703)
0812 01:08:30.538815 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:30.538884 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260812 01:08:30.539736 30111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:30.539438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.66:39225)
0812 01:08:30.539558 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:30.539629 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260812 01:08:30.539968 30106 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 01:08:30.541438 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 29907
I20260812 01:08:30.542017 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:37335
--local_ip_for_outbound_sockets=127.4.201.67
--tserver_master_addrs=127.4.201.126:45265
--webserver_port=39883
--webserver_interface=127.4.201.67
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:39757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:08:30.868261 30112 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:08:30.868553 30112 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:08:30.868693 30112 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:08:30.875763 30112 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:08:30.875877 30112 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:08:30.876026 30112 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:08:30.885421 30112 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:39757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:37335
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=39883
--tserver_master_addrs=127.4.201.126:45265
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:08:30.886618 30112 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:08:30.887882 30112 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:08:30.900422 30123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:30.900544 30122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:30.901000 30126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:08:30.901083 30112 server_base.cc:1034] running on GCE node
I20260812 01:08:30.901750 30112 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:08:30.902645 30112 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:08:30.903841 30112 hybrid_clock.cc:648] HybridClock initialized: now 1786496910903781 us; error 48 us; skew 500 ppm
I20260812 01:08:30.904151 30112 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:08:30 dist-test-slave-bndk krb5kdc[27691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496910, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:08:30.907320 30112 init.cc:377] Logged in from keytab as kudu/127.4.201.67@KRBTEST.COM (short username kudu)
I20260812 01:08:30.908644 30112 webserver.cc:460] Webserver started at http://127.4.201.67:39883/ using document root <none> and password file <none>
I20260812 01:08:30.909348 30112 fs_manager.cc:359] Metadata directory not provided
I20260812 01:08:30.909461 30112 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:08:30.914434 30112 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260812 01:08:30.916913 30136 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:30.918224 30112 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 01:08:30.918377 30112 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "0e7039af958f404d9c846bf53395533d"
format_stamp: "Formatted at 2026-08-12 01:08:25 on dist-test-slave-bndk"
server_key: "c15a70379c8d728cdb5f6f7dbc58a42b"
server_key_iv: "d1f209c1da94d77ff7a8ad05a6242710"
server_key_version: "encryptionkey@0"
I20260812 01:08:30.919359 30112 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:08:30.937585 30112 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:08:30.941505 30112 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:08:30.941745 30112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:08:30.942652 30112 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:08:30.943879 30112 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:08:30.943992 30112 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:30.944101 30112 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:08:30.944172 30112 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:30.974164 30112 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:37335
I20260812 01:08:30.974212 30327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:37335 every 8 connection(s)
I20260812 01:08:30.975543 30112 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:08:30.976886 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 30112
I20260812 01:08:30.980386 30331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:30.978574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.67:50197)
0812 01:08:30.979321 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:30.979565 (+ 244us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":284,"threads_started":1}
W20260812 01:08:30.981045 30328 heartbeater.cc:644] Failed to heartbeat to 127.4.201.126:45265 (0 consecutive failures): Network error: Failed to ping master at 127.4.201.126:45265: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
I20260812 01:08:30.981840 30331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:30.981529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.67:45825)
0812 01:08:30.981666 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:30.981735 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260812 01:08:30.982636 30331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:30.982319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.67:35591)
0812 01:08:30.982438 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:30.982528 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260812 01:08:30.982867 30328 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 01:08:31.087867 30333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:31.087044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.65:49721)
0812 01:08:31.087547 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:31.087641 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":226,"threads_started":1}
I20260812 01:08:31.541208 30335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:31.540447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.66:35105)
0812 01:08:31.540869 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:31.540973 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":202,"threads_started":1}
I20260812 01:08:31.984238 30336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:31.983361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.67:48181)
0812 01:08:31.983856 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:31.983989 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":219,"threads_started":1}
I20260812 01:08:32.089491 30337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:32.088753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.65:58735)
0812 01:08:32.089195 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:32.089311 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":214,"threads_started":1}
I20260812 01:08:32.542827 30338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:32.542076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.66:51973)
0812 01:08:32.542585 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:32.542665 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":258,"threads_started":1}
I20260812 01:08:32.985864 30339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:32.985132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.67:38555)
0812 01:08:32.985612 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:32.985694 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":246,"threads_started":1}
I20260812 01:08:33.090960 30345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:33.090282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.65:45043)
0812 01:08:33.090707 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:33.090785 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":224,"threads_started":1}
I20260812 01:08:33.544299 30346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:33.543623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.66:46299)
0812 01:08:33.544048 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:33.544129 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":223,"threads_started":1}
I20260812 01:08:33.987327 30347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:33.986647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.67:42455)
0812 01:08:33.987071 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:33.987149 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":219,"threads_started":1}
I20260812 01:08:34.092430 30349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:34.091739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.65:35955)
0812 01:08:34.092167 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:34.092247 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":204,"threads_started":1}
I20260812 01:08:34.545866 30352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:34.545131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.66:54489)
0812 01:08:34.545590 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:34.545673 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":226,"threads_started":1}
I20260812 01:08:34.988821 30353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:34.988115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.67:35555)
0812 01:08:34.988545 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:34.988629 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":205,"threads_started":1}
I20260812 01:08:35.093990 30354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:35.093268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.65:34263)
0812 01:08:35.093746 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:35.093828 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":237,"threads_started":1}
I20260812 01:08:35.547384 30356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:35.546670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.66:47149)
0812 01:08:35.547138 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:35.547217 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":233,"threads_started":1}
I20260812 01:08:35.990588 30357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:35.989761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.67:55795)
0812 01:08:35.990253 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:35.990341 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":234,"threads_started":1}
I20260812 01:08:36.095495 30358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:36.094795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.65:54565)
0812 01:08:36.095231 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:36.095325 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":227,"threads_started":1}
I20260812 01:08:36.548906 30359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:36.548169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.66:33065)
0812 01:08:36.548641 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:36.548733 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":234,"threads_started":1}
I20260812 01:08:36.992162 30363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:36.991455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.67:53419)
0812 01:08:36.991909 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:36.992002 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":237,"threads_started":1}
I20260812 01:08:37.097076 30365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:37.096324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.65:44823)
0812 01:08:37.096786 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:37.096864 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":203,"threads_started":1}
I20260812 01:08:37.550541 30366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:37.549742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.66:45217)
0812 01:08:37.550244 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:37.550324 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":228,"threads_started":1}
I20260812 01:08:37.993903 30369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:37.993048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.67:33277)
0812 01:08:37.993602 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:37.993686 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":251,"threads_started":1}
I20260812 01:08:38.098584 30370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:38.097902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.65:36133)
0812 01:08:38.098344 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:38.098429 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":228,"threads_started":1}
I20260812 01:08:38.552063 30374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:38.551375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.66:37591)
0812 01:08:38.551808 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:38.551888 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":226,"threads_started":1}
I20260812 01:08:38.995494 30375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:38.994797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.67:52585)
0812 01:08:38.995236 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:38.995313 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":229,"threads_started":1}
I20260812 01:08:39.100119 30376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:39.099392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.65:52351)
0812 01:08:39.099853 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:39.099934 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":231,"threads_started":1}
I20260812 01:08:39.553679 30377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:39.552874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.66:51871)
0812 01:08:39.553419 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:39.553502 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":254,"threads_started":1}
I20260812 01:08:39.997272 30380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:39.996449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.67:38975)
0812 01:08:39.996972 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:39.997063 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":257,"threads_started":1}
I20260812 01:08:40.101846 30382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:40.101072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.65:37693)
0812 01:08:40.101593 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:40.101684 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":292,"threads_started":1}
I20260812 01:08:40.555534 30383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:40.554707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.66:40905)
0812 01:08:40.555267 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:40.555364 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":310,"threads_started":1}
I20260812 01:08:40.998836 30384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:40.998126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.67:50667)
0812 01:08:40.998591 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:40.998673 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":259,"threads_started":1}
I20260812 01:08:41.103408 30387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:41.102687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.65:35249)
0812 01:08:41.103128 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:41.103227 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":216,"threads_started":1}
I20260812 01:08:41.557238 30388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:41.556481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.66:45735)
0812 01:08:41.556911 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:41.557025 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":208,"threads_started":1}
I20260812 01:08:42.000427 30389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:41.999655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.67:37583)
0812 01:08:42.000143 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:42.000239 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":234,"threads_started":1}
I20260812 01:08:42.105064 30391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:42.104242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.65:52839)
0812 01:08:42.104736 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:42.104833 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":255,"threads_started":1}
I20260812 01:08:42.558789 30392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:42.558097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.66:54757)
0812 01:08:42.558550 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:42.558634 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":222,"threads_started":1}
I20260812 01:08:43.002008 30393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:43.001304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.67:38157)
0812 01:08:43.001765 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:43.001848 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":237,"threads_started":1}
I20260812 01:08:43.106707 30394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:43.105902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.65:58035)
0812 01:08:43.106407 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:43.106506 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":238,"threads_started":1}
I20260812 01:08:43.560362 30395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:43.559597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.66:41313)
0812 01:08:43.560082 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:43.560176 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":229,"threads_started":1}
I20260812 01:08:44.003597 30398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:44.002818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.67:49823)
0812 01:08:44.003297 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:44.003392 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":232,"threads_started":1}
I20260812 01:08:44.108278 30399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:44.107546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.65:45605)
0812 01:08:44.108001 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:44.108091 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":228,"threads_started":1}
I20260812 01:08:44.561944 30400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:44.561240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.66:53269)
0812 01:08:44.561677 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:44.561760 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":218,"threads_started":1}
I20260812 01:08:45.005167 30401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:45.004408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.67:54655)
0812 01:08:45.004876 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:45.004968 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":245,"threads_started":1}
I20260812 01:08:45.110157 30402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:45.109376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.65:37645)
0812 01:08:45.109861 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:45.109973 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":248,"threads_started":1}
I20260812 01:08:45.563589 30404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:45.562901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.66:44217)
0812 01:08:45.563318 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:45.563405 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":221,"threads_started":1}
I20260812 01:08:45.986294 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 29649
I20260812 01:08:46.004593 30405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:45.987306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37024 (local address 127.4.201.65:40519)
0812 01:08:45.987857 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:45.987878 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:45.988050 (+ 172us) server_negotiation.cc:407] Connection header received
0812 01:08:45.989805 (+ 1755us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:45.989814 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:45.990235 (+ 421us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:45.990567 (+ 332us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:45.992128 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:45.993393 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:45.994626 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:45.995279 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:45.995467 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:45.998117 (+ 2650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:45.998125 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:45.998140 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:45.998178 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:46.001135 (+ 2957us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:46.001974 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:46.001989 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:46.001996 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:46.002176 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:46.002573 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:46.002577 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:46.002579 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:46.003109 (+ 530us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:46.003405 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:46.003877 (+ 472us) server_negotiation.cc:299] Negotiation successful
0812 01:08:46.004301 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":235,"threads_started":1}
I20260812 01:08:46.006052 29895 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:08:46.007009 30408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:46.006218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45265 (local address 127.4.201.67:41181)
0812 01:08:46.006695 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:46.006783 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:45265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":253,"threads_started":1}
I20260812 01:08:46.088425 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 29649
I20260812 01:08:46.116820 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 29907
I20260812 01:08:46.133996 30409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:46.117788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56832 (local address 127.4.201.66:44917)
0812 01:08:46.118328 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:46.118344 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:46.118383 (+ 39us) server_negotiation.cc:407] Connection header received
0812 01:08:46.119961 (+ 1578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:46.119971 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:46.120411 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:46.120714 (+ 303us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:46.122045 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:46.123392 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:46.124714 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:46.125460 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:46.125608 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:46.128168 (+ 2560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:46.128176 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:46.128192 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:46.128231 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:46.131077 (+ 2846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:46.131673 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:46.131679 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:46.131686 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:46.131856 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:46.132176 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:46.132179 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:46.132181 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:46.132681 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:46.132913 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:46.133293 (+ 380us) server_negotiation.cc:299] Negotiation successful
0812 01:08:46.133698 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":238,"threads_started":1}
I20260812 01:08:46.135370 30092 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:08:46.217480 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 29907
I20260812 01:08:46.241623 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 30112
I20260812 01:08:46.258586 30412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:46.242620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36748 (local address 127.4.201.67:37335)
0812 01:08:46.243197 (+ 577us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:46.243211 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:46.243254 (+ 43us) server_negotiation.cc:407] Connection header received
0812 01:08:46.244870 (+ 1616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:46.244879 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:46.245367 (+ 488us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:46.245659 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:46.246990 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:46.248276 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:46.249665 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:46.250348 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:46.250485 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:46.253010 (+ 2525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:46.253018 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:46.253033 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:46.253067 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:46.255710 (+ 2643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:46.256322 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:46.256328 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:46.256335 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:46.256498 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:46.256775 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:46.256778 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:46.256780 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:46.257319 (+ 539us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:46.257561 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:46.257876 (+ 315us) server_negotiation.cc:299] Negotiation successful
0812 01:08:46.258280 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":416,"thread_start_us":256,"threads_started":1}
I20260812 01:08:46.259913 30318 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:08:46.343144 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 30112
2026-08-12T01:08:46Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (24750 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:08:46 dist-test-slave-bndk krb5kdc[30416](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:08:46 dist-test-slave-bndk krb5kdc[30416](info): set up 2 sockets
Aug 12 01:08:46 dist-test-slave-bndk krb5kdc[30416](info): commencing operation
krb5kdc: starting...
W20260812 01:08:47.573514 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.186s user 0.000s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:08:47 dist-test-slave-bndk krb5kdc[30416](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496927, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:08:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:08:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.201.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
I20260812 01:08:47.852603 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:34855
--webserver_interface=127.4.201.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:39755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:34855
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:08:48.185443 30440 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:08:48.185721 30440 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:08:48.185819 30440 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:08:48.192803 30440 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 01:08:48.192888 30440 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 01:08:48.192934 30440 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 01:08:48.192991 30440 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:08:48.193044 30440 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:08:48.193110 30440 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:08:48.193154 30440 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:08:48.193207 30440 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:08:48.202675 30440 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:39755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:34855
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:34855
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:08:48.203809 30440 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:08:48.205042 30440 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:08:48.215924 30446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:48.216038 30448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:48.215996 30454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:08:48.217052 30440 server_base.cc:1034] running on GCE node
I20260812 01:08:48.217808 30440 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:08:48.219094 30440 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:08:48.220307 30440 hybrid_clock.cc:648] HybridClock initialized: now 1786496928220244 us; error 39 us; skew 500 ppm
I20260812 01:08:48.220609 30440 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:08:48 dist-test-slave-bndk krb5kdc[30416](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496928, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:08:48.223589 30440 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:08:48.224947 30440 webserver.cc:460] Webserver started at http://127.4.201.126:45189/ using document root <none> and password file <none>
I20260812 01:08:48.225665 30440 fs_manager.cc:359] Metadata directory not provided
I20260812 01:08:48.225795 30440 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:08:48.226121 30440 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:08:48.228962 30440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "636ff8e3b4984c42a57202918e2d6164"
format_stamp: "Formatted at 2026-08-12 01:08:48 on dist-test-slave-bndk"
server_key: "275e479b124b785b037c88bfcdad2af0"
server_key_iv: "4470588723b28534df5865183958c899"
server_key_version: "encryptionkey@0"
I20260812 01:08:48.229782 30440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "636ff8e3b4984c42a57202918e2d6164"
format_stamp: "Formatted at 2026-08-12 01:08:48 on dist-test-slave-bndk"
server_key: "275e479b124b785b037c88bfcdad2af0"
server_key_iv: "4470588723b28534df5865183958c899"
server_key_version: "encryptionkey@0"
I20260812 01:08:48.234783 30440 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 01:08:48.238078 30464 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:48.239329 30440 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 01:08:48.239493 30440 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "636ff8e3b4984c42a57202918e2d6164"
format_stamp: "Formatted at 2026-08-12 01:08:48 on dist-test-slave-bndk"
server_key: "275e479b124b785b037c88bfcdad2af0"
server_key_iv: "4470588723b28534df5865183958c899"
server_key_version: "encryptionkey@0"
I20260812 01:08:48.239691 30440 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:08:48.268780 30440 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:08:48.272869 30440 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:08:48.273141 30440 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:08:48.290750 30440 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:34855
I20260812 01:08:48.290771 30545 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:34855 every 8 connection(s)
I20260812 01:08:48.292071 30440 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:08:48.295843 30546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:08:48.298244 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 30440
I20260812 01:08:48.298454 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:08:48.299108 4901 external_mini_cluster.cc:1428] Setting key 0d746db1386152712956a295e78700da
I20260812 01:08:48.307567 30546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164: Bootstrap starting.
I20260812 01:08:48.311304 30546 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164: Neither blocks nor log segments found. Creating new log.
I20260812 01:08:48.312577 30546 log.cc:824] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164: Log is configured to *not* fsync() on all Append() calls
Aug 12 01:08:48 dist-test-slave-bndk krb5kdc[30416](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496927, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:08:48.315392 30546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164: No bootstrap required, opened a new log
I20260812 01:08:48.322127 30551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:48.301061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58876 (local address 127.4.201.126:34855)
0812 01:08:48.301898 (+ 837us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:48.301910 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:48.301949 (+ 39us) server_negotiation.cc:407] Connection header received
0812 01:08:48.303602 (+ 1653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:48.303625 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:48.304015 (+ 390us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:48.304329 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:48.306251 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:48.307525 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:48.309445 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:48.310120 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:48.310245 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:48.314978 (+ 4733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:48.314986 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:48.315000 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:48.315039 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:48.318091 (+ 3052us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:48.318787 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:48.318794 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:48.318801 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:48.318986 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:48.319354 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:48.319358 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:48.319360 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:48.319896 (+ 536us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:48.320218 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:48.320668 (+ 450us) server_negotiation.cc:299] Negotiation successful
0812 01:08:48.321079 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":629,"thread_start_us":360,"threads_started":1}
I20260812 01:08:48.323172 30546 raft_consensus.cc:348] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "636ff8e3b4984c42a57202918e2d6164" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 34855 } }
I20260812 01:08:48.323534 30546 raft_consensus.cc:374] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:08:48.323635 30546 raft_consensus.cc:729] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 636ff8e3b4984c42a57202918e2d6164, State: Initialized, Role: FOLLOWER
I20260812 01:08:48.324188 30546 consensus_queue.cc:260] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "636ff8e3b4984c42a57202918e2d6164" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 34855 } }
I20260812 01:08:48.324417 30546 raft_consensus.cc:388] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:08:48.324568 30546 raft_consensus.cc:482] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:08:48.324743 30546 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:08:48.327214 30546 raft_consensus.cc:504] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "636ff8e3b4984c42a57202918e2d6164" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 34855 } }
I20260812 01:08:48.327675 30546 leader_election.cc:302] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 636ff8e3b4984c42a57202918e2d6164; no voters:
I20260812 01:08:48.328166 30546 leader_election.cc:288] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:08:48.328284 30553 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:08:48.329066 30553 raft_consensus.cc:686] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [term 1 LEADER]: Becoming Leader. State: Replica: 636ff8e3b4984c42a57202918e2d6164, State: Running, Role: LEADER
I20260812 01:08:48.329639 30553 consensus_queue.cc:237] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "636ff8e3b4984c42a57202918e2d6164" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 34855 } }
I20260812 01:08:48.330148 30546 sys_catalog.cc:564] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:08:48.332131 30554 sys_catalog.cc:455] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "636ff8e3b4984c42a57202918e2d6164" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "636ff8e3b4984c42a57202918e2d6164" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 34855 } } }
I20260812 01:08:48.332571 30554 sys_catalog.cc:458] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [sys.catalog]: This master's current role is: LEADER
I20260812 01:08:48.332567 30555 sys_catalog.cc:455] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 636ff8e3b4984c42a57202918e2d6164. Latest consensus state: current_term: 1 leader_uuid: "636ff8e3b4984c42a57202918e2d6164" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "636ff8e3b4984c42a57202918e2d6164" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 34855 } } }
I20260812 01:08:48.333251 30555 sys_catalog.cc:458] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [sys.catalog]: This master's current role is: LEADER
I20260812 01:08:48.335829 30566 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:08:48.341053 30566 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:08:48.350138 30566 catalog_manager.cc:1347] Generated new cluster ID: 223cf21027904ea6b2017892b30e6366
I20260812 01:08:48.350255 30566 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:08:48.368645 30566 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:08:48.370009 30566 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:08:48.380785 30566 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164: Generated new TSK 0
I20260812 01:08:48.381681 30566 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.201.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
I20260812 01:08:48.448689 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:0
--local_ip_for_outbound_sockets=127.4.201.65
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:34855
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:39755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:08:48.784677 30587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:08:48.784963 30587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:08:48.785105 30587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:08:48.792023 30587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:08:48.792138 30587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:08:48.792300 30587 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:08:48.801678 30587 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:39755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:34855
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:08:48.802896 30587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:08:48.804224 30587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:08:48.816658 30599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:48.816702 30594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:48.816727 30596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:08:48.817365 30587 server_base.cc:1034] running on GCE node
I20260812 01:08:48.817940 30587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:08:48.818787 30587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:08:48.819983 30587 hybrid_clock.cc:648] HybridClock initialized: now 1786496928819931 us; error 45 us; skew 500 ppm
I20260812 01:08:48.820267 30587 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:08:48 dist-test-slave-bndk krb5kdc[30416](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496928, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:08:48.826686 30587 init.cc:377] Logged in from keytab as kudu/127.4.201.65@KRBTEST.COM (short username kudu)
I20260812 01:08:48.828040 30587 webserver.cc:460] Webserver started at http://127.4.201.65:32821/ using document root <none> and password file <none>
I20260812 01:08:48.828701 30587 fs_manager.cc:359] Metadata directory not provided
I20260812 01:08:48.828820 30587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:08:48.829144 30587 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:08:48.832266 30587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/data/instance:
uuid: "8416d51d8b614c95bbbb195dfac73fbc"
format_stamp: "Formatted at 2026-08-12 01:08:48 on dist-test-slave-bndk"
server_key: "2601c01431c9e2e95f98c9aca0df47b7"
server_key_iv: "8818745bbb5c136dc372e2bccd2f709c"
server_key_version: "encryptionkey@0"
I20260812 01:08:48.833010 30587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance:
uuid: "8416d51d8b614c95bbbb195dfac73fbc"
format_stamp: "Formatted at 2026-08-12 01:08:48 on dist-test-slave-bndk"
server_key: "2601c01431c9e2e95f98c9aca0df47b7"
server_key_iv: "8818745bbb5c136dc372e2bccd2f709c"
server_key_version: "encryptionkey@0"
I20260812 01:08:48.838089 30587 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 01:08:48.841435 30611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:48.842720 30587 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 01:08:48.842849 30587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "8416d51d8b614c95bbbb195dfac73fbc"
format_stamp: "Formatted at 2026-08-12 01:08:48 on dist-test-slave-bndk"
server_key: "2601c01431c9e2e95f98c9aca0df47b7"
server_key_iv: "8818745bbb5c136dc372e2bccd2f709c"
server_key_version: "encryptionkey@0"
I20260812 01:08:48.843045 30587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:08:48.861693 30587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:08:48.865304 30587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:08:48.865597 30587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:08:48.866482 30587 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:08:48.867751 30587 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:08:48.867823 30587 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:48.867915 30587 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:08:48.867965 30587 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:48.896698 30587 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:44347
I20260812 01:08:48.896749 30778 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:44347 every 8 connection(s)
I20260812 01:08:48.897997 30587 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:08:48.906454 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 30587
I20260812 01:08:48.906666 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance
I20260812 01:08:48.907306 4901 external_mini_cluster.cc:1428] Setting key 0c2bea3e1be3c8c375b2e3868af56d9d
Aug 12 01:08:48 dist-test-slave-bndk krb5kdc[30416](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496928, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:08:48.917330 30781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:48.900424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:60947 (local address 127.4.201.126:34855)
0812 01:08:48.900844 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:48.900849 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:48.901734 (+ 885us) server_negotiation.cc:407] Connection header received
0812 01:08:48.903545 (+ 1811us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:48.903551 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:48.903629 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:48.903725 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:48.905206 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:48.905955 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:48.908036 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:48.908446 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:48.908572 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:48.912020 (+ 3448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:48.912025 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:48.912029 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:48.912061 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:48.914412 (+ 2351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:48.915099 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:48.915105 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:48.915107 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:48.915230 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:48.915635 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:48.915640 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:48.915642 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:48.915912 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:48.916048 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:48.916717 (+ 669us) server_negotiation.cc:299] Negotiation successful
0812 01:08:48.916947 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":215,"threads_started":1}
I20260812 01:08:48.918226 30783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:48.900849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.65:60947)
0812 01:08:48.901570 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:48.901615 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:48.903262 (+ 1647us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:48.903978 (+ 716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:48.903987 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:48.904478 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:08:48.905027 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:48.905045 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:48.906111 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:48.906115 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:48.907896 (+ 1781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:48.907911 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:48.908677 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:48.908685 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:48.908914 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:48.909550 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:08:48.909577 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:08:48.911813 (+ 2236us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:08:48.914545 (+ 2732us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:48.914555 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:48.914571 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:48.914984 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:48.915333 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:48.915338 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:48.915342 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:48.915527 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:48.916040 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:08:48.916047 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:08:48.916358 (+ 311us) client_negotiation.cc:769] Sending connection context
0812 01:08:48.916599 (+ 241us) client_negotiation.cc:240] Negotiation successful
0812 01:08:48.917095 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":292,"threads_started":1}
I20260812 01:08:48.919642 30779 heartbeater.cc:347] Connected to a master server at 127.4.201.126:34855
I20260812 01:08:48.919914 30779 heartbeater.cc:464] Registering TS with master...
I20260812 01:08:48.920607 30779 heartbeater.cc:511] Master 127.4.201.126:34855 requested a full tablet report, sending...
I20260812 01:08:48.922670 30490 ts_manager.cc:194] Registered new tserver with Master: 8416d51d8b614c95bbbb195dfac73fbc (127.4.201.65:44347)
I20260812 01:08:48.924096 30490 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.65@KRBTEST.COM'} at 127.4.201.65:60947
WARNING: no policy specified for kudu/127.4.201.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
I20260812 01:08:48.966205 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:0
--local_ip_for_outbound_sockets=127.4.201.66
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:34855
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:39755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:08:49.296777 30786 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:08:49.297031 30786 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:08:49.297150 30786 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:08:49.304399 30786 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:08:49.304502 30786 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:08:49.304652 30786 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:08:49.314579 30786 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:39755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:34855
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:08:49.315783 30786 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:08:49.317072 30786 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:08:49.329610 30795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:49.329682 30799 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:49.329751 30797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:08:49.331030 30786 server_base.cc:1034] running on GCE node
I20260812 01:08:49.331748 30786 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:08:49.332772 30786 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:08:49.333981 30786 hybrid_clock.cc:648] HybridClock initialized: now 1786496929333919 us; error 47 us; skew 500 ppm
I20260812 01:08:49.334295 30786 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:08:49 dist-test-slave-bndk krb5kdc[30416](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496929, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:08:49.337534 30786 init.cc:377] Logged in from keytab as kudu/127.4.201.66@KRBTEST.COM (short username kudu)
I20260812 01:08:49.338984 30786 webserver.cc:460] Webserver started at http://127.4.201.66:44025/ using document root <none> and password file <none>
I20260812 01:08:49.339636 30786 fs_manager.cc:359] Metadata directory not provided
I20260812 01:08:49.339754 30786 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:08:49.340060 30786 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:08:49.343086 30786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/data/instance:
uuid: "c57f64fe38f64cff859befc23a5b3912"
format_stamp: "Formatted at 2026-08-12 01:08:49 on dist-test-slave-bndk"
server_key: "e0fde74e1e93bf2be421f7d8a3625e50"
server_key_iv: "a7f807016553118aa19b68fc1751ccb4"
server_key_version: "encryptionkey@0"
I20260812 01:08:49.343855 30786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance:
uuid: "c57f64fe38f64cff859befc23a5b3912"
format_stamp: "Formatted at 2026-08-12 01:08:49 on dist-test-slave-bndk"
server_key: "e0fde74e1e93bf2be421f7d8a3625e50"
server_key_iv: "a7f807016553118aa19b68fc1751ccb4"
server_key_version: "encryptionkey@0"
I20260812 01:08:49.349327 30786 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 01:08:49.353001 30812 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:49.354290 30786 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:08:49.354458 30786 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "c57f64fe38f64cff859befc23a5b3912"
format_stamp: "Formatted at 2026-08-12 01:08:49 on dist-test-slave-bndk"
server_key: "e0fde74e1e93bf2be421f7d8a3625e50"
server_key_iv: "a7f807016553118aa19b68fc1751ccb4"
server_key_version: "encryptionkey@0"
I20260812 01:08:49.354635 30786 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:08:49.369067 30786 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:08:49.373119 30786 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:08:49.373411 30786 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:08:49.374326 30786 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:08:49.375600 30786 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:08:49.375677 30786 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:49.375814 30786 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:08:49.375882 30786 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:49.406330 30786 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:45357
I20260812 01:08:49.406383 31001 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:45357 every 8 connection(s)
I20260812 01:08:49.407614 30786 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:08:49.411913 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 30786
I20260812 01:08:49.412106 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance
I20260812 01:08:49.412668 4901 external_mini_cluster.cc:1428] Setting key cad7cd6434b99501ce0bddf28948747a
Aug 12 01:08:49 dist-test-slave-bndk krb5kdc[30416](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496929, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:08:49.429118 30781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:49.410164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:34061 (local address 127.4.201.126:34855)
0812 01:08:49.410367 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:49.410374 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:49.411612 (+ 1238us) server_negotiation.cc:407] Connection header received
0812 01:08:49.413994 (+ 2382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:49.413999 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:49.414067 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:49.414139 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:49.416054 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:49.416745 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:49.418817 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:49.419348 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:49.419454 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:49.423436 (+ 3982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:49.423442 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:49.423445 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:49.423481 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:49.425984 (+ 2503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:49.426799 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:49.426803 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:49.426805 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:49.426935 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:49.427390 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:49.427393 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:49.427395 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:49.427722 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:49.427863 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:49.428516 (+ 653us) server_negotiation.cc:299] Negotiation successful
0812 01:08:49.428771 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 01:08:49.430006 31005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:49.410687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.66:34061)
0812 01:08:49.411428 (+ 741us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:49.411480 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:49.413694 (+ 2214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:49.414411 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:49.414422 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:49.415067 (+ 645us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:08:49.415872 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:49.415897 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:49.416906 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:49.416912 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:49.418680 (+ 1768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:49.418696 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:49.419577 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:49.419584 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:49.419842 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:49.420549 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:08:49.420576 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:08:49.423204 (+ 2628us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:08:49.426121 (+ 2917us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:49.426130 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:49.426148 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:49.426688 (+ 540us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:49.427049 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:49.427054 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:49.427057 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:49.427296 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:49.427837 (+ 541us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:08:49.427843 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:08:49.428165 (+ 322us) client_negotiation.cc:769] Sending connection context
0812 01:08:49.428382 (+ 217us) client_negotiation.cc:240] Negotiation successful
0812 01:08:49.428821 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":272,"threads_started":1}
I20260812 01:08:49.431535 31002 heartbeater.cc:347] Connected to a master server at 127.4.201.126:34855
I20260812 01:08:49.431838 31002 heartbeater.cc:464] Registering TS with master...
I20260812 01:08:49.432567 31002 heartbeater.cc:511] Master 127.4.201.126:34855 requested a full tablet report, sending...
I20260812 01:08:49.434059 30490 ts_manager.cc:194] Registered new tserver with Master: c57f64fe38f64cff859befc23a5b3912 (127.4.201.66:45357)
I20260812 01:08:49.434886 30490 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.66@KRBTEST.COM'} at 127.4.201.66:34061
WARNING: no policy specified for kudu/127.4.201.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
I20260812 01:08:49.476024 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:0
--local_ip_for_outbound_sockets=127.4.201.67
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:34855
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:39755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:08:49.808805 31009 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:08:49.809093 31009 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:08:49.809247 31009 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:08:49.816655 31009 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:08:49.816785 31009 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:08:49.816939 31009 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:08:49.826853 31009 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:39755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:34855
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:08:49.828159 31009 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:08:49.829618 31009 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:08:49.842890 31018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:49.842905 31019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:08:49.843039 31022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:08:49.843773 31009 server_base.cc:1034] running on GCE node
I20260812 01:08:49.844409 31009 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:08:49.845441 31009 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:08:49.846662 31009 hybrid_clock.cc:648] HybridClock initialized: now 1786496929846595 us; error 56 us; skew 500 ppm
I20260812 01:08:49.846972 31009 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:08:49 dist-test-slave-bndk krb5kdc[30416](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496929, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:08:49.850071 31009 init.cc:377] Logged in from keytab as kudu/127.4.201.67@KRBTEST.COM (short username kudu)
I20260812 01:08:49.851554 31009 webserver.cc:460] Webserver started at http://127.4.201.67:35675/ using document root <none> and password file <none>
I20260812 01:08:49.852209 31009 fs_manager.cc:359] Metadata directory not provided
I20260812 01:08:49.852332 31009 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:08:49.852645 31009 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:08:49.855520 31009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/data/instance:
uuid: "1ffd2c4c35e44953865fd1c9b414234f"
format_stamp: "Formatted at 2026-08-12 01:08:49 on dist-test-slave-bndk"
server_key: "34376327023bfe162df40e4af1c3002b"
server_key_iv: "cf5f7aeffffbd05ef9d5a02310c1127c"
server_key_version: "encryptionkey@0"
I20260812 01:08:49.856269 31009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance:
uuid: "1ffd2c4c35e44953865fd1c9b414234f"
format_stamp: "Formatted at 2026-08-12 01:08:49 on dist-test-slave-bndk"
server_key: "34376327023bfe162df40e4af1c3002b"
server_key_iv: "cf5f7aeffffbd05ef9d5a02310c1127c"
server_key_version: "encryptionkey@0"
I20260812 01:08:49.861481 31009 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.006s
I20260812 01:08:49.864735 31033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:49.866008 31009 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:08:49.866173 31009 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "1ffd2c4c35e44953865fd1c9b414234f"
format_stamp: "Formatted at 2026-08-12 01:08:49 on dist-test-slave-bndk"
server_key: "34376327023bfe162df40e4af1c3002b"
server_key_iv: "cf5f7aeffffbd05ef9d5a02310c1127c"
server_key_version: "encryptionkey@0"
I20260812 01:08:49.866366 31009 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:08:49.878072 31009 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:08:49.882061 31009 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:08:49.882320 31009 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:08:49.883210 31009 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:08:49.884503 31009 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:08:49.884581 31009 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:49.884699 31009 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:08:49.884754 31009 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:08:49.916337 31009 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:37127
I20260812 01:08:49.916383 31216 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:37127 every 8 connection(s)
I20260812 01:08:49.917601 31009 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:08:49.922465 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 31009
I20260812 01:08:49.922624 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance
I20260812 01:08:49.923092 4901 external_mini_cluster.cc:1428] Setting key 1e1d490d2811d43c07de2460dbe92a01
I20260812 01:08:49.926839 30779 heartbeater.cc:503] Master 127.4.201.126:34855 was elected leader, sending a full tablet report...
Aug 12 01:08:49 dist-test-slave-bndk krb5kdc[30416](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496929, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:08:49.937839 30781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:49.920135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:41683 (local address 127.4.201.126:34855)
0812 01:08:49.920346 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:49.920352 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:49.921490 (+ 1138us) server_negotiation.cc:407] Connection header received
0812 01:08:49.923346 (+ 1856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:49.923352 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:49.923448 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:49.923567 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:49.925331 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:49.926194 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:49.928388 (+ 2194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:49.928939 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:49.929041 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:49.932325 (+ 3284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:49.932330 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:49.932333 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:49.932363 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:49.934789 (+ 2426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:49.935499 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:49.935504 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:49.935507 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:49.935638 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:49.936053 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:49.936057 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:49.936059 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:49.936308 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:49.936500 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:49.937275 (+ 775us) server_negotiation.cc:299] Negotiation successful
0812 01:08:49.937502 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 01:08:49.938676 31219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:49.920591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.67:41683)
0812 01:08:49.921330 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:49.921381 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:49.923071 (+ 1690us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:49.923792 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:49.923804 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:49.924492 (+ 688us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:08:49.925159 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:49.925180 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:49.926357 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:49.926363 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:49.928256 (+ 1893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:49.928271 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:49.929134 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:49.929139 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:49.929391 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:49.929951 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:08:49.929972 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:08:49.932137 (+ 2165us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:08:49.934919 (+ 2782us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:49.934936 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:49.934950 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:49.935391 (+ 441us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:49.935742 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:08:49.935747 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:08:49.935751 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:08:49.935938 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:08:49.936470 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:08:49.936478 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:08:49.936838 (+ 360us) client_negotiation.cc:769] Sending connection context
0812 01:08:49.937094 (+ 256us) client_negotiation.cc:240] Negotiation successful
0812 01:08:49.937587 (+ 493us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":265,"threads_started":1}
I20260812 01:08:49.939950 31217 heartbeater.cc:347] Connected to a master server at 127.4.201.126:34855
I20260812 01:08:49.940220 31217 heartbeater.cc:464] Registering TS with master...
I20260812 01:08:49.940851 31217 heartbeater.cc:511] Master 127.4.201.126:34855 requested a full tablet report, sending...
I20260812 01:08:49.942293 30490 ts_manager.cc:194] Registered new tserver with Master: 1ffd2c4c35e44953865fd1c9b414234f (127.4.201.67:37127)
I20260812 01:08:49.943046 30490 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.67@KRBTEST.COM'} at 127.4.201.67:41683
I20260812 01:08:49.950381 4901 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:08:49.966217 30781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:49.954774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58884 (local address 127.4.201.126:34855)
0812 01:08:49.954956 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:49.954962 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:49.955356 (+ 394us) server_negotiation.cc:407] Connection header received
0812 01:08:49.955495 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:49.955500 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:49.955556 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:49.955632 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:49.956905 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:49.957687 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:49.959081 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:49.959485 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:49.959579 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:49.961688 (+ 2109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:49.961693 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:49.961696 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:49.961725 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:49.964081 (+ 2356us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:49.964669 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:49.964673 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:49.964676 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:49.964804 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:49.965099 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:49.965102 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:49.965104 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:49.965403 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:49.965596 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:49.965820 (+ 224us) server_negotiation.cc:299] Negotiation successful
0812 01:08:49.965974 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 01:08:49.970065 30490 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58884:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:08:49.976780 30490 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:08:50.011759 31236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:49.989080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58874 (local address 127.4.201.66:45357)
0812 01:08:50.003963 (+ 14883us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:50.003971 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:50.003996 (+ 25us) server_negotiation.cc:407] Connection header received
0812 01:08:50.004078 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:50.004083 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:50.004275 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:50.004451 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:08:50.005094 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:50.006658 (+ 1564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:50.008723 (+ 2065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:50.010158 (+ 1435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:50.010301 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:50.010499 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:50.011221 (+ 722us) server_negotiation.cc:299] Negotiation successful
0812 01:08:50.011407 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14728,"thread_start_us":15605,"threads_started":1}
I20260812 01:08:50.011781 31238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:49.988897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:45357 (local address 127.0.0.1:58874)
0812 01:08:49.998339 (+ 9442us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:49.998397 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:49.998588 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:50.004489 (+ 5901us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:50.004496 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:50.004527 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:08:50.004878 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:50.004893 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:50.006816 (+ 1923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:50.006821 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:50.008562 (+ 1741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:50.008575 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:50.010637 (+ 2062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:50.010643 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:50.010940 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:50.011007 (+ 67us) client_negotiation.cc:769] Sending connection context
0812 01:08:50.011135 (+ 128us) client_negotiation.cc:240] Negotiation successful
0812 01:08:50.011352 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9200,"mutex_wait_us":49,"thread_start_us":13924,"threads_started":1}
I20260812 01:08:50.013919 31239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:49.989486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36466 (local address 127.4.201.67:37127)
0812 01:08:50.005752 (+ 16266us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:50.005759 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:50.005784 (+ 25us) server_negotiation.cc:407] Connection header received
0812 01:08:50.005887 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:50.005893 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:50.006100 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:50.006309 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:08:50.007410 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:50.008939 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:50.011531 (+ 2592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:50.012868 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:50.013006 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:50.013253 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:50.013436 (+ 183us) server_negotiation.cc:299] Negotiation successful
0812 01:08:50.013592 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16119,"thread_start_us":15945,"threads_started":1}
I20260812 01:08:50.014216 31242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:49.989246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:37127 (local address 127.0.0.1:36466)
0812 01:08:50.002331 (+ 13085us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:50.002356 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:50.002478 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:50.006505 (+ 4027us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:50.006509 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:50.006536 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:08:50.007202 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:50.007216 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:50.009061 (+ 1845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:50.009067 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:50.011333 (+ 2266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:50.011348 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:50.013054 (+ 1706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:50.013061 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:50.013244 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:50.013276 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 01:08:50.013364 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 01:08:50.013495 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12955,"mutex_wait_us":161,"thread_start_us":8719,"threads_started":1}
I20260812 01:08:50.015429 31243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:49.999205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41498 (local address 127.4.201.65:44347)
0812 01:08:50.005393 (+ 6188us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:50.005401 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:50.005431 (+ 30us) server_negotiation.cc:407] Connection header received
0812 01:08:50.005539 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:50.005547 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:50.005776 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:50.005953 (+ 177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:08:50.007272 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:50.008830 (+ 1558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:50.011630 (+ 2800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:50.013491 (+ 1861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:50.013624 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:50.013927 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:50.015010 (+ 1083us) server_negotiation.cc:299] Negotiation successful
0812 01:08:50.015182 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5980,"thread_start_us":5809,"threads_started":1}
I20260812 01:08:50.016274 30888 tablet_service.cc:1467] Processing CreateTablet for tablet 3662b23756be48e584b1eab1f969b743 (DEFAULT_TABLE table=test-table [id=12e020e37f9c4a5b815e9dba787d5a9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:08:50.017907 30888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3662b23756be48e584b1eab1f969b743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:08:50.018286 31235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:49.998813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:44347 (local address 127.0.0.1:41498)
0812 01:08:50.003080 (+ 4267us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:50.003139 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:50.003254 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:50.006218 (+ 2964us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:50.006223 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:50.006248 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:08:50.007084 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:50.007098 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:50.008967 (+ 1869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:50.008972 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:50.011426 (+ 2454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:50.011441 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:50.014630 (+ 3189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:50.014636 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:50.014794 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:50.014825 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 01:08:50.014930 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 01:08:50.015050 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4134,"mutex_wait_us":141,"thread_start_us":3732,"threads_started":1}
I20260812 01:08:50.017879 31116 tablet_service.cc:1467] Processing CreateTablet for tablet 3662b23756be48e584b1eab1f969b743 (DEFAULT_TABLE table=test-table [id=12e020e37f9c4a5b815e9dba787d5a9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:08:50.019328 31116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3662b23756be48e584b1eab1f969b743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:08:50.021306 30680 tablet_service.cc:1467] Processing CreateTablet for tablet 3662b23756be48e584b1eab1f969b743 (DEFAULT_TABLE table=test-table [id=12e020e37f9c4a5b815e9dba787d5a9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:08:50.022384 30680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3662b23756be48e584b1eab1f969b743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:08:50.032851 31244 tablet_bootstrap.cc:492] T 3662b23756be48e584b1eab1f969b743 P c57f64fe38f64cff859befc23a5b3912: Bootstrap starting.
I20260812 01:08:50.034861 31245 tablet_bootstrap.cc:492] T 3662b23756be48e584b1eab1f969b743 P 8416d51d8b614c95bbbb195dfac73fbc: Bootstrap starting.
I20260812 01:08:50.036643 31244 tablet_bootstrap.cc:654] T 3662b23756be48e584b1eab1f969b743 P c57f64fe38f64cff859befc23a5b3912: Neither blocks nor log segments found. Creating new log.
I20260812 01:08:50.038183 31244 log.cc:824] T 3662b23756be48e584b1eab1f969b743 P c57f64fe38f64cff859befc23a5b3912: Log is configured to *not* fsync() on all Append() calls
I20260812 01:08:50.038586 31246 tablet_bootstrap.cc:492] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f: Bootstrap starting.
I20260812 01:08:50.040086 31245 tablet_bootstrap.cc:654] T 3662b23756be48e584b1eab1f969b743 P 8416d51d8b614c95bbbb195dfac73fbc: Neither blocks nor log segments found. Creating new log.
I20260812 01:08:50.040997 31245 log.cc:824] T 3662b23756be48e584b1eab1f969b743 P 8416d51d8b614c95bbbb195dfac73fbc: Log is configured to *not* fsync() on all Append() calls
I20260812 01:08:50.041411 31244 tablet_bootstrap.cc:492] T 3662b23756be48e584b1eab1f969b743 P c57f64fe38f64cff859befc23a5b3912: No bootstrap required, opened a new log
I20260812 01:08:50.041692 31244 ts_tablet_manager.cc:1397] T 3662b23756be48e584b1eab1f969b743 P c57f64fe38f64cff859befc23a5b3912: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260812 01:08:50.041828 31246 tablet_bootstrap.cc:654] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f: Neither blocks nor log segments found. Creating new log.
I20260812 01:08:50.043062 31246 log.cc:824] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f: Log is configured to *not* fsync() on all Append() calls
I20260812 01:08:50.043448 31245 tablet_bootstrap.cc:492] T 3662b23756be48e584b1eab1f969b743 P 8416d51d8b614c95bbbb195dfac73fbc: No bootstrap required, opened a new log
I20260812 01:08:50.043668 31245 ts_tablet_manager.cc:1397] T 3662b23756be48e584b1eab1f969b743 P 8416d51d8b614c95bbbb195dfac73fbc: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260812 01:08:50.050884 31245 raft_consensus.cc:348] T 3662b23756be48e584b1eab1f969b743 P 8416d51d8b614c95bbbb195dfac73fbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c57f64fe38f64cff859befc23a5b3912" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 45357 } } peers { permanent_uuid: "1ffd2c4c35e44953865fd1c9b414234f" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37127 } } peers { permanent_uuid: "8416d51d8b614c95bbbb195dfac73fbc" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 44347 } }
I20260812 01:08:50.051220 31245 raft_consensus.cc:374] T 3662b23756be48e584b1eab1f969b743 P 8416d51d8b614c95bbbb195dfac73fbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:08:50.051332 31245 raft_consensus.cc:729] T 3662b23756be48e584b1eab1f969b743 P 8416d51d8b614c95bbbb195dfac73fbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8416d51d8b614c95bbbb195dfac73fbc, State: Initialized, Role: FOLLOWER
I20260812 01:08:50.051931 31246 tablet_bootstrap.cc:492] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f: No bootstrap required, opened a new log
I20260812 01:08:50.051937 31245 consensus_queue.cc:260] T 3662b23756be48e584b1eab1f969b743 P 8416d51d8b614c95bbbb195dfac73fbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c57f64fe38f64cff859befc23a5b3912" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 45357 } } peers { permanent_uuid: "1ffd2c4c35e44953865fd1c9b414234f" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37127 } } peers { permanent_uuid: "8416d51d8b614c95bbbb195dfac73fbc" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 44347 } }
I20260812 01:08:50.052213 31246 ts_tablet_manager.cc:1397] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.007s
I20260812 01:08:50.052017 31244 raft_consensus.cc:348] T 3662b23756be48e584b1eab1f969b743 P c57f64fe38f64cff859befc23a5b3912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c57f64fe38f64cff859befc23a5b3912" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 45357 } } peers { permanent_uuid: "1ffd2c4c35e44953865fd1c9b414234f" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37127 } } peers { permanent_uuid: "8416d51d8b614c95bbbb195dfac73fbc" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 44347 } }
I20260812 01:08:50.052482 31244 raft_consensus.cc:374] T 3662b23756be48e584b1eab1f969b743 P c57f64fe38f64cff859befc23a5b3912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:08:50.052596 31244 raft_consensus.cc:729] T 3662b23756be48e584b1eab1f969b743 P c57f64fe38f64cff859befc23a5b3912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c57f64fe38f64cff859befc23a5b3912, State: Initialized, Role: FOLLOWER
I20260812 01:08:50.053260 31244 consensus_queue.cc:260] T 3662b23756be48e584b1eab1f969b743 P c57f64fe38f64cff859befc23a5b3912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c57f64fe38f64cff859befc23a5b3912" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 45357 } } peers { permanent_uuid: "1ffd2c4c35e44953865fd1c9b414234f" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37127 } } peers { permanent_uuid: "8416d51d8b614c95bbbb195dfac73fbc" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 44347 } }
I20260812 01:08:50.053720 31245 ts_tablet_manager.cc:1428] T 3662b23756be48e584b1eab1f969b743 P 8416d51d8b614c95bbbb195dfac73fbc: Time spent starting tablet: real 0.010s user 0.004s sys 0.005s
I20260812 01:08:50.054699 31002 heartbeater.cc:503] Master 127.4.201.126:34855 was elected leader, sending a full tablet report...
I20260812 01:08:50.055280 31244 ts_tablet_manager.cc:1428] T 3662b23756be48e584b1eab1f969b743 P c57f64fe38f64cff859befc23a5b3912: Time spent starting tablet: real 0.013s user 0.009s sys 0.004s
I20260812 01:08:50.061468 31246 raft_consensus.cc:348] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c57f64fe38f64cff859befc23a5b3912" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 45357 } } peers { permanent_uuid: "1ffd2c4c35e44953865fd1c9b414234f" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37127 } } peers { permanent_uuid: "8416d51d8b614c95bbbb195dfac73fbc" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 44347 } }
I20260812 01:08:50.061779 31246 raft_consensus.cc:374] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:08:50.061878 31246 raft_consensus.cc:729] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ffd2c4c35e44953865fd1c9b414234f, State: Initialized, Role: FOLLOWER
I20260812 01:08:50.062356 31246 consensus_queue.cc:260] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c57f64fe38f64cff859befc23a5b3912" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 45357 } } peers { permanent_uuid: "1ffd2c4c35e44953865fd1c9b414234f" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37127 } } peers { permanent_uuid: "8416d51d8b614c95bbbb195dfac73fbc" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 44347 } }
I20260812 01:08:50.063283 31217 heartbeater.cc:503] Master 127.4.201.126:34855 was elected leader, sending a full tablet report...
I20260812 01:08:50.063657 31246 ts_tablet_manager.cc:1428] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f: Time spent starting tablet: real 0.011s user 0.010s sys 0.001s
I20260812 01:08:50.070390 31257 raft_consensus.cc:482] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:08:50.070627 31257 raft_consensus.cc:504] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c57f64fe38f64cff859befc23a5b3912" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 45357 } } peers { permanent_uuid: "1ffd2c4c35e44953865fd1c9b414234f" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37127 } } peers { permanent_uuid: "8416d51d8b614c95bbbb195dfac73fbc" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 44347 } }
I20260812 01:08:50.072113 31257 leader_election.cc:288] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c57f64fe38f64cff859befc23a5b3912 (127.4.201.66:45357), 8416d51d8b614c95bbbb195dfac73fbc (127.4.201.65:44347)
I20260812 01:08:50.078401 31219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:50.072474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:45357 (local address 127.4.201.67:50413)
0812 01:08:50.072779 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:50.072797 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:50.072941 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:50.073315 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:50.073320 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:50.073348 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:08:50.073542 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:50.073554 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:50.074705 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:50.074709 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:50.076544 (+ 1835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:50.076559 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:50.077844 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:50.077849 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:50.077999 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:50.078023 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 01:08:50.078096 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 01:08:50.078185 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186}
I20260812 01:08:50.078594 31236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:50.072590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:50413 (local address 127.4.201.66:45357)
0812 01:08:50.072782 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:50.072788 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:50.072866 (+ 78us) server_negotiation.cc:407] Connection header received
0812 01:08:50.073072 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:50.073077 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:50.073153 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:50.073294 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:08:50.073665 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:50.074584 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:50.076691 (+ 2107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:50.077710 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:50.077859 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:50.077930 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:50.078139 (+ 209us) server_negotiation.cc:299] Negotiation successful
0812 01:08:50.078264 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 01:08:50.079068 31243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:50.072538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:41999 (local address 127.4.201.65:44347)
0812 01:08:50.072735 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:50.072741 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:50.073415 (+ 674us) server_negotiation.cc:407] Connection header received
0812 01:08:50.073590 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:50.073594 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:50.073676 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:50.073766 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:08:50.074232 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:50.075049 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:50.077121 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:50.078257 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:50.078409 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:50.078485 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:50.078813 (+ 328us) server_negotiation.cc:299] Negotiation successful
0812 01:08:50.078908 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 01:08:50.079311 31258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:50.072536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:44347 (local address 127.4.201.67:41999)
0812 01:08:50.073311 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:50.073332 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 01:08:50.073478 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:08:50.073791 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:08:50.073794 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:08:50.073815 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:08:50.074089 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:50.074097 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:50.075194 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:50.075199 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:50.076985 (+ 1786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:08:50.076996 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:08:50.078479 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:08:50.078486 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:08:50.078653 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:50.078686 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 01:08:50.078767 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 01:08:50.078881 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":636,"mutex_wait_us":1,"thread_start_us":420,"threads_started":1}
I20260812 01:08:50.079553 30916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3662b23756be48e584b1eab1f969b743" candidate_uuid: "1ffd2c4c35e44953865fd1c9b414234f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c57f64fe38f64cff859befc23a5b3912" is_pre_election: true
I20260812 01:08:50.080071 30916 raft_consensus.cc:2454] T 3662b23756be48e584b1eab1f969b743 P c57f64fe38f64cff859befc23a5b3912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ffd2c4c35e44953865fd1c9b414234f in term 0.
I20260812 01:08:50.080281 30709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3662b23756be48e584b1eab1f969b743" candidate_uuid: "1ffd2c4c35e44953865fd1c9b414234f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8416d51d8b614c95bbbb195dfac73fbc" is_pre_election: true
I20260812 01:08:50.080778 30709 raft_consensus.cc:2454] T 3662b23756be48e584b1eab1f969b743 P 8416d51d8b614c95bbbb195dfac73fbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ffd2c4c35e44953865fd1c9b414234f in term 0.
I20260812 01:08:50.080811 31034 leader_election.cc:302] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ffd2c4c35e44953865fd1c9b414234f, c57f64fe38f64cff859befc23a5b3912; no voters:
I20260812 01:08:50.081152 31257 raft_consensus.cc:2781] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:08:50.081324 31257 raft_consensus.cc:482] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:08:50.081429 31257 raft_consensus.cc:3037] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:08:50.083545 31257 raft_consensus.cc:504] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c57f64fe38f64cff859befc23a5b3912" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 45357 } } peers { permanent_uuid: "1ffd2c4c35e44953865fd1c9b414234f" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37127 } } peers { permanent_uuid: "8416d51d8b614c95bbbb195dfac73fbc" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 44347 } }
I20260812 01:08:50.084084 31257 leader_election.cc:288] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f [CANDIDATE]: Term 1 election: Requested vote from peers c57f64fe38f64cff859befc23a5b3912 (127.4.201.66:45357), 8416d51d8b614c95bbbb195dfac73fbc (127.4.201.65:44347)
I20260812 01:08:50.084478 30709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3662b23756be48e584b1eab1f969b743" candidate_uuid: "1ffd2c4c35e44953865fd1c9b414234f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8416d51d8b614c95bbbb195dfac73fbc"
I20260812 01:08:50.084491 30916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3662b23756be48e584b1eab1f969b743" candidate_uuid: "1ffd2c4c35e44953865fd1c9b414234f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c57f64fe38f64cff859befc23a5b3912"
I20260812 01:08:50.084643 30916 raft_consensus.cc:3037] T 3662b23756be48e584b1eab1f969b743 P c57f64fe38f64cff859befc23a5b3912 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:08:50.084652 30709 raft_consensus.cc:3037] T 3662b23756be48e584b1eab1f969b743 P 8416d51d8b614c95bbbb195dfac73fbc [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:08:50.087092 30916 raft_consensus.cc:2454] T 3662b23756be48e584b1eab1f969b743 P c57f64fe38f64cff859befc23a5b3912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ffd2c4c35e44953865fd1c9b414234f in term 1.
I20260812 01:08:50.087118 30709 raft_consensus.cc:2454] T 3662b23756be48e584b1eab1f969b743 P 8416d51d8b614c95bbbb195dfac73fbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ffd2c4c35e44953865fd1c9b414234f in term 1.
I20260812 01:08:50.087445 31034 leader_election.cc:302] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ffd2c4c35e44953865fd1c9b414234f, c57f64fe38f64cff859befc23a5b3912; no voters:
I20260812 01:08:50.087742 31257 raft_consensus.cc:2781] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:08:50.088129 31257 raft_consensus.cc:686] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f [term 1 LEADER]: Becoming Leader. State: Replica: 1ffd2c4c35e44953865fd1c9b414234f, State: Running, Role: LEADER
I20260812 01:08:50.088544 31257 consensus_queue.cc:237] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c57f64fe38f64cff859befc23a5b3912" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 45357 } } peers { permanent_uuid: "1ffd2c4c35e44953865fd1c9b414234f" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37127 } } peers { permanent_uuid: "8416d51d8b614c95bbbb195dfac73fbc" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 44347 } }
I20260812 01:08:50.093137 30488 catalog_manager.cc:5495] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ffd2c4c35e44953865fd1c9b414234f (127.4.201.67). New cstate: current_term: 1 leader_uuid: "1ffd2c4c35e44953865fd1c9b414234f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c57f64fe38f64cff859befc23a5b3912" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 45357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ffd2c4c35e44953865fd1c9b414234f" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8416d51d8b614c95bbbb195dfac73fbc" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260812 01:08:50.116112 31239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:50.111357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36468 (local address 127.4.201.67:37127)
0812 01:08:50.111547 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:50.111552 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:50.111619 (+ 67us) server_negotiation.cc:407] Connection header received
0812 01:08:50.111782 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:50.111786 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:50.111859 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:50.111979 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:08:50.112265 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:50.112972 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:50.114330 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:50.114717 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:50.114807 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:50.115205 (+ 398us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:08:50.115694 (+ 489us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:08:50.115794 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:50.115862 (+ 68us) server_negotiation.cc:299] Negotiation successful
0812 01:08:50.115926 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 01:08:50.123857 30709 raft_consensus.cc:1261] T 3662b23756be48e584b1eab1f969b743 P 8416d51d8b614c95bbbb195dfac73fbc [term 1 FOLLOWER]: Refusing update from remote peer 1ffd2c4c35e44953865fd1c9b414234f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:08:50.123869 30916 raft_consensus.cc:1261] T 3662b23756be48e584b1eab1f969b743 P c57f64fe38f64cff859befc23a5b3912 [term 1 FOLLOWER]: Refusing update from remote peer 1ffd2c4c35e44953865fd1c9b414234f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:08:50.124754 31259 consensus_queue.cc:1035] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c57f64fe38f64cff859befc23a5b3912" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 45357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:08:50.125087 31257 consensus_queue.cc:1035] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8416d51d8b614c95bbbb195dfac73fbc" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:08:50.151582 30486 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58884:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:08:50.151867 30486 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58884:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:08:50.155700 30486 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164: Sending DeleteTablet for 3 replicas of tablet 3662b23756be48e584b1eab1f969b743
I20260812 01:08:50.156906 30888 tablet_service.cc:1514] Processing DeleteTablet for tablet 3662b23756be48e584b1eab1f969b743 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:08:50 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:58874
I20260812 01:08:50.157100 30680 tablet_service.cc:1514] Processing DeleteTablet for tablet 3662b23756be48e584b1eab1f969b743 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:08:50 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:41498
I20260812 01:08:50.157315 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 30587
I20260812 01:08:50.157774 31116 tablet_service.cc:1514] Processing DeleteTablet for tablet 3662b23756be48e584b1eab1f969b743 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:08:50 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:36466
I20260812 01:08:50.168128 31285 tablet_replica.cc:330] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f: stopping tablet replica
I20260812 01:08:50.170382 31285 raft_consensus.cc:2229] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:08:50.171908 31285 raft_consensus.cc:2258] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:08:50.171998 31282 tablet_replica.cc:330] T 3662b23756be48e584b1eab1f969b743 P c57f64fe38f64cff859befc23a5b3912: stopping tablet replica
I20260812 01:08:50.172400 31282 raft_consensus.cc:2229] T 3662b23756be48e584b1eab1f969b743 P c57f64fe38f64cff859befc23a5b3912 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:08:50.172887 31283 tablet_replica.cc:330] T 3662b23756be48e584b1eab1f969b743 P 8416d51d8b614c95bbbb195dfac73fbc: stopping tablet replica
I20260812 01:08:50.172891 31282 raft_consensus.cc:2258] T 3662b23756be48e584b1eab1f969b743 P c57f64fe38f64cff859befc23a5b3912 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:08:50.173259 31283 raft_consensus.cc:2229] T 3662b23756be48e584b1eab1f969b743 P 8416d51d8b614c95bbbb195dfac73fbc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:08:50.173712 31283 raft_consensus.cc:2258] T 3662b23756be48e584b1eab1f969b743 P 8416d51d8b614c95bbbb195dfac73fbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:08:50.175418 31285 ts_tablet_manager.cc:1905] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:08:50.178328 31282 ts_tablet_manager.cc:1905] T 3662b23756be48e584b1eab1f969b743 P c57f64fe38f64cff859befc23a5b3912: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 12 01:08:50 dist-test-slave-bndk krb5kdc[30416](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496927, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.65@KRBTEST.COM
I20260812 01:08:50.182695 31285 ts_tablet_manager.cc:1918] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:08:50.182899 31285 log.cc:1196] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/wal/wals/3662b23756be48e584b1eab1f969b743
I20260812 01:08:50.183465 31285 ts_tablet_manager.cc:1939] T 3662b23756be48e584b1eab1f969b743 P 1ffd2c4c35e44953865fd1c9b414234f: Deleting consensus metadata
I20260812 01:08:50.185098 31282 ts_tablet_manager.cc:1918] T 3662b23756be48e584b1eab1f969b743 P c57f64fe38f64cff859befc23a5b3912: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:08:50.185276 31282 log.cc:1196] T 3662b23756be48e584b1eab1f969b743 P c57f64fe38f64cff859befc23a5b3912: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/wal/wals/3662b23756be48e584b1eab1f969b743
I20260812 01:08:50.185496 30467 catalog_manager.cc:4841] TS 1ffd2c4c35e44953865fd1c9b414234f (127.4.201.67:37127): tablet 3662b23756be48e584b1eab1f969b743 (table test-table [id=12e020e37f9c4a5b815e9dba787d5a9f]) successfully deleted
I20260812 01:08:50.185781 31282 ts_tablet_manager.cc:1939] T 3662b23756be48e584b1eab1f969b743 P c57f64fe38f64cff859befc23a5b3912: Deleting consensus metadata
I20260812 01:08:50.187163 31283 ts_tablet_manager.cc:1905] T 3662b23756be48e584b1eab1f969b743 P 8416d51d8b614c95bbbb195dfac73fbc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:08:50.187603 30465 catalog_manager.cc:4841] TS c57f64fe38f64cff859befc23a5b3912 (127.4.201.66:45357): tablet 3662b23756be48e584b1eab1f969b743 (table test-table [id=12e020e37f9c4a5b815e9dba787d5a9f]) successfully deleted
I20260812 01:08:50.191358 31243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:50.158631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41512 (local address 127.4.201.65:44347)
0812 01:08:50.158810 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:50.158815 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:50.168545 (+ 9730us) server_negotiation.cc:407] Connection header received
0812 01:08:50.169017 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:50.169024 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:50.169126 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:50.169208 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:50.173270 (+ 4062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:50.174490 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:50.176545 (+ 2055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:50.177147 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:50.177301 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:50.183778 (+ 6477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:50.183796 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:50.183816 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:50.183867 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:50.187733 (+ 3866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:50.188731 (+ 998us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:50.188745 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:50.188749 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:50.188926 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:50.189410 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:50.189416 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:50.189420 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:50.189927 (+ 507us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:50.190245 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:50.190677 (+ 432us) server_negotiation.cc:299] Negotiation successful
0812 01:08:50.190928 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 01:08:50.192152 30772 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:08:50.337869 31283 ts_tablet_manager.cc:1918] T 3662b23756be48e584b1eab1f969b743 P 8416d51d8b614c95bbbb195dfac73fbc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:08:50.338219 31283 log.cc:1196] T 3662b23756be48e584b1eab1f969b743 P 8416d51d8b614c95bbbb195dfac73fbc: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/wal/wals/3662b23756be48e584b1eab1f969b743
I20260812 01:08:50.338671 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 30587
I20260812 01:08:50.338789 31283 ts_tablet_manager.cc:1939] T 3662b23756be48e584b1eab1f969b743 P 8416d51d8b614c95bbbb195dfac73fbc: Deleting consensus metadata
I20260812 01:08:50.374631 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 30786
W20260812 01:08:50.374652 30467 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.201.65:44347 (error 108)
I20260812 01:08:50.377434 31235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:50.376993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:44347 (local address 127.0.0.1:41514)
0812 01:08:50.377159 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:50.377298 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260812 01:08:50.377769 30467 catalog_manager.cc:4584] TS 8416d51d8b614c95bbbb195dfac73fbc (127.4.201.65:44347): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3662b23756be48e584b1eab1f969b743: Network error: Client connection negotiation failed: client connection to 127.4.201.65:44347: connect: Connection refused (error 111)
Aug 12 01:08:50 dist-test-slave-bndk krb5kdc[30416](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496927, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.66@KRBTEST.COM
I20260812 01:08:50.392001 31236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:50.375523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58890 (local address 127.4.201.66:45357)
0812 01:08:50.375722 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:50.375728 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:50.375873 (+ 145us) server_negotiation.cc:407] Connection header received
0812 01:08:50.376064 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:50.376070 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:50.376157 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:50.376264 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:50.378190 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:50.378907 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:50.380793 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:50.381166 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:50.381314 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:50.386532 (+ 5218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:50.386547 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:50.386563 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:50.386600 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:50.389295 (+ 2695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:50.389960 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:50.389968 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:50.389971 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:50.390096 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:50.390453 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:50.390457 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:50.390459 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:50.390854 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:50.391137 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:50.391483 (+ 346us) server_negotiation.cc:299] Negotiation successful
0812 01:08:50.391697 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 01:08:50.392598 30994 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:08:50.431603 31235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:50.430982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:44347 (local address 127.0.0.1:41526)
0812 01:08:50.431227 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:50.431372 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260812 01:08:50.432785 31235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:50.432359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:44347 (local address 127.0.0.1:41538)
0812 01:08:50.432516 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:50.432614 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260812 01:08:50.482133 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 30786
I20260812 01:08:50.493706 31235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:50.493111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:44347 (local address 127.0.0.1:41554)
0812 01:08:50.493394 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:50.493503 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260812 01:08:50.494911 31235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:50.494488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:44347 (local address 127.0.0.1:41564)
0812 01:08:50.494661 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:50.494756 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260812 01:08:50.507335 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 31009
Aug 12 01:08:50 dist-test-slave-bndk krb5kdc[30416](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496927, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.67@KRBTEST.COM
I20260812 01:08:50.524070 31239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:50.508040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36478 (local address 127.4.201.67:37127)
0812 01:08:50.508217 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 01:08:50.508224 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:08:50.508345 (+ 121us) server_negotiation.cc:407] Connection header received
0812 01:08:50.508541 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:08:50.508545 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:08:50.508613 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:08:50.508701 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:08:50.510106 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:50.511072 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:50.512501 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:08:50.513351 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:08:50.513502 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:08:50.518056 (+ 4554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:08:50.518070 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:08:50.518093 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:08:50.518135 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:08:50.521113 (+ 2978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:50.521996 (+ 883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:50.522003 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:50.522009 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:50.522156 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:08:50.522606 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:08:50.522609 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:08:50.522615 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:08:50.522965 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:08:50.523190 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0812 01:08:50.523572 (+ 382us) server_negotiation.cc:299] Negotiation successful
0812 01:08:50.523738 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 01:08:50.524758 31208 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:08:50.575673 31235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:50.575143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:44347 (local address 127.0.0.1:41572)
0812 01:08:50.575373 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:50.575476 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260812 01:08:50.576759 31235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:50.576350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:44347 (local address 127.0.0.1:41586)
0812 01:08:50.576559 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:50.576637 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260812 01:08:50.647779 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 31009
I20260812 01:08:50.675487 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 30440
I20260812 01:08:50.676674 30533 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:08:50.785657 31235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:08:50.785072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:44347 (local address 127.0.0.1:41594)
0812 01:08:50.785316 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0812 01:08:50.785430 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260812 01:08:50.785714 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 30440
I20260812 01:09:10.815956 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:34855
--webserver_interface=127.4.201.126
--webserver_port=45189
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:39755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:34855
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:09:11.154609 31297 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:09:11.154896 31297 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:09:11.155035 31297 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:09:11.162377 31297 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 01:09:11.162490 31297 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 01:09:11.162539 31297 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 01:09:11.162608 31297 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:09:11.162675 31297 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:09:11.162767 31297 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:09:11.162823 31297 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:09:11.162899 31297 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:09:11.172845 31297 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:39755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:34855
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:34855
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=45189
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:09:11.174171 31297 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:09:11.175513 31297 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:09:11.200649 31306 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:09:11.200697 31308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:09:11.200611 31310 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:09:11.206405 31297 server_base.cc:1034] running on GCE node
I20260812 01:09:11.207286 31297 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:09:11.208868 31297 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:09:11.210100 31297 hybrid_clock.cc:648] HybridClock initialized: now 1786496951210029 us; error 33 us; skew 500 ppm
I20260812 01:09:11.210508 31297 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:09:11 dist-test-slave-bndk krb5kdc[30416](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496951, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:09:11.218281 31297 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:09:11.220042 31297 webserver.cc:460] Webserver started at http://127.4.201.126:45189/ using document root <none> and password file <none>
I20260812 01:09:11.220849 31297 fs_manager.cc:359] Metadata directory not provided
I20260812 01:09:11.220973 31297 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:09:11.227104 31297 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260812 01:09:11.230041 31321 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:11.231374 31297 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:09:11.231550 31297 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "636ff8e3b4984c42a57202918e2d6164"
format_stamp: "Formatted at 2026-08-12 01:08:48 on dist-test-slave-bndk"
server_key: "275e479b124b785b037c88bfcdad2af0"
server_key_iv: "4470588723b28534df5865183958c899"
server_key_version: "encryptionkey@0"
I20260812 01:09:11.232590 31297 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:09:11.258570 31297 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:09:11.263226 31297 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:09:11.263525 31297 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:09:11.282061 31297 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:34855
I20260812 01:09:11.282114 31404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:34855 every 8 connection(s)
I20260812 01:09:11.283763 31297 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:09:11.284745 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 31297
I20260812 01:09:11.285689 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:44347
--local_ip_for_outbound_sockets=127.4.201.65
--tserver_master_addrs=127.4.201.126:34855
--webserver_port=32821
--webserver_interface=127.4.201.65
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:39755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:09:11.291409 31405 sys_catalog.cc:263] Verifying existing consensus state
I20260812 01:09:11.294742 31405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164: Bootstrap starting.
I20260812 01:09:11.314303 31405 log.cc:824] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164: Log is configured to *not* fsync() on all Append() calls
I20260812 01:09:11.326715 31405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 01:09:11.327250 31405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164: Bootstrap complete.
I20260812 01:09:11.336498 31405 raft_consensus.cc:348] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "636ff8e3b4984c42a57202918e2d6164" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 34855 } }
I20260812 01:09:11.337520 31405 raft_consensus.cc:729] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 636ff8e3b4984c42a57202918e2d6164, State: Initialized, Role: FOLLOWER
I20260812 01:09:11.338183 31405 consensus_queue.cc:260] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "636ff8e3b4984c42a57202918e2d6164" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 34855 } }
I20260812 01:09:11.338423 31405 raft_consensus.cc:388] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:09:11.338547 31405 raft_consensus.cc:482] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:09:11.338713 31405 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [term 1 FOLLOWER]: Advancing to term 2
I20260812 01:09:11.342667 31405 raft_consensus.cc:504] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "636ff8e3b4984c42a57202918e2d6164" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 34855 } }
I20260812 01:09:11.343199 31405 leader_election.cc:302] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 636ff8e3b4984c42a57202918e2d6164; no voters:
I20260812 01:09:11.343806 31405 leader_election.cc:288] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 01:09:11.343966 31411 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 01:09:11.345117 31411 raft_consensus.cc:686] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [term 2 LEADER]: Becoming Leader. State: Replica: 636ff8e3b4984c42a57202918e2d6164, State: Running, Role: LEADER
I20260812 01:09:11.345778 31411 consensus_queue.cc:237] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "636ff8e3b4984c42a57202918e2d6164" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 34855 } }
I20260812 01:09:11.346228 31405 sys_catalog.cc:564] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:09:11.348301 31415 sys_catalog.cc:455] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 636ff8e3b4984c42a57202918e2d6164. Latest consensus state: current_term: 2 leader_uuid: "636ff8e3b4984c42a57202918e2d6164" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "636ff8e3b4984c42a57202918e2d6164" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 34855 } } }
I20260812 01:09:11.348717 31415 sys_catalog.cc:458] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [sys.catalog]: This master's current role is: LEADER
I20260812 01:09:11.349264 31412 sys_catalog.cc:455] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "636ff8e3b4984c42a57202918e2d6164" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "636ff8e3b4984c42a57202918e2d6164" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 34855 } } }
I20260812 01:09:11.349606 31412 sys_catalog.cc:458] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [sys.catalog]: This master's current role is: LEADER
I20260812 01:09:11.357510 31418 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:09:11.370909 31418 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:09:11.372378 31418 catalog_manager.cc:1259] Loaded cluster ID: 223cf21027904ea6b2017892b30e6366
I20260812 01:09:11.372486 31418 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:09:11.376540 31418 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:09:11.378182 31418 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164: Loaded TSK: 0
I20260812 01:09:11.412431 31418 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164: Generated new TSK 1
I20260812 01:09:11.412917 31418 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 01:09:11.636374 31407 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:09:11.636651 31407 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:09:11.636806 31407 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:09:11.643980 31407 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:09:11.644084 31407 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:09:11.644236 31407 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:09:11.654186 31407 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:39755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:44347
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=32821
--tserver_master_addrs=127.4.201.126:34855
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:09:11.655493 31407 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:09:11.656844 31407 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:09:11.671554 31451 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:09:11.671838 31456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:09:11.671581 31450 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:09:11.672621 31407 server_base.cc:1034] running on GCE node
I20260812 01:09:11.673273 31407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:09:11.674263 31407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:09:11.675465 31407 hybrid_clock.cc:648] HybridClock initialized: now 1786496951675398 us; error 60 us; skew 500 ppm
I20260812 01:09:11.675786 31407 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:09:11 dist-test-slave-bndk krb5kdc[30416](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496951, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:09:11.678846 31407 init.cc:377] Logged in from keytab as kudu/127.4.201.65@KRBTEST.COM (short username kudu)
I20260812 01:09:11.680315 31407 webserver.cc:460] Webserver started at http://127.4.201.65:32821/ using document root <none> and password file <none>
I20260812 01:09:11.680985 31407 fs_manager.cc:359] Metadata directory not provided
I20260812 01:09:11.681108 31407 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:09:11.686630 31407 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 01:09:11.689514 31466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:11.691363 31407 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 01:09:11.691599 31407 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "8416d51d8b614c95bbbb195dfac73fbc"
format_stamp: "Formatted at 2026-08-12 01:08:48 on dist-test-slave-bndk"
server_key: "2601c01431c9e2e95f98c9aca0df47b7"
server_key_iv: "8818745bbb5c136dc372e2bccd2f709c"
server_key_version: "encryptionkey@0"
I20260812 01:09:11.693063 31407 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:09:11.711676 31407 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:09:11.715993 31407 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:09:11.716256 31407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:09:11.717348 31407 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:09:11.719220 31477 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260812 01:09:11.726740 31477 ts_tablet_manager.cc:1852] T 3662b23756be48e584b1eab1f969b743 P 8416d51d8b614c95bbbb195dfac73fbc: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260812 01:09:11.728035 31477 ts_tablet_manager.cc:1905] T 3662b23756be48e584b1eab1f969b743 P 8416d51d8b614c95bbbb195dfac73fbc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:09:11.737341 31477 ts_tablet_manager.cc:1918] T 3662b23756be48e584b1eab1f969b743 P 8416d51d8b614c95bbbb195dfac73fbc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:09:11.737602 31477 ts_tablet_manager.cc:1939] T 3662b23756be48e584b1eab1f969b743 P 8416d51d8b614c95bbbb195dfac73fbc: Deleting consensus metadata
I20260812 01:09:11.738045 31407 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260812 01:09:11.738157 31407 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.019s user 0.001s sys 0.000s
I20260812 01:09:11.738282 31407 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:09:11.738353 31407 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:11.769090 31407 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:44347
I20260812 01:09:11.769151 31659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:44347 every 8 connection(s)
I20260812 01:09:11.770395 31407 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:09:11.775319 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 31407
I20260812 01:09:11.775919 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:45357
--local_ip_for_outbound_sockets=127.4.201.66
--tserver_master_addrs=127.4.201.126:34855
--webserver_port=44025
--webserver_interface=127.4.201.66
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:39755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 01:09:11 dist-test-slave-bndk krb5kdc[30416](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496951, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:09:11.793668 31663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:11.773253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:44819 (local address 127.4.201.126:34855)
0812 01:09:11.773832 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:11.773843 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:11.774402 (+ 559us) server_negotiation.cc:407] Connection header received
0812 01:09:11.776712 (+ 2310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:11.776732 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:11.777158 (+ 426us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:11.777609 (+ 451us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:09:11.778917 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:11.780582 (+ 1665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:11.782143 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:11.783072 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:11.783240 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:11.786470 (+ 3230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:09:11.786489 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:09:11.786508 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:09:11.786550 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:09:11.789553 (+ 3003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:11.790380 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:11.790386 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:11.790391 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:11.790563 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:11.790972 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:11.790974 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:11.790976 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:11.791422 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:09:11.791589 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:11.792383 (+ 794us) server_negotiation.cc:299] Negotiation successful
0812 01:09:11.792702 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":256,"threads_started":1}
I20260812 01:09:11.793891 31664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:11.773398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.65:44819)
0812 01:09:11.774229 (+ 831us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:11.774284 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 01:09:11.776126 (+ 1842us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:09:11.777683 (+ 1557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:09:11.777690 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:09:11.778209 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:09:11.778720 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:11.778737 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:11.780721 (+ 1984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:11.780725 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:11.782000 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:11.782013 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:11.783269 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:11.783274 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:11.783447 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:11.784069 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:09:11.784101 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:09:11.786198 (+ 2097us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:09:11.789691 (+ 3493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:09:11.789700 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:09:11.789714 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:09:11.790268 (+ 554us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:09:11.790666 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:09:11.790670 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:09:11.790673 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:09:11.790879 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:09:11.791559 (+ 680us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:09:11.791565 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:09:11.791924 (+ 359us) client_negotiation.cc:769] Sending connection context
0812 01:09:11.792221 (+ 297us) client_negotiation.cc:240] Negotiation successful
0812 01:09:11.792739 (+ 518us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":339,"threads_started":1}
I20260812 01:09:11.796679 31661 heartbeater.cc:347] Connected to a master server at 127.4.201.126:34855
I20260812 01:09:11.796968 31661 heartbeater.cc:464] Registering TS with master...
I20260812 01:09:11.797686 31661 heartbeater.cc:511] Master 127.4.201.126:34855 requested a full tablet report, sending...
I20260812 01:09:11.799887 31345 ts_manager.cc:194] Registered new tserver with Master: 8416d51d8b614c95bbbb195dfac73fbc (127.4.201.65:44347)
I20260812 01:09:11.801487 31345 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.65@KRBTEST.COM'} at 127.4.201.65:44819
W20260812 01:09:12.110970 31665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:09:12.111219 31665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:09:12.111378 31665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:09:12.118427 31665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:09:12.118538 31665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:09:12.118698 31665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:09:12.128196 31665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:39755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:45357
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=44025
--tserver_master_addrs=127.4.201.126:34855
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:09:12.129467 31665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:09:12.130756 31665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:09:12.143463 31670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:09:12.143476 31673 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:09:12.143658 31676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:09:12.144457 31665 server_base.cc:1034] running on GCE node
I20260812 01:09:12.145058 31665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:09:12.145974 31665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:09:12.147173 31665 hybrid_clock.cc:648] HybridClock initialized: now 1786496952147115 us; error 52 us; skew 500 ppm
I20260812 01:09:12.147475 31665 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:09:12 dist-test-slave-bndk krb5kdc[30416](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496952, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:09:12.150614 31665 init.cc:377] Logged in from keytab as kudu/127.4.201.66@KRBTEST.COM (short username kudu)
I20260812 01:09:12.152774 31665 webserver.cc:460] Webserver started at http://127.4.201.66:44025/ using document root <none> and password file <none>
I20260812 01:09:12.153529 31665 fs_manager.cc:359] Metadata directory not provided
I20260812 01:09:12.153661 31665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:09:12.159003 31665 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 01:09:12.161736 31688 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:12.163043 31665 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:09:12.163178 31665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "c57f64fe38f64cff859befc23a5b3912"
format_stamp: "Formatted at 2026-08-12 01:08:49 on dist-test-slave-bndk"
server_key: "e0fde74e1e93bf2be421f7d8a3625e50"
server_key_iv: "a7f807016553118aa19b68fc1751ccb4"
server_key_version: "encryptionkey@0"
I20260812 01:09:12.164104 31665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:09:12.185994 31665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:09:12.190225 31665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:09:12.190492 31665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:09:12.191465 31665 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:09:12.192804 31665 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:09:12.192898 31665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:12.193018 31665 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:09:12.193089 31665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:12.222496 31665 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:45357
I20260812 01:09:12.222568 31851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:45357 every 8 connection(s)
I20260812 01:09:12.223958 31665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:09:12.227752 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 31665
I20260812 01:09:12.228430 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:37127
--local_ip_for_outbound_sockets=127.4.201.67
--tserver_master_addrs=127.4.201.126:34855
--webserver_port=35675
--webserver_interface=127.4.201.67
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:39755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 01:09:12 dist-test-slave-bndk krb5kdc[30416](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496952, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:09:12.243211 31663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:12.226459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:40353 (local address 127.4.201.126:34855)
0812 01:09:12.226627 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:12.226631 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:12.227765 (+ 1134us) server_negotiation.cc:407] Connection header received
0812 01:09:12.229717 (+ 1952us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:12.229723 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:12.229803 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:12.229892 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:09:12.231352 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.232036 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.233592 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.234015 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.234127 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:12.237539 (+ 3412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:09:12.237545 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:09:12.237548 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:09:12.237581 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:09:12.240206 (+ 2625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:12.240930 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:12.240935 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:12.240939 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:12.241081 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:12.241505 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:12.241509 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:12.241512 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:12.241844 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:09:12.241993 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:12.242603 (+ 610us) server_negotiation.cc:299] Negotiation successful
0812 01:09:12.242860 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 01:09:12.243901 31860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:12.226899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.66:40353)
0812 01:09:12.227613 (+ 714us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:12.227650 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 01:09:12.229450 (+ 1800us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:09:12.230134 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:09:12.230142 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:09:12.230639 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:09:12.231171 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:12.231188 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.232196 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.232200 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:12.233454 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:12.233467 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.234241 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.234249 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:12.234476 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:12.235088 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:09:12.235114 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:09:12.237312 (+ 2198us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:09:12.240359 (+ 3047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:09:12.240366 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:09:12.240378 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:09:12.240798 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:09:12.241173 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:09:12.241176 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:09:12.241178 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:09:12.241390 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:09:12.241947 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:09:12.241953 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:09:12.242250 (+ 297us) client_negotiation.cc:769] Sending connection context
0812 01:09:12.242466 (+ 216us) client_negotiation.cc:240] Negotiation successful
0812 01:09:12.242848 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":282,"threads_started":1}
I20260812 01:09:12.245275 31854 heartbeater.cc:347] Connected to a master server at 127.4.201.126:34855
I20260812 01:09:12.245647 31854 heartbeater.cc:464] Registering TS with master...
I20260812 01:09:12.246515 31854 heartbeater.cc:511] Master 127.4.201.126:34855 requested a full tablet report, sending...
I20260812 01:09:12.248088 31345 ts_manager.cc:194] Registered new tserver with Master: c57f64fe38f64cff859befc23a5b3912 (127.4.201.66:45357)
I20260812 01:09:12.248894 31345 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.66@KRBTEST.COM'} at 127.4.201.66:40353
W20260812 01:09:12.565933 31861 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:09:12.566184 31861 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:09:12.566318 31861 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:09:12.573374 31861 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:09:12.573485 31861 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:09:12.573639 31861 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:09:12.583050 31861 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:39755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:37127
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=35675
--tserver_master_addrs=127.4.201.126:34855
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:09:12.584287 31861 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:09:12.585614 31861 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:09:12.597965 31869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:09:12.598229 31873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:09:12.598734 31868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:09:12.599773 31861 server_base.cc:1034] running on GCE node
I20260812 01:09:12.600298 31861 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:09:12.601141 31861 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:09:12.602372 31861 hybrid_clock.cc:648] HybridClock initialized: now 1786496952602321 us; error 41 us; skew 500 ppm
I20260812 01:09:12.602679 31861 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:09:12 dist-test-slave-bndk krb5kdc[30416](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496952, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:09:12.605674 31861 init.cc:377] Logged in from keytab as kudu/127.4.201.67@KRBTEST.COM (short username kudu)
I20260812 01:09:12.606997 31861 webserver.cc:460] Webserver started at http://127.4.201.67:35675/ using document root <none> and password file <none>
I20260812 01:09:12.607681 31861 fs_manager.cc:359] Metadata directory not provided
I20260812 01:09:12.607808 31861 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:09:12.612896 31861 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 01:09:12.615449 31889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:12.616654 31861 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 01:09:12.616799 31861 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "1ffd2c4c35e44953865fd1c9b414234f"
format_stamp: "Formatted at 2026-08-12 01:08:49 on dist-test-slave-bndk"
server_key: "34376327023bfe162df40e4af1c3002b"
server_key_iv: "cf5f7aeffffbd05ef9d5a02310c1127c"
server_key_version: "encryptionkey@0"
I20260812 01:09:12.617774 31861 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:09:12.635648 31861 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:09:12.639778 31861 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:09:12.640025 31861 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:09:12.640965 31861 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:09:12.642249 31861 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:09:12.642346 31861 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:12.642457 31861 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:09:12.642534 31861 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:12.672659 31861 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:37127
I20260812 01:09:12.672716 32067 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:37127 every 8 connection(s)
I20260812 01:09:12.674136 31861 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:09:12.679459 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 31861
Aug 12 01:09:12 dist-test-slave-bndk krb5kdc[30416](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496952, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:09:12.694945 32076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:12.680357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56444 (local address 127.4.201.126:34855)
0812 01:09:12.681345 (+ 988us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:12.681349 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:12.681363 (+ 14us) server_negotiation.cc:407] Connection header received
0812 01:09:12.681407 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:12.681410 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:12.681463 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:12.681557 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:09:12.683110 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.683821 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.685213 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.685764 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.685879 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:12.688751 (+ 2872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:09:12.688756 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:09:12.688759 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:09:12.688800 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:09:12.692171 (+ 3371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:12.692859 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:12.692865 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:12.692868 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:12.693034 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:12.693470 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:12.693475 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:12.693478 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:12.693814 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:09:12.694068 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:12.694313 (+ 245us) server_negotiation.cc:299] Negotiation successful
0812 01:09:12.694537 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":896,"thread_start_us":766,"threads_started":1}
I20260812 01:09:12.695170 31663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:12.676629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:38039 (local address 127.4.201.126:34855)
0812 01:09:12.676808 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:12.676813 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:12.677937 (+ 1124us) server_negotiation.cc:407] Connection header received
0812 01:09:12.679775 (+ 1838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:12.679781 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:12.679861 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:12.679951 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:09:12.681869 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.682608 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.684174 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.684613 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.684724 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:12.688403 (+ 3679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:09:12.688408 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:09:12.688411 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:09:12.688442 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:09:12.691949 (+ 3507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:12.692637 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:12.692643 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:12.692647 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:12.692788 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:12.693300 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:12.693305 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:12.693309 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:12.693642 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:09:12.693754 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:12.694603 (+ 849us) server_negotiation.cc:299] Negotiation successful
0812 01:09:12.694802 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 01:09:12.696246 32071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:12.677069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.67:38039)
0812 01:09:12.677787 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:12.677824 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 01:09:12.679482 (+ 1658us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:09:12.680224 (+ 742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:09:12.680235 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:09:12.681001 (+ 766us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:09:12.681700 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:12.681721 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.682775 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.682779 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:12.684033 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:12.684045 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.684837 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.684845 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:12.685084 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:12.685755 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:09:12.685777 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:09:12.688191 (+ 2414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:09:12.692084 (+ 3893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:09:12.692091 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:09:12.692104 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:09:12.692505 (+ 401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:09:12.692901 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:09:12.692905 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:09:12.692908 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:09:12.693155 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:09:12.693770 (+ 615us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:09:12.693778 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:09:12.694176 (+ 398us) client_negotiation.cc:769] Sending connection context
0812 01:09:12.694492 (+ 316us) client_negotiation.cc:240] Negotiation successful
0812 01:09:12.695001 (+ 509us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":322,"threads_started":1}
I20260812 01:09:12.697808 32069 heartbeater.cc:347] Connected to a master server at 127.4.201.126:34855
I20260812 01:09:12.698091 32069 heartbeater.cc:464] Registering TS with master...
I20260812 01:09:12.698827 32069 heartbeater.cc:511] Master 127.4.201.126:34855 requested a full tablet report, sending...
I20260812 01:09:12.700217 31344 ts_manager.cc:194] Registered new tserver with Master: 1ffd2c4c35e44953865fd1c9b414234f (127.4.201.67:37127)
I20260812 01:09:12.701061 31344 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.67@KRBTEST.COM'} at 127.4.201.67:38039
I20260812 01:09:12.709537 4901 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:09:12.715540 32076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:12.710401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56454 (local address 127.4.201.126:34855)
0812 01:09:12.710544 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:12.710548 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:12.710985 (+ 437us) server_negotiation.cc:407] Connection header received
0812 01:09:12.711151 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:12.711154 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:12.711287 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:12.711417 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:09:12.711818 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.712498 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.713877 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.714295 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.714383 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:12.714802 (+ 419us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:09:12.715059 (+ 257us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0812 01:09:12.715331 (+ 272us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:56454: token expired
Metrics: {"server-negotiator.queue_time_us":50}
W20260812 01:09:12.715641 32076 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:56454: token expired
W20260812 01:09:12.716133 31226 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.4.201.126:34855)
I20260812 01:09:12.728497 32076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:12.716637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56464 (local address 127.4.201.126:34855)
0812 01:09:12.716818 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:12.716823 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:12.716842 (+ 19us) server_negotiation.cc:407] Connection header received
0812 01:09:12.717001 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:12.717006 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:12.717062 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:12.717141 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:09:12.718576 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.719271 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.720587 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.720989 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.721094 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:12.723588 (+ 2494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:09:12.723592 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:09:12.723595 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:09:12.723625 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:09:12.725965 (+ 2340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:12.726605 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:12.726617 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:12.726620 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:12.726748 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:12.727114 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:12.727118 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:12.727120 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:12.727431 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:09:12.727657 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:12.727980 (+ 323us) server_negotiation.cc:299] Negotiation successful
0812 01:09:12.728193 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 01:09:12.731726 31344 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56464:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:09:12.739298 31344 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:09:12.775489 32085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:12.750803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:44347 (local address 127.0.0.1:48216)
0812 01:09:12.764012 (+ 13209us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:12.764032 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 01:09:12.764167 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:09:12.765962 (+ 1795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:09:12.765969 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:09:12.766000 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:09:12.766493 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:12.766507 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.768359 (+ 1852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.769050 (+ 691us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:12.771445 (+ 2395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:12.771465 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.774464 (+ 2999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.774481 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:12.774669 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:12.774724 (+ 55us) client_negotiation.cc:769] Sending connection context
0812 01:09:12.774846 (+ 122us) client_negotiation.cc:240] Negotiation successful
0812 01:09:12.775030 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13077,"mutex_wait_us":24,"thread_start_us":12377,"threads_started":1}
I20260812 01:09:12.776296 32087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:12.750507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:45357 (local address 127.0.0.1:35858)
0812 01:09:12.763547 (+ 13040us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:12.763592 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 01:09:12.763780 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:09:12.767566 (+ 3786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:09:12.767570 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:09:12.767597 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:09:12.767948 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:12.767959 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.770673 (+ 2714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.770678 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:12.773294 (+ 2616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:12.773312 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.775130 (+ 1818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.775137 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:12.775327 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:12.775365 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 01:09:12.775437 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 01:09:12.775562 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12796,"mutex_wait_us":1,"thread_start_us":14583,"threads_started":1}
I20260812 01:09:12.776965 32089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:12.751108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48216 (local address 127.4.201.65:44347)
0812 01:09:12.763151 (+ 12043us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:12.763160 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:12.764310 (+ 1150us) server_negotiation.cc:407] Connection header received
0812 01:09:12.764432 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:12.764440 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:12.764726 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:12.764921 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:09:12.766708 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.768197 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.771648 (+ 3451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.773944 (+ 2296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.774068 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:12.774304 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:12.776004 (+ 1700us) server_negotiation.cc:299] Negotiation successful
0812 01:09:12.776633 (+ 629us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11867,"thread_start_us":11735,"threads_started":1}
I20260812 01:09:12.777598 32088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:12.751155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35858 (local address 127.4.201.66:45357)
0812 01:09:12.766795 (+ 15640us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:12.766804 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:12.766832 (+ 28us) server_negotiation.cc:407] Connection header received
0812 01:09:12.766926 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:12.766933 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:12.767174 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:12.768524 (+ 1350us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:09:12.768826 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.770524 (+ 1698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.773512 (+ 2988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.774871 (+ 1359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.776992 (+ 2121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:12.777176 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:12.777274 (+ 98us) server_negotiation.cc:299] Negotiation successful
0812 01:09:12.777394 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15457,"thread_start_us":16149,"threads_started":1}
I20260812 01:09:12.781453 31761 tablet_service.cc:1467] Processing CreateTablet for tablet 9cc40b2382ae4a72b5b87b91359d2085 (DEFAULT_TABLE table=test-table [id=fca7e007ffd446e5ae080205cd7ad228]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:09:12.781915 31547 tablet_service.cc:1467] Processing CreateTablet for tablet 9cc40b2382ae4a72b5b87b91359d2085 (DEFAULT_TABLE table=test-table [id=fca7e007ffd446e5ae080205cd7ad228]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:09:12.782934 31761 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cc40b2382ae4a72b5b87b91359d2085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:09:12.783047 31547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cc40b2382ae4a72b5b87b91359d2085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:09:12.786378 32085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:12.764238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:37127 (local address 127.0.0.1:50288)
0812 01:09:12.775717 (+ 11479us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:12.775735 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 01:09:12.775829 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:09:12.779579 (+ 3750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:09:12.779585 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:09:12.779617 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:09:12.779806 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:12.779819 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.782265 (+ 2446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.782270 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:12.783955 (+ 1685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:12.783982 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.785671 (+ 1689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.785678 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:12.785856 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:12.785891 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 01:09:12.785996 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 01:09:12.786132 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11382,"thread_start_us":15665,"threads_started":1}
I20260812 01:09:12.786846 32092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:12.764344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50288 (local address 127.4.201.67:37127)
0812 01:09:12.778994 (+ 14650us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:12.779003 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:12.779038 (+ 35us) server_negotiation.cc:407] Connection header received
0812 01:09:12.779132 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:12.779139 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:12.779365 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:12.779562 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:09:12.780012 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.782123 (+ 2111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.784140 (+ 2017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.785506 (+ 1366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.785638 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:12.785859 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:12.786042 (+ 183us) server_negotiation.cc:299] Negotiation successful
0812 01:09:12.786199 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14450,"thread_start_us":14286,"threads_started":1}
I20260812 01:09:12.791553 32094 tablet_bootstrap.cc:492] T 9cc40b2382ae4a72b5b87b91359d2085 P 8416d51d8b614c95bbbb195dfac73fbc: Bootstrap starting.
I20260812 01:09:12.791152 31963 tablet_service.cc:1467] Processing CreateTablet for tablet 9cc40b2382ae4a72b5b87b91359d2085 (DEFAULT_TABLE table=test-table [id=fca7e007ffd446e5ae080205cd7ad228]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:09:12.792590 31963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cc40b2382ae4a72b5b87b91359d2085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:09:12.795173 32094 tablet_bootstrap.cc:654] T 9cc40b2382ae4a72b5b87b91359d2085 P 8416d51d8b614c95bbbb195dfac73fbc: Neither blocks nor log segments found. Creating new log.
I20260812 01:09:12.796128 32094 log.cc:824] T 9cc40b2382ae4a72b5b87b91359d2085 P 8416d51d8b614c95bbbb195dfac73fbc: Log is configured to *not* fsync() on all Append() calls
I20260812 01:09:12.798167 32097 tablet_bootstrap.cc:492] T 9cc40b2382ae4a72b5b87b91359d2085 P c57f64fe38f64cff859befc23a5b3912: Bootstrap starting.
I20260812 01:09:12.799283 32094 tablet_bootstrap.cc:492] T 9cc40b2382ae4a72b5b87b91359d2085 P 8416d51d8b614c95bbbb195dfac73fbc: No bootstrap required, opened a new log
I20260812 01:09:12.799543 32094 ts_tablet_manager.cc:1397] T 9cc40b2382ae4a72b5b87b91359d2085 P 8416d51d8b614c95bbbb195dfac73fbc: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.005s
I20260812 01:09:12.801671 32097 tablet_bootstrap.cc:654] T 9cc40b2382ae4a72b5b87b91359d2085 P c57f64fe38f64cff859befc23a5b3912: Neither blocks nor log segments found. Creating new log.
I20260812 01:09:12.802888 32097 log.cc:824] T 9cc40b2382ae4a72b5b87b91359d2085 P c57f64fe38f64cff859befc23a5b3912: Log is configured to *not* fsync() on all Append() calls
I20260812 01:09:12.804458 31661 heartbeater.cc:503] Master 127.4.201.126:34855 was elected leader, sending a full tablet report...
I20260812 01:09:12.806957 32099 tablet_bootstrap.cc:492] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f: Bootstrap starting.
I20260812 01:09:12.810002 32099 tablet_bootstrap.cc:654] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f: Neither blocks nor log segments found. Creating new log.
I20260812 01:09:12.810982 32099 log.cc:824] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f: Log is configured to *not* fsync() on all Append() calls
I20260812 01:09:12.811962 32097 tablet_bootstrap.cc:492] T 9cc40b2382ae4a72b5b87b91359d2085 P c57f64fe38f64cff859befc23a5b3912: No bootstrap required, opened a new log
I20260812 01:09:12.812252 32097 ts_tablet_manager.cc:1397] T 9cc40b2382ae4a72b5b87b91359d2085 P c57f64fe38f64cff859befc23a5b3912: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.004s
I20260812 01:09:12.813100 32094 raft_consensus.cc:348] T 9cc40b2382ae4a72b5b87b91359d2085 P 8416d51d8b614c95bbbb195dfac73fbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c57f64fe38f64cff859befc23a5b3912" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 45357 } } peers { permanent_uuid: "8416d51d8b614c95bbbb195dfac73fbc" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 44347 } } peers { permanent_uuid: "1ffd2c4c35e44953865fd1c9b414234f" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37127 } }
I20260812 01:09:12.813520 32099 tablet_bootstrap.cc:492] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f: No bootstrap required, opened a new log
I20260812 01:09:12.813556 32094 raft_consensus.cc:374] T 9cc40b2382ae4a72b5b87b91359d2085 P 8416d51d8b614c95bbbb195dfac73fbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:09:12.813656 32094 raft_consensus.cc:729] T 9cc40b2382ae4a72b5b87b91359d2085 P 8416d51d8b614c95bbbb195dfac73fbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8416d51d8b614c95bbbb195dfac73fbc, State: Initialized, Role: FOLLOWER
I20260812 01:09:12.813761 32099 ts_tablet_manager.cc:1397] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260812 01:09:12.814321 32094 consensus_queue.cc:260] T 9cc40b2382ae4a72b5b87b91359d2085 P 8416d51d8b614c95bbbb195dfac73fbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c57f64fe38f64cff859befc23a5b3912" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 45357 } } peers { permanent_uuid: "8416d51d8b614c95bbbb195dfac73fbc" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 44347 } } peers { permanent_uuid: "1ffd2c4c35e44953865fd1c9b414234f" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37127 } }
I20260812 01:09:12.816195 32094 ts_tablet_manager.cc:1428] T 9cc40b2382ae4a72b5b87b91359d2085 P 8416d51d8b614c95bbbb195dfac73fbc: Time spent starting tablet: real 0.017s user 0.013s sys 0.001s
I20260812 01:09:12.820803 32097 raft_consensus.cc:348] T 9cc40b2382ae4a72b5b87b91359d2085 P c57f64fe38f64cff859befc23a5b3912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c57f64fe38f64cff859befc23a5b3912" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 45357 } } peers { permanent_uuid: "8416d51d8b614c95bbbb195dfac73fbc" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 44347 } } peers { permanent_uuid: "1ffd2c4c35e44953865fd1c9b414234f" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37127 } }
I20260812 01:09:12.821201 32097 raft_consensus.cc:374] T 9cc40b2382ae4a72b5b87b91359d2085 P c57f64fe38f64cff859befc23a5b3912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:09:12.821329 32097 raft_consensus.cc:729] T 9cc40b2382ae4a72b5b87b91359d2085 P c57f64fe38f64cff859befc23a5b3912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c57f64fe38f64cff859befc23a5b3912, State: Initialized, Role: FOLLOWER
I20260812 01:09:12.821866 32097 consensus_queue.cc:260] T 9cc40b2382ae4a72b5b87b91359d2085 P c57f64fe38f64cff859befc23a5b3912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c57f64fe38f64cff859befc23a5b3912" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 45357 } } peers { permanent_uuid: "8416d51d8b614c95bbbb195dfac73fbc" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 44347 } } peers { permanent_uuid: "1ffd2c4c35e44953865fd1c9b414234f" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37127 } }
I20260812 01:09:12.821940 32099 raft_consensus.cc:348] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c57f64fe38f64cff859befc23a5b3912" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 45357 } } peers { permanent_uuid: "8416d51d8b614c95bbbb195dfac73fbc" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 44347 } } peers { permanent_uuid: "1ffd2c4c35e44953865fd1c9b414234f" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37127 } }
I20260812 01:09:12.822300 32099 raft_consensus.cc:374] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:09:12.822399 32099 raft_consensus.cc:729] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ffd2c4c35e44953865fd1c9b414234f, State: Initialized, Role: FOLLOWER
I20260812 01:09:12.823036 31854 heartbeater.cc:503] Master 127.4.201.126:34855 was elected leader, sending a full tablet report...
I20260812 01:09:12.822933 32099 consensus_queue.cc:260] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c57f64fe38f64cff859befc23a5b3912" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 45357 } } peers { permanent_uuid: "8416d51d8b614c95bbbb195dfac73fbc" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 44347 } } peers { permanent_uuid: "1ffd2c4c35e44953865fd1c9b414234f" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37127 } }
I20260812 01:09:12.823414 32097 ts_tablet_manager.cc:1428] T 9cc40b2382ae4a72b5b87b91359d2085 P c57f64fe38f64cff859befc23a5b3912: Time spent starting tablet: real 0.011s user 0.008s sys 0.004s
I20260812 01:09:12.823979 32069 heartbeater.cc:503] Master 127.4.201.126:34855 was elected leader, sending a full tablet report...
I20260812 01:09:12.824519 32099 ts_tablet_manager.cc:1428] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f: Time spent starting tablet: real 0.011s user 0.006s sys 0.004s
I20260812 01:09:12.887713 32103 raft_consensus.cc:482] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:09:12.888015 32103 raft_consensus.cc:504] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c57f64fe38f64cff859befc23a5b3912" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 45357 } } peers { permanent_uuid: "8416d51d8b614c95bbbb195dfac73fbc" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 44347 } } peers { permanent_uuid: "1ffd2c4c35e44953865fd1c9b414234f" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37127 } }
I20260812 01:09:12.889750 32103 leader_election.cc:288] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c57f64fe38f64cff859befc23a5b3912 (127.4.201.66:45357), 8416d51d8b614c95bbbb195dfac73fbc (127.4.201.65:44347)
I20260812 01:09:12.895372 32088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:12.890210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:54853 (local address 127.4.201.66:45357)
0812 01:09:12.890411 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:12.890417 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:12.890601 (+ 184us) server_negotiation.cc:407] Connection header received
0812 01:09:12.890798 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:12.890802 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:12.890865 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:12.890941 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:09:12.891351 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.892060 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.893740 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.894519 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.894658 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:12.894732 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:12.895002 (+ 270us) server_negotiation.cc:299] Negotiation successful
0812 01:09:12.895124 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 01:09:12.895377 32071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:12.890162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:45357 (local address 127.4.201.67:54853)
0812 01:09:12.890498 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:12.890517 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 01:09:12.890657 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:09:12.890996 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:09:12.891001 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:09:12.891029 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:09:12.891199 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:12.891209 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.892209 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.892215 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:12.893577 (+ 1362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:12.893598 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.894668 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.894674 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:12.894851 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:12.894877 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 01:09:12.894959 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 01:09:12.895100 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212}
I20260812 01:09:12.895934 32089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:12.890244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:44045 (local address 127.4.201.65:44347)
0812 01:09:12.890449 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:12.890455 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:12.891111 (+ 656us) server_negotiation.cc:407] Connection header received
0812 01:09:12.891281 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:12.891285 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:12.891359 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:12.891433 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:09:12.891963 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.892676 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.894341 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.895084 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.895233 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:12.895303 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:12.895623 (+ 320us) server_negotiation.cc:299] Negotiation successful
0812 01:09:12.895747 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 01:09:12.896559 32105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:12.890217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:44347 (local address 127.4.201.67:44045)
0812 01:09:12.891003 (+ 786us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:12.891017 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 01:09:12.891153 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:09:12.891467 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:09:12.891471 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:09:12.891495 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:09:12.891803 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:12.891811 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.892809 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.892813 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:12.894184 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:12.894197 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.895281 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.895287 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:12.895433 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:12.895466 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 01:09:12.896128 (+ 662us) client_negotiation.cc:240] Negotiation successful
0812 01:09:12.896257 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":668,"thread_start_us":432,"threads_started":1}
I20260812 01:09:12.896500 31790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9cc40b2382ae4a72b5b87b91359d2085" candidate_uuid: "1ffd2c4c35e44953865fd1c9b414234f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c57f64fe38f64cff859befc23a5b3912" is_pre_election: true
I20260812 01:09:12.897055 31790 raft_consensus.cc:2454] T 9cc40b2382ae4a72b5b87b91359d2085 P c57f64fe38f64cff859befc23a5b3912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ffd2c4c35e44953865fd1c9b414234f in term 0.
I20260812 01:09:12.897501 31588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9cc40b2382ae4a72b5b87b91359d2085" candidate_uuid: "1ffd2c4c35e44953865fd1c9b414234f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8416d51d8b614c95bbbb195dfac73fbc" is_pre_election: true
I20260812 01:09:12.897754 31890 leader_election.cc:302] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ffd2c4c35e44953865fd1c9b414234f, c57f64fe38f64cff859befc23a5b3912; no voters:
I20260812 01:09:12.897998 31588 raft_consensus.cc:2454] T 9cc40b2382ae4a72b5b87b91359d2085 P 8416d51d8b614c95bbbb195dfac73fbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ffd2c4c35e44953865fd1c9b414234f in term 0.
I20260812 01:09:12.898132 32103 raft_consensus.cc:2781] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:09:12.898265 32103 raft_consensus.cc:482] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:09:12.898336 32103 raft_consensus.cc:3037] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:09:12.900484 32103 raft_consensus.cc:504] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c57f64fe38f64cff859befc23a5b3912" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 45357 } } peers { permanent_uuid: "8416d51d8b614c95bbbb195dfac73fbc" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 44347 } } peers { permanent_uuid: "1ffd2c4c35e44953865fd1c9b414234f" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37127 } }
I20260812 01:09:12.901050 32103 leader_election.cc:288] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f [CANDIDATE]: Term 1 election: Requested vote from peers c57f64fe38f64cff859befc23a5b3912 (127.4.201.66:45357), 8416d51d8b614c95bbbb195dfac73fbc (127.4.201.65:44347)
I20260812 01:09:12.901425 31790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9cc40b2382ae4a72b5b87b91359d2085" candidate_uuid: "1ffd2c4c35e44953865fd1c9b414234f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c57f64fe38f64cff859befc23a5b3912"
I20260812 01:09:12.901516 31588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9cc40b2382ae4a72b5b87b91359d2085" candidate_uuid: "1ffd2c4c35e44953865fd1c9b414234f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8416d51d8b614c95bbbb195dfac73fbc"
I20260812 01:09:12.901603 31790 raft_consensus.cc:3037] T 9cc40b2382ae4a72b5b87b91359d2085 P c57f64fe38f64cff859befc23a5b3912 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:09:12.901707 31588 raft_consensus.cc:3037] T 9cc40b2382ae4a72b5b87b91359d2085 P 8416d51d8b614c95bbbb195dfac73fbc [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:09:12.903780 31790 raft_consensus.cc:2454] T 9cc40b2382ae4a72b5b87b91359d2085 P c57f64fe38f64cff859befc23a5b3912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ffd2c4c35e44953865fd1c9b414234f in term 1.
I20260812 01:09:12.903858 31588 raft_consensus.cc:2454] T 9cc40b2382ae4a72b5b87b91359d2085 P 8416d51d8b614c95bbbb195dfac73fbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ffd2c4c35e44953865fd1c9b414234f in term 1.
I20260812 01:09:12.904168 31890 leader_election.cc:302] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ffd2c4c35e44953865fd1c9b414234f, c57f64fe38f64cff859befc23a5b3912; no voters:
I20260812 01:09:12.904493 32103 raft_consensus.cc:2781] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:09:12.904919 32103 raft_consensus.cc:686] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f [term 1 LEADER]: Becoming Leader. State: Replica: 1ffd2c4c35e44953865fd1c9b414234f, State: Running, Role: LEADER
I20260812 01:09:12.905404 32103 consensus_queue.cc:237] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c57f64fe38f64cff859befc23a5b3912" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 45357 } } peers { permanent_uuid: "8416d51d8b614c95bbbb195dfac73fbc" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 44347 } } peers { permanent_uuid: "1ffd2c4c35e44953865fd1c9b414234f" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37127 } }
I20260812 01:09:12.910076 31345 catalog_manager.cc:5495] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ffd2c4c35e44953865fd1c9b414234f (127.4.201.67). New cstate: current_term: 1 leader_uuid: "1ffd2c4c35e44953865fd1c9b414234f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c57f64fe38f64cff859befc23a5b3912" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 45357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8416d51d8b614c95bbbb195dfac73fbc" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ffd2c4c35e44953865fd1c9b414234f" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37127 } health_report { overall_health: HEALTHY } } }
W20260812 01:09:12.925702 32070 tablet.cc:2369] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:09:12.926783 32092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:12.921573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50294 (local address 127.4.201.67:37127)
0812 01:09:12.921768 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:12.921774 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:12.921939 (+ 165us) server_negotiation.cc:407] Connection header received
0812 01:09:12.922102 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:12.922106 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:12.922180 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:12.922297 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:09:12.922649 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.923360 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.924642 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.925026 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.925112 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:12.925612 (+ 500us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:09:12.926292 (+ 680us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:09:12.926451 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:12.926498 (+ 47us) server_negotiation.cc:299] Negotiation successful
0812 01:09:12.926561 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 01:09:12.934463 31790 raft_consensus.cc:1261] T 9cc40b2382ae4a72b5b87b91359d2085 P c57f64fe38f64cff859befc23a5b3912 [term 1 FOLLOWER]: Refusing update from remote peer 1ffd2c4c35e44953865fd1c9b414234f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:09:12.934459 31588 raft_consensus.cc:1261] T 9cc40b2382ae4a72b5b87b91359d2085 P 8416d51d8b614c95bbbb195dfac73fbc [term 1 FOLLOWER]: Refusing update from remote peer 1ffd2c4c35e44953865fd1c9b414234f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:09:12.935400 32108 consensus_queue.cc:1035] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c57f64fe38f64cff859befc23a5b3912" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 45357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:09:12.935750 32103 consensus_queue.cc:1035] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8416d51d8b614c95bbbb195dfac73fbc" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:09:12.946110 32110 mvcc.cc:205] Tried to move back new op lower bound from 7317491519210221568 to 7317491519104356352. Current Snapshot: MvccSnapshot[applied={T|T < 7317491519210221568}]
I20260812 01:09:12.951869 32111 mvcc.cc:205] Tried to move back new op lower bound from 7317491519210221568 to 7317491519104356352. Current Snapshot: MvccSnapshot[applied={T|T < 7317491519210221568}]
I20260812 01:09:12.961671 31345 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56464:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:09:12.961927 31345 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56464:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:09:12.965305 31345 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164: Sending DeleteTablet for 3 replicas of tablet 9cc40b2382ae4a72b5b87b91359d2085
I20260812 01:09:12.966523 31761 tablet_service.cc:1514] Processing DeleteTablet for tablet 9cc40b2382ae4a72b5b87b91359d2085 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:09:12 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:35858
I20260812 01:09:12.966630 31963 tablet_service.cc:1514] Processing DeleteTablet for tablet 9cc40b2382ae4a72b5b87b91359d2085 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:09:12 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:50288
I20260812 01:09:12.966706 31547 tablet_service.cc:1514] Processing DeleteTablet for tablet 9cc40b2382ae4a72b5b87b91359d2085 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:09:12 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:48216
I20260812 01:09:12.967751 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 31407
I20260812 01:09:12.977698 32121 tablet_replica.cc:330] T 9cc40b2382ae4a72b5b87b91359d2085 P c57f64fe38f64cff859befc23a5b3912: stopping tablet replica
I20260812 01:09:12.978320 32121 raft_consensus.cc:2229] T 9cc40b2382ae4a72b5b87b91359d2085 P c57f64fe38f64cff859befc23a5b3912 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:09:12.978840 32123 tablet_replica.cc:330] T 9cc40b2382ae4a72b5b87b91359d2085 P 8416d51d8b614c95bbbb195dfac73fbc: stopping tablet replica
I20260812 01:09:12.979060 32121 raft_consensus.cc:2258] T 9cc40b2382ae4a72b5b87b91359d2085 P c57f64fe38f64cff859befc23a5b3912 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:09:12.979269 32123 raft_consensus.cc:2229] T 9cc40b2382ae4a72b5b87b91359d2085 P 8416d51d8b614c95bbbb195dfac73fbc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:09:12.979732 32123 raft_consensus.cc:2258] T 9cc40b2382ae4a72b5b87b91359d2085 P 8416d51d8b614c95bbbb195dfac73fbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:09:12.981628 32121 ts_tablet_manager.cc:1905] T 9cc40b2382ae4a72b5b87b91359d2085 P c57f64fe38f64cff859befc23a5b3912: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:09:12.981617 32123 ts_tablet_manager.cc:1905] T 9cc40b2382ae4a72b5b87b91359d2085 P 8416d51d8b614c95bbbb195dfac73fbc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:09:12.988467 32123 ts_tablet_manager.cc:1918] T 9cc40b2382ae4a72b5b87b91359d2085 P 8416d51d8b614c95bbbb195dfac73fbc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:09:12.988467 32121 ts_tablet_manager.cc:1918] T 9cc40b2382ae4a72b5b87b91359d2085 P c57f64fe38f64cff859befc23a5b3912: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:09:12.988636 32123 log.cc:1196] T 9cc40b2382ae4a72b5b87b91359d2085 P 8416d51d8b614c95bbbb195dfac73fbc: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/wal/wals/9cc40b2382ae4a72b5b87b91359d2085
I20260812 01:09:12.988889 32120 tablet_replica.cc:330] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f: stopping tablet replica
I20260812 01:09:12.989146 32123 ts_tablet_manager.cc:1939] T 9cc40b2382ae4a72b5b87b91359d2085 P 8416d51d8b614c95bbbb195dfac73fbc: Deleting consensus metadata
I20260812 01:09:12.989531 32120 raft_consensus.cc:2229] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:09:12.990257 32120 raft_consensus.cc:2258] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:09:12.990303 32089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:12.969443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48226 (local address 127.4.201.65:44347)
0812 01:09:12.969615 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:12.969622 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:12.969640 (+ 18us) server_negotiation.cc:407] Connection header received
0812 01:09:12.969697 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:12.969702 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:12.969779 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:12.969872 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:09:12.971932 (+ 2060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.973096 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.975154 (+ 2058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:12.975789 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:12.975912 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:12.981618 (+ 5706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:09:12.981635 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:09:12.981653 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:09:12.981696 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:09:12.985708 (+ 4012us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:12.986759 (+ 1051us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:12.986771 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:12.986775 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:12.987044 (+ 269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:12.987528 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:12.987533 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:12.987536 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:12.988037 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:09:12.988370 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:12.989644 (+ 1274us) server_negotiation.cc:299] Negotiation successful
0812 01:09:12.989914 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 01:09:12.991022 31655 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:09:12.991185 31325 catalog_manager.cc:4841] TS 8416d51d8b614c95bbbb195dfac73fbc (127.4.201.65:44347): tablet 9cc40b2382ae4a72b5b87b91359d2085 (table test-table [id=fca7e007ffd446e5ae080205cd7ad228]) successfully deleted
I20260812 01:09:12.993186 32120 ts_tablet_manager.cc:1905] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:09:13.001200 32120 ts_tablet_manager.cc:1918] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:09:13.001381 32121 log.cc:1196] T 9cc40b2382ae4a72b5b87b91359d2085 P c57f64fe38f64cff859befc23a5b3912: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/wal/wals/9cc40b2382ae4a72b5b87b91359d2085
I20260812 01:09:13.001566 32120 log.cc:1196] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/wal/wals/9cc40b2382ae4a72b5b87b91359d2085
I20260812 01:09:13.002048 32121 ts_tablet_manager.cc:1939] T 9cc40b2382ae4a72b5b87b91359d2085 P c57f64fe38f64cff859befc23a5b3912: Deleting consensus metadata
I20260812 01:09:13.002214 32120 ts_tablet_manager.cc:1939] T 9cc40b2382ae4a72b5b87b91359d2085 P 1ffd2c4c35e44953865fd1c9b414234f: Deleting consensus metadata
I20260812 01:09:13.004164 31325 catalog_manager.cc:4841] TS 1ffd2c4c35e44953865fd1c9b414234f (127.4.201.67:37127): tablet 9cc40b2382ae4a72b5b87b91359d2085 (table test-table [id=fca7e007ffd446e5ae080205cd7ad228]) successfully deleted
I20260812 01:09:13.004192 31322 catalog_manager.cc:4841] TS c57f64fe38f64cff859befc23a5b3912 (127.4.201.66:45357): tablet 9cc40b2382ae4a72b5b87b91359d2085 (table test-table [id=fca7e007ffd446e5ae080205cd7ad228]) successfully deleted
I20260812 01:09:13.084313 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 31407
I20260812 01:09:13.109211 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 31665
I20260812 01:09:13.127974 32088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:13.110133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35870 (local address 127.4.201.66:45357)
0812 01:09:13.110356 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:13.110362 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:13.110387 (+ 25us) server_negotiation.cc:407] Connection header received
0812 01:09:13.110457 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:13.110463 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:13.110561 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:13.110680 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:09:13.111904 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:13.113077 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:13.114393 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:13.115050 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:13.115180 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:13.121396 (+ 6216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:09:13.121417 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:09:13.121440 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:09:13.121496 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:09:13.125151 (+ 3655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:13.125893 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:13.125904 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:13.125908 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:13.126070 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:13.126381 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:13.126386 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:13.126389 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:13.126888 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:09:13.127206 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:13.127371 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 01:09:13.127613 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 01:09:13.128759 31845 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:09:13.215914 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 31665
I20260812 01:09:13.245414 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 31861
I20260812 01:09:13.259783 32092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:13.246213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50296 (local address 127.4.201.67:37127)
0812 01:09:13.246443 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:13.246449 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:13.246471 (+ 22us) server_negotiation.cc:407] Connection header received
0812 01:09:13.246652 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:13.246657 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:13.246738 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:13.246825 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:09:13.248318 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:13.249117 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:13.250429 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:13.250877 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:13.251007 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:13.253889 (+ 2882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:09:13.253902 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:09:13.253920 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:09:13.253960 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:09:13.256873 (+ 2913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:13.257638 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:13.257646 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:13.257648 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:13.257810 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:13.258281 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:13.258285 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:13.258287 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:13.258666 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:09:13.258895 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:13.259301 (+ 406us) server_negotiation.cc:299] Negotiation successful
0812 01:09:13.259461 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 01:09:13.260545 32059 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:09:13.383249 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 31861
I20260812 01:09:13.410351 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 31297
I20260812 01:09:13.411525 31399 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:09:13.525094 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 31297
I20260812 01:09:33.553701 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:34855
--webserver_interface=127.4.201.126
--webserver_port=45189
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:39755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:34855
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:09:33.903053 32129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:09:33.903313 32129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:09:33.903407 32129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:09:33.910799 32129 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 01:09:33.910888 32129 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 01:09:33.910933 32129 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 01:09:33.910990 32129 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:09:33.911043 32129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:09:33.911108 32129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:09:33.911151 32129 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:09:33.911204 32129 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:09:33.920605 32129 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:39755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:34855
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:34855
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=45189
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:09:33.921785 32129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:09:33.923043 32129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:09:33.934777 32137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:09:33.934705 32140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:09:33.934731 32138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:09:33.935510 32129 server_base.cc:1034] running on GCE node
I20260812 01:09:33.936198 32129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:09:33.937481 32129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:09:33.938687 32129 hybrid_clock.cc:648] HybridClock initialized: now 1786496973938621 us; error 45 us; skew 500 ppm
I20260812 01:09:33.938995 32129 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:09:33 dist-test-slave-bndk krb5kdc[30416](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496973, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:09:33.942042 32129 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:09:33.943424 32129 webserver.cc:460] Webserver started at http://127.4.201.126:45189/ using document root <none> and password file <none>
I20260812 01:09:33.944057 32129 fs_manager.cc:359] Metadata directory not provided
I20260812 01:09:33.944146 32129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:09:33.949396 32129 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260812 01:09:33.952131 32150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:33.953481 32129 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:09:33.953619 32129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "636ff8e3b4984c42a57202918e2d6164"
format_stamp: "Formatted at 2026-08-12 01:08:48 on dist-test-slave-bndk"
server_key: "275e479b124b785b037c88bfcdad2af0"
server_key_iv: "4470588723b28534df5865183958c899"
server_key_version: "encryptionkey@0"
I20260812 01:09:33.954545 32129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:09:33.992606 32129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:09:33.996939 32129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:09:33.997196 32129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:09:34.014912 32129 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:34855
I20260812 01:09:34.014941 32246 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:34855 every 8 connection(s)
I20260812 01:09:34.016409 32129 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:09:34.022730 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 32129
I20260812 01:09:34.023182 32247 sys_catalog.cc:263] Verifying existing consensus state
I20260812 01:09:34.023577 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:44347
--local_ip_for_outbound_sockets=127.4.201.65
--tserver_master_addrs=127.4.201.126:34855
--webserver_port=32821
--webserver_interface=127.4.201.65
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:39755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:09:34.026464 32247 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164: Bootstrap starting.
I20260812 01:09:34.046074 32247 log.cc:824] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164: Log is configured to *not* fsync() on all Append() calls
I20260812 01:09:34.062711 32247 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 01:09:34.063185 32247 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164: Bootstrap complete.
I20260812 01:09:34.071892 32247 raft_consensus.cc:348] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "636ff8e3b4984c42a57202918e2d6164" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 34855 } }
I20260812 01:09:34.072753 32247 raft_consensus.cc:729] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 636ff8e3b4984c42a57202918e2d6164, State: Initialized, Role: FOLLOWER
I20260812 01:09:34.073382 32247 consensus_queue.cc:260] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "636ff8e3b4984c42a57202918e2d6164" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 34855 } }
I20260812 01:09:34.073614 32247 raft_consensus.cc:388] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:09:34.073721 32247 raft_consensus.cc:482] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:09:34.073889 32247 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [term 2 FOLLOWER]: Advancing to term 3
I20260812 01:09:34.077538 32247 raft_consensus.cc:504] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "636ff8e3b4984c42a57202918e2d6164" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 34855 } }
I20260812 01:09:34.077986 32247 leader_election.cc:302] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 636ff8e3b4984c42a57202918e2d6164; no voters:
I20260812 01:09:34.078639 32247 leader_election.cc:288] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 01:09:34.078848 32251 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 01:09:34.079839 32251 raft_consensus.cc:686] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [term 3 LEADER]: Becoming Leader. State: Replica: 636ff8e3b4984c42a57202918e2d6164, State: Running, Role: LEADER
I20260812 01:09:34.080626 32247 sys_catalog.cc:564] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:09:34.080551 32251 consensus_queue.cc:237] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "636ff8e3b4984c42a57202918e2d6164" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 34855 } }
I20260812 01:09:34.089056 32253 sys_catalog.cc:455] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 636ff8e3b4984c42a57202918e2d6164. Latest consensus state: current_term: 3 leader_uuid: "636ff8e3b4984c42a57202918e2d6164" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "636ff8e3b4984c42a57202918e2d6164" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 34855 } } }
I20260812 01:09:34.089434 32253 sys_catalog.cc:458] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [sys.catalog]: This master's current role is: LEADER
I20260812 01:09:34.084679 32252 sys_catalog.cc:455] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "636ff8e3b4984c42a57202918e2d6164" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "636ff8e3b4984c42a57202918e2d6164" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 34855 } } }
I20260812 01:09:34.090168 32252 sys_catalog.cc:458] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164 [sys.catalog]: This master's current role is: LEADER
I20260812 01:09:34.096290 32260 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:09:34.106801 32260 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:09:34.108379 32260 catalog_manager.cc:1259] Loaded cluster ID: 223cf21027904ea6b2017892b30e6366
I20260812 01:09:34.108577 32260 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:09:34.112635 32260 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:09:34.114445 32260 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164: Loaded TSK: 0
I20260812 01:09:34.114702 32260 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 636ff8e3b4984c42a57202918e2d6164: Loaded TSK: 1
F20260812 01:09:34.115953 32260 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f9b34a129ad google::LogMessage::Fail() at ??:0
@ 0x7f9b34a1588a google::LogMessage::SendToLog() at ??:0
@ 0x7f9b34a124de google::LogMessage::Flush() at ??:0
@ 0x7f9b34a13a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f9b387767d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f9b3876573e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f9b4a4411c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f9b4a440783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f9b4a4cc2a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f9b4a4cc0c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f9b4a5165e9 std::function<>::operator()() at ??:0
@ 0x7f9b4a444cdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f9b4a442c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f9b4a4ca610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f9b4a4ca439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f9b3765e345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f9b3766191c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f9b37661799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f9b3763ceaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f9b3a9166db start_thread at ??:0
@ 0x7f9b338ac61f clone at ??:0
W20260812 01:09:34.420943 32249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:09:34.421190 32249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:09:34.421341 32249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:09:34.428355 32249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:09:34.428454 32249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:09:34.428603 32249 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:09:34.437903 32249 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:39755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:44347
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=32821
--tserver_master_addrs=127.4.201.126:34855
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:09:34.439033 32249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:09:34.440263 32249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:09:34.452924 32322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:09:34.452975 32316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:09:34.453047 32325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:09:34.453665 32249 server_base.cc:1034] running on GCE node
I20260812 01:09:34.454195 32249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:09:34.455042 32249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:09:34.456231 32249 hybrid_clock.cc:648] HybridClock initialized: now 1786496974456181 us; error 40 us; skew 500 ppm
I20260812 01:09:34.456523 32249 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:09:34 dist-test-slave-bndk krb5kdc[30416](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496974, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:09:34.459540 32249 init.cc:377] Logged in from keytab as kudu/127.4.201.65@KRBTEST.COM (short username kudu)
I20260812 01:09:34.460897 32249 webserver.cc:460] Webserver started at http://127.4.201.65:32821/ using document root <none> and password file <none>
I20260812 01:09:34.461578 32249 fs_manager.cc:359] Metadata directory not provided
I20260812 01:09:34.461683 32249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:09:34.466744 32249 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260812 01:09:34.469379 32334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:34.470623 32249 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 01:09:34.470759 32249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "8416d51d8b614c95bbbb195dfac73fbc"
format_stamp: "Formatted at 2026-08-12 01:08:48 on dist-test-slave-bndk"
server_key: "2601c01431c9e2e95f98c9aca0df47b7"
server_key_iv: "8818745bbb5c136dc372e2bccd2f709c"
server_key_version: "encryptionkey@0"
I20260812 01:09:34.471769 32249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:09:34.497696 32249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:09:34.502177 32249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:09:34.502411 32249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:09:34.503409 32249 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:09:34.504729 32249 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:09:34.504818 32249 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:34.504911 32249 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:09:34.504966 32249 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:34.535717 32249 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:44347
I20260812 01:09:34.535785 32521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:44347 every 8 connection(s)
I20260812 01:09:34.537120 32249 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:09:34.542279 32526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:34.540114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.65:39117)
0812 01:09:34.540884 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:34.541165 (+ 281us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":310,"threads_started":1}
I20260812 01:09:34.542682 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 32249
W20260812 01:09:34.542994 32523 heartbeater.cc:644] Failed to heartbeat to 127.4.201.126:34855 (0 consecutive failures): Network error: Failed to ping master at 127.4.201.126:34855: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
I20260812 01:09:34.543371 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:45357
--local_ip_for_outbound_sockets=127.4.201.66
--tserver_master_addrs=127.4.201.126:34855
--webserver_port=44025
--webserver_interface=127.4.201.66
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:39755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:09:34.543804 32526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:34.543447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.65:60915)
0812 01:09:34.543640 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:34.543704 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260812 01:09:34.544595 32526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:34.544277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.65:39437)
0812 01:09:34.544412 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:34.544488 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260812 01:09:34.544811 32523 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 01:09:34.877163 32527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:09:34.877444 32527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:09:34.877578 32527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:09:34.884586 32527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:09:34.884680 32527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:09:34.884820 32527 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:09:34.894265 32527 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:39755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:45357
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=44025
--tserver_master_addrs=127.4.201.126:34855
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:09:34.895535 32527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:09:34.896795 32527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:09:34.910979 32541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:09:34.911036 32538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:09:34.911060 32539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:09:34.911824 32527 server_base.cc:1034] running on GCE node
I20260812 01:09:34.912413 32527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:09:34.913311 32527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:09:34.914513 32527 hybrid_clock.cc:648] HybridClock initialized: now 1786496974914463 us; error 42 us; skew 500 ppm
I20260812 01:09:34.914812 32527 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:09:34 dist-test-slave-bndk krb5kdc[30416](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496974, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:09:34.917790 32527 init.cc:377] Logged in from keytab as kudu/127.4.201.66@KRBTEST.COM (short username kudu)
I20260812 01:09:34.919134 32527 webserver.cc:460] Webserver started at http://127.4.201.66:44025/ using document root <none> and password file <none>
I20260812 01:09:34.919728 32527 fs_manager.cc:359] Metadata directory not provided
I20260812 01:09:34.919827 32527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:09:34.924880 32527 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 01:09:34.927423 32552 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:34.928603 32527 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260812 01:09:34.928754 32527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "c57f64fe38f64cff859befc23a5b3912"
format_stamp: "Formatted at 2026-08-12 01:08:49 on dist-test-slave-bndk"
server_key: "e0fde74e1e93bf2be421f7d8a3625e50"
server_key_iv: "a7f807016553118aa19b68fc1751ccb4"
server_key_version: "encryptionkey@0"
I20260812 01:09:34.929728 32527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:09:34.958039 32527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:09:34.962112 32527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:09:34.962352 32527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:09:34.963258 32527 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:09:34.964540 32527 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:09:34.964634 32527 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:34.964740 32527 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:09:34.964809 32527 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:34.996075 32527 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:45357
I20260812 01:09:34.996145 32732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:45357 every 8 connection(s)
I20260812 01:09:34.997526 32527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:09:35.002159 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 32527
I20260812 01:09:35.002193 32736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:35.000354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.66:38033)
0812 01:09:35.001076 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:35.001358 (+ 282us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":266,"threads_started":1}
I20260812 01:09:35.002833 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:37127
--local_ip_for_outbound_sockets=127.4.201.67
--tserver_master_addrs=127.4.201.126:34855
--webserver_port=35675
--webserver_interface=127.4.201.67
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:39755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:09:35.002943 32734 heartbeater.cc:644] Failed to heartbeat to 127.4.201.126:34855 (0 consecutive failures): Network error: Failed to ping master at 127.4.201.126:34855: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
I20260812 01:09:35.003772 32736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:35.003439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.66:51185)
0812 01:09:35.003595 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:35.003666 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260812 01:09:35.004619 32736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:35.004280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.66:58327)
0812 01:09:35.004419 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:35.004503 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260812 01:09:35.004844 32734 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 01:09:35.333181 32738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:09:35.333488 32738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:09:35.333642 32738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:09:35.340847 32738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:09:35.340960 32738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:09:35.341122 32738 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:09:35.351559 32738 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:39755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:37127
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=35675
--tserver_master_addrs=127.4.201.126:34855
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:09:35.352919 32738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:09:35.354296 32738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:09:35.367259 32745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:09:35.367292 32744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:09:35.367323 32749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:09:35.368032 32738 server_base.cc:1034] running on GCE node
I20260812 01:09:35.368611 32738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:09:35.369583 32738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:09:35.370779 32738 hybrid_clock.cc:648] HybridClock initialized: now 1786496975370718 us; error 53 us; skew 500 ppm
I20260812 01:09:35.371066 32738 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:09:35 dist-test-slave-bndk krb5kdc[30416](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496975, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:09:35.374104 32738 init.cc:377] Logged in from keytab as kudu/127.4.201.67@KRBTEST.COM (short username kudu)
I20260812 01:09:35.375564 32738 webserver.cc:460] Webserver started at http://127.4.201.67:35675/ using document root <none> and password file <none>
I20260812 01:09:35.376284 32738 fs_manager.cc:359] Metadata directory not provided
I20260812 01:09:35.376394 32738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:09:35.381790 32738 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:09:35.384546 32758 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:35.385895 32738 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:09:35.386049 32738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "1ffd2c4c35e44953865fd1c9b414234f"
format_stamp: "Formatted at 2026-08-12 01:08:49 on dist-test-slave-bndk"
server_key: "34376327023bfe162df40e4af1c3002b"
server_key_iv: "cf5f7aeffffbd05ef9d5a02310c1127c"
server_key_version: "encryptionkey@0"
I20260812 01:09:35.386967 32738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:09:35.409017 32738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:09:35.413057 32738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:09:35.413297 32738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:09:35.414191 32738 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:09:35.415439 32738 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:09:35.415536 32738 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:35.415613 32738 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:09:35.415668 32738 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:35.446013 32738 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:37127
I20260812 01:09:35.446090 465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:37127 every 8 connection(s)
I20260812 01:09:35.447413 32738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:09:35.451376 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 32738
I20260812 01:09:35.452260 468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:35.450272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.67:58803)
0812 01:09:35.451035 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:35.451281 (+ 246us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":284,"threads_started":1}
W20260812 01:09:35.452993 466 heartbeater.cc:644] Failed to heartbeat to 127.4.201.126:34855 (0 consecutive failures): Network error: Failed to ping master at 127.4.201.126:34855: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
I20260812 01:09:35.453784 468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:35.453493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.67:34811)
0812 01:09:35.453619 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:35.453683 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260812 01:09:35.454526 468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:35.454245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.67:49731)
0812 01:09:35.454351 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:35.454423 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260812 01:09:35.454726 466 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 01:09:35.546092 470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:35.545348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.65:47055)
0812 01:09:35.545768 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:35.545854 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":198,"threads_started":1}
I20260812 01:09:36.006242 471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:36.005442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.66:56119)
0812 01:09:36.005917 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:36.006014 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":222,"threads_started":1}
I20260812 01:09:36.455909 473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:36.455201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.67:40099)
0812 01:09:36.455614 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:36.455698 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":197,"threads_started":1}
I20260812 01:09:36.547621 480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:36.546933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.65:56373)
0812 01:09:36.547368 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:36.547448 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":214,"threads_started":1}
I20260812 01:09:37.007773 481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:37.007076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.66:48165)
0812 01:09:37.007524 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:37.007607 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":216,"threads_started":1}
I20260812 01:09:37.457378 482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:37.456690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.67:36389)
0812 01:09:37.457118 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:37.457196 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":204,"threads_started":1}
I20260812 01:09:37.549041 483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:37.548380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.65:53219)
0812 01:09:37.548795 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:37.548874 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":219,"threads_started":1}
I20260812 01:09:38.009351 484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:38.008616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.66:42185)
0812 01:09:38.009057 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:38.009141 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":233,"threads_started":1}
I20260812 01:09:38.458801 485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:38.458128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.67:49503)
0812 01:09:38.458551 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:38.458628 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":216,"threads_started":1}
I20260812 01:09:38.550537 486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:38.549806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.65:47517)
0812 01:09:38.550263 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:38.550349 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":226,"threads_started":1}
I20260812 01:09:39.010916 487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:39.010191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.66:43805)
0812 01:09:39.010645 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:39.010728 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":229,"threads_started":1}
I20260812 01:09:39.460268 488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:39.459565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.67:52289)
0812 01:09:39.459999 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:39.460078 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":200,"threads_started":1}
I20260812 01:09:39.552085 489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:39.551351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.65:44283)
0812 01:09:39.551808 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:39.551888 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":227,"threads_started":1}
I20260812 01:09:40.012562 490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:40.011838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.66:42141)
0812 01:09:40.012299 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:40.012382 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":250,"threads_started":1}
I20260812 01:09:40.461804 492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:40.461080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.67:43305)
0812 01:09:40.461561 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:40.461639 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":253,"threads_started":1}
I20260812 01:09:40.553610 494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:40.552873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.65:48159)
0812 01:09:40.553356 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:40.553441 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":265,"threads_started":1}
I20260812 01:09:41.014159 496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:41.013436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.66:43793)
0812 01:09:41.013885 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:41.013991 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":237,"threads_started":1}
I20260812 01:09:41.463250 497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:41.462559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.67:46565)
0812 01:09:41.463003 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:41.463092 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":216,"threads_started":1}
I20260812 01:09:41.555390 498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:41.554543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.65:60879)
0812 01:09:41.555073 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:41.555164 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":211,"threads_started":1}
I20260812 01:09:42.015843 499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:42.015010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.66:50251)
0812 01:09:42.015535 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:42.015625 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":213,"threads_started":1}
I20260812 01:09:42.464828 500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:42.464061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.67:54839)
0812 01:09:42.464538 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:42.464620 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":197,"threads_started":1}
I20260812 01:09:42.557060 502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:42.556184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.65:39905)
0812 01:09:42.556736 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:42.556848 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":249,"threads_started":1}
I20260812 01:09:43.017392 503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:43.016685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.66:46133)
0812 01:09:43.017126 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:43.017206 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":219,"threads_started":1}
I20260812 01:09:43.466315 504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:43.465660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.67:45759)
0812 01:09:43.466084 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:43.466163 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":224,"threads_started":1}
I20260812 01:09:43.558635 506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:43.557887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.65:36821)
0812 01:09:43.558374 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:43.558452 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":240,"threads_started":1}
I20260812 01:09:44.018937 509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:44.018205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.66:49685)
0812 01:09:44.018657 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:44.018767 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":214,"threads_started":1}
I20260812 01:09:44.467919 510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:44.467162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.67:52045)
0812 01:09:44.467651 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:44.467743 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":229,"threads_started":1}
I20260812 01:09:44.560245 511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:44.559534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.65:48431)
0812 01:09:44.560006 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:44.560087 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":254,"threads_started":1}
I20260812 01:09:45.020421 512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:45.019761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.66:34513)
0812 01:09:45.020183 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:45.020265 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":231,"threads_started":1}
I20260812 01:09:45.469449 514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:45.468757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.67:41661)
0812 01:09:45.469167 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:45.469282 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":204,"threads_started":1}
I20260812 01:09:45.561786 515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:45.561043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.65:48941)
0812 01:09:45.561511 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:45.561609 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":239,"threads_started":1}
I20260812 01:09:46.022040 516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:46.021308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.66:44669)
0812 01:09:46.021763 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:46.021856 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":223,"threads_started":1}
I20260812 01:09:46.471019 519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:46.470305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.67:47393)
0812 01:09:46.470729 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:46.470820 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":218,"threads_started":1}
I20260812 01:09:46.563304 523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:46.562614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.65:34697)
0812 01:09:46.563067 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:46.563150 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":230,"threads_started":1}
I20260812 01:09:47.023582 525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:47.022915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.66:46025)
0812 01:09:47.023347 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:47.023427 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":225,"threads_started":1}
I20260812 01:09:47.472642 526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:47.471964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.67:33615)
0812 01:09:47.472396 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:47.472478 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":217,"threads_started":1}
I20260812 01:09:47.564994 527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:47.564182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.65:46457)
0812 01:09:47.564707 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:47.564803 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":265,"threads_started":1}
I20260812 01:09:48.025187 528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:48.024451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.66:55875)
0812 01:09:48.024902 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:48.025000 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":214,"threads_started":1}
I20260812 01:09:48.474303 529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:48.473530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.67:60819)
0812 01:09:48.474001 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:48.474114 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":239,"threads_started":1}
I20260812 01:09:48.566617 531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:48.565876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.65:44981)
0812 01:09:48.566323 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:48.566432 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":224,"threads_started":1}
I20260812 01:09:49.026755 532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:49.026052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.66:34275)
0812 01:09:49.026477 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:49.026573 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":218,"threads_started":1}
I20260812 01:09:49.476006 533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:49.475204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.67:60735)
0812 01:09:49.475733 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:49.475817 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":302,"threads_started":1}
I20260812 01:09:49.568377 536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:49.567650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.65:44841)
0812 01:09:49.568097 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:49.568205 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":221,"threads_started":1}
I20260812 01:09:50.028522 537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:50.027784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.66:49987)
0812 01:09:50.028235 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:50.028325 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":225,"threads_started":1}
I20260812 01:09:50.460419 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 32249
I20260812 01:09:50.477841 540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:50.477084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:34855 (local address 127.4.201.67:45207)
0812 01:09:50.477558 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:50.477666 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.126:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":260,"threads_started":1}
I20260812 01:09:50.482439 539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:50.461586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50008 (local address 127.4.201.65:44347)
0812 01:09:50.462156 (+ 570us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:50.462177 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:50.462231 (+ 54us) server_negotiation.cc:407] Connection header received
0812 01:09:50.464012 (+ 1781us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:50.464023 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:50.464467 (+ 444us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:50.464769 (+ 302us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:09:50.466204 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:50.467500 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:50.468749 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:50.469496 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:50.469632 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:50.475465 (+ 5833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:09:50.475473 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:09:50.475506 (+ 33us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:09:50.475564 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:09:50.479532 (+ 3968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:50.480159 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:50.480165 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:50.480172 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:50.480346 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:50.480647 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:50.480650 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:50.480652 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:50.481159 (+ 507us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:09:50.481464 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:50.481783 (+ 319us) server_negotiation.cc:299] Negotiation successful
0812 01:09:50.482176 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":244,"threads_started":1}
I20260812 01:09:50.483799 32514 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:09:50.570181 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 32249
I20260812 01:09:50.594686 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 32527
I20260812 01:09:50.612458 544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:50.595673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50326 (local address 127.4.201.66:45357)
0812 01:09:50.596346 (+ 673us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:50.596361 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:50.596402 (+ 41us) server_negotiation.cc:407] Connection header received
0812 01:09:50.598075 (+ 1673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:50.598086 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:50.598531 (+ 445us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:50.598898 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:09:50.600539 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:50.601884 (+ 1345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:50.603126 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:50.603780 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:50.603954 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:50.606540 (+ 2586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:09:50.606548 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:09:50.606562 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:09:50.606601 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:09:50.609373 (+ 2772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:50.609998 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:50.610005 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:50.610012 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:50.610177 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:50.610532 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:50.610537 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:50.610540 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:50.611025 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:09:50.611326 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:50.611779 (+ 453us) server_negotiation.cc:299] Negotiation successful
0812 01:09:50.612175 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":506,"thread_start_us":390,"threads_started":1}
I20260812 01:09:50.613857 32728 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:09:50.697660 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 32527
I20260812 01:09:50.719044 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 32738
I20260812 01:09:50.736877 550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:50.720005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47864 (local address 127.4.201.67:37127)
0812 01:09:50.720645 (+ 640us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:50.720660 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:50.720713 (+ 53us) server_negotiation.cc:407] Connection header received
0812 01:09:50.722461 (+ 1748us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:50.722471 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:50.722891 (+ 420us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:50.723219 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:09:50.724666 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:50.726089 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:50.727398 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:50.728033 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:50.728200 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:50.730696 (+ 2496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:09:50.730704 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:09:50.730719 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:09:50.730756 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:09:50.733663 (+ 2907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:50.734333 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:50.734340 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:50.734346 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:50.734534 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:50.734906 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:50.734910 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:50.734912 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:50.735412 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:09:50.735720 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:50.736151 (+ 431us) server_negotiation.cc:299] Negotiation successful
0812 01:09:50.736580 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":258,"threads_started":1}
I20260812 01:09:50.738366 457 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:09:50.823937 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 32738
2026-08-12T01:09:50Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (64482 ms)
[----------] 30 tests from SecurityITest (300821 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:09:50 dist-test-slave-bndk krb5kdc[556](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:09:50 dist-test-slave-bndk krb5kdc[556](info): set up 2 sockets
Aug 12 01:09:50 dist-test-slave-bndk krb5kdc[556](info): commencing operation
krb5kdc: starting...
W20260812 01:09:52.068246 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.198s user 0.000s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:09:52 dist-test-slave-bndk krb5kdc[556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496992, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:09:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:09:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.201.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
I20260812 01:09:52.359385 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:36869
--webserver_interface=127.4.201.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:41847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:36869
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:09:52.701196 574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:09:52.701508 574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:09:52.701640 574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:09:52.708630 574 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:09:52.708729 574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:09:52.708803 574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:09:52.708884 574 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:09:52.708942 574 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:09:52.718542 574 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:41847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:36869
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:36869
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:09:52.719765 574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:09:52.721055 574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:09:52.732460 583 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:09:52.732580 580 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:09:52.732616 586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:09:52.733426 574 server_base.cc:1034] running on GCE node
I20260812 01:09:52.734169 574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:09:52.735488 574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:09:52.736704 574 hybrid_clock.cc:648] HybridClock initialized: now 1786496992736660 us; error 26 us; skew 500 ppm
I20260812 01:09:52.737047 574 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:09:52 dist-test-slave-bndk krb5kdc[556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496992, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:09:52.739995 574 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:09:52.741451 574 webserver.cc:460] Webserver started at http://127.4.201.126:41923/ using document root <none> and password file <none>
I20260812 01:09:52.742100 574 fs_manager.cc:359] Metadata directory not provided
I20260812 01:09:52.742215 574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:09:52.742516 574 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:09:52.745430 574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "c9422648d7ec4e789aa1885d3c59db51"
format_stamp: "Formatted at 2026-08-12 01:09:52 on dist-test-slave-bndk"
server_key: "35f824fcd6f266b9ca6150a296c4e49a"
server_key_iv: "62990a36847ffe3370d785fea4759470"
server_key_version: "encryptionkey@0"
I20260812 01:09:52.746157 574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "c9422648d7ec4e789aa1885d3c59db51"
format_stamp: "Formatted at 2026-08-12 01:09:52 on dist-test-slave-bndk"
server_key: "35f824fcd6f266b9ca6150a296c4e49a"
server_key_iv: "62990a36847ffe3370d785fea4759470"
server_key_version: "encryptionkey@0"
I20260812 01:09:52.751075 574 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 01:09:52.754383 594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:52.755586 574 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 01:09:52.755738 574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "c9422648d7ec4e789aa1885d3c59db51"
format_stamp: "Formatted at 2026-08-12 01:09:52 on dist-test-slave-bndk"
server_key: "35f824fcd6f266b9ca6150a296c4e49a"
server_key_iv: "62990a36847ffe3370d785fea4759470"
server_key_version: "encryptionkey@0"
I20260812 01:09:52.755916 574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:09:52.776186 574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:09:52.779836 574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:09:52.780088 574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:09:52.797539 574 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:36869
I20260812 01:09:52.797549 676 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:36869 every 8 connection(s)
I20260812 01:09:52.798830 574 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:09:52.802444 677 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:09:52.807649 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 574
I20260812 01:09:52.807839 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:09:52.808486 4901 external_mini_cluster.cc:1428] Setting key 1fd20ed6fcd84c93e04b7a88bceeceb0
I20260812 01:09:52.813839 677 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9422648d7ec4e789aa1885d3c59db51: Bootstrap starting.
I20260812 01:09:52.817446 677 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c9422648d7ec4e789aa1885d3c59db51: Neither blocks nor log segments found. Creating new log.
I20260812 01:09:52.818559 677 log.cc:824] T 00000000000000000000000000000000 P c9422648d7ec4e789aa1885d3c59db51: Log is configured to *not* fsync() on all Append() calls
I20260812 01:09:52.821455 677 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9422648d7ec4e789aa1885d3c59db51: No bootstrap required, opened a new log
Aug 12 01:09:52 dist-test-slave-bndk krb5kdc[556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496992, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:09:52.831120 677 raft_consensus.cc:348] T 00000000000000000000000000000000 P c9422648d7ec4e789aa1885d3c59db51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9422648d7ec4e789aa1885d3c59db51" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 36869 } }
I20260812 01:09:52.831610 677 raft_consensus.cc:374] T 00000000000000000000000000000000 P c9422648d7ec4e789aa1885d3c59db51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:09:52.831722 677 raft_consensus.cc:729] T 00000000000000000000000000000000 P c9422648d7ec4e789aa1885d3c59db51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9422648d7ec4e789aa1885d3c59db51, State: Initialized, Role: FOLLOWER
I20260812 01:09:52.832401 677 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9422648d7ec4e789aa1885d3c59db51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9422648d7ec4e789aa1885d3c59db51" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 36869 } }
I20260812 01:09:52.832715 680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:52.810468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42722 (local address 127.4.201.126:36869)
0812 01:09:52.811308 (+ 840us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:52.811324 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:52.811374 (+ 50us) server_negotiation.cc:407] Connection header received
0812 01:09:52.813695 (+ 2321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:52.813724 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:52.814185 (+ 461us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:52.814606 (+ 421us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:09:52.815930 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:52.817913 (+ 1983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:52.819326 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:52.820183 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:52.820349 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:52.824345 (+ 3996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:09:52.824355 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:09:52.824373 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:09:52.824426 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:09:52.828361 (+ 3935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:52.829045 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:52.829054 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:52.829063 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:52.829313 (+ 250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:52.829667 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:52.829672 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:52.829676 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:52.830355 (+ 679us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:09:52.830644 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:52.830950 (+ 306us) server_negotiation.cc:299] Negotiation successful
0812 01:09:52.831385 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":563,"thread_start_us":324,"threads_started":1}
I20260812 01:09:52.832712 677 raft_consensus.cc:388] T 00000000000000000000000000000000 P c9422648d7ec4e789aa1885d3c59db51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:09:52.832926 677 raft_consensus.cc:482] T 00000000000000000000000000000000 P c9422648d7ec4e789aa1885d3c59db51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:09:52.833122 677 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c9422648d7ec4e789aa1885d3c59db51 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:09:52.835445 677 raft_consensus.cc:504] T 00000000000000000000000000000000 P c9422648d7ec4e789aa1885d3c59db51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9422648d7ec4e789aa1885d3c59db51" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 36869 } }
I20260812 01:09:52.835908 677 leader_election.cc:302] T 00000000000000000000000000000000 P c9422648d7ec4e789aa1885d3c59db51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c9422648d7ec4e789aa1885d3c59db51; no voters:
I20260812 01:09:52.836472 677 leader_election.cc:288] T 00000000000000000000000000000000 P c9422648d7ec4e789aa1885d3c59db51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:09:52.836591 682 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c9422648d7ec4e789aa1885d3c59db51 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:09:52.837205 682 raft_consensus.cc:686] T 00000000000000000000000000000000 P c9422648d7ec4e789aa1885d3c59db51 [term 1 LEADER]: Becoming Leader. State: Replica: c9422648d7ec4e789aa1885d3c59db51, State: Running, Role: LEADER
I20260812 01:09:52.837795 682 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9422648d7ec4e789aa1885d3c59db51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9422648d7ec4e789aa1885d3c59db51" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 36869 } }
I20260812 01:09:52.838376 677 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9422648d7ec4e789aa1885d3c59db51 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:09:52.840792 685 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9422648d7ec4e789aa1885d3c59db51 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9422648d7ec4e789aa1885d3c59db51. Latest consensus state: current_term: 1 leader_uuid: "c9422648d7ec4e789aa1885d3c59db51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9422648d7ec4e789aa1885d3c59db51" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 36869 } } }
I20260812 01:09:52.841189 685 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9422648d7ec4e789aa1885d3c59db51 [sys.catalog]: This master's current role is: LEADER
I20260812 01:09:52.842187 683 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9422648d7ec4e789aa1885d3c59db51 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c9422648d7ec4e789aa1885d3c59db51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9422648d7ec4e789aa1885d3c59db51" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 36869 } } }
I20260812 01:09:52.842615 683 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9422648d7ec4e789aa1885d3c59db51 [sys.catalog]: This master's current role is: LEADER
I20260812 01:09:52.854768 692 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:09:52.860411 692 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:09:52.871526 692 catalog_manager.cc:1347] Generated new cluster ID: e129a850c20f4fa7a86c37cf0d1e32d7
I20260812 01:09:52.871644 692 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:09:52.878582 692 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:09:52.879787 692 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:09:52.901080 692 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c9422648d7ec4e789aa1885d3c59db51: Generated new TSK 0
I20260812 01:09:52.901988 692 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.201.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
I20260812 01:09:52.981247 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:0
--local_ip_for_outbound_sockets=127.4.201.65
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:36869
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:41847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:09:53.319586 716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:09:53.319871 716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:09:53.319999 716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:09:53.327289 716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:09:53.327416 716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:09:53.327566 716 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:09:53.337914 716 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:41847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:36869
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:09:53.339298 716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:09:53.340674 716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:09:53.353720 723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:09:53.353808 725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:09:53.353824 730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:09:53.354635 716 server_base.cc:1034] running on GCE node
I20260812 01:09:53.355201 716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:09:53.356182 716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:09:53.357374 716 hybrid_clock.cc:648] HybridClock initialized: now 1786496993357340 us; error 64 us; skew 500 ppm
I20260812 01:09:53.357671 716 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:09:53 dist-test-slave-bndk krb5kdc[556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496993, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:09:53.360831 716 init.cc:377] Logged in from keytab as kudu/127.4.201.65@KRBTEST.COM (short username kudu)
I20260812 01:09:53.362305 716 webserver.cc:460] Webserver started at http://127.4.201.65:46275/ using document root <none> and password file <none>
I20260812 01:09:53.362963 716 fs_manager.cc:359] Metadata directory not provided
I20260812 01:09:53.363066 716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:09:53.363332 716 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:09:53.366282 716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-0/data/instance:
uuid: "c156be4fee524951bd5db2af9fc981f7"
format_stamp: "Formatted at 2026-08-12 01:09:53 on dist-test-slave-bndk"
server_key: "f39c5e933fef01bd328bdf6e3e4caca7"
server_key_iv: "f02ea557f7685bacf6735a6af5b319d8"
server_key_version: "encryptionkey@0"
I20260812 01:09:53.367033 716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance:
uuid: "c156be4fee524951bd5db2af9fc981f7"
format_stamp: "Formatted at 2026-08-12 01:09:53 on dist-test-slave-bndk"
server_key: "f39c5e933fef01bd328bdf6e3e4caca7"
server_key_iv: "f02ea557f7685bacf6735a6af5b319d8"
server_key_version: "encryptionkey@0"
I20260812 01:09:53.372359 716 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 01:09:53.375766 737 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:53.377036 716 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 01:09:53.377172 716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "c156be4fee524951bd5db2af9fc981f7"
format_stamp: "Formatted at 2026-08-12 01:09:53 on dist-test-slave-bndk"
server_key: "f39c5e933fef01bd328bdf6e3e4caca7"
server_key_iv: "f02ea557f7685bacf6735a6af5b319d8"
server_key_version: "encryptionkey@0"
I20260812 01:09:53.377389 716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:09:53.393640 716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:09:53.397430 716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:09:53.397675 716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:09:53.398617 716 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:09:53.399998 716 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:09:53.400074 716 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:53.400192 716 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:09:53.400243 716 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:53.430794 716 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:34333
I20260812 01:09:53.430845 918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:34333 every 8 connection(s)
I20260812 01:09:53.432106 716 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:09:53.440387 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 716
I20260812 01:09:53.440601 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance
I20260812 01:09:53.441337 4901 external_mini_cluster.cc:1428] Setting key d9b674b915c52b9718a1f5441466868d
Aug 12 01:09:53 dist-test-slave-bndk krb5kdc[556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496993, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:09:53.452203 921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:53.434638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:58013 (local address 127.4.201.126:36869)
0812 01:09:53.435121 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:53.435128 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:53.436069 (+ 941us) server_negotiation.cc:407] Connection header received
0812 01:09:53.437927 (+ 1858us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:53.437931 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:53.438001 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:53.438093 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:09:53.439635 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:53.440684 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:53.442312 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:53.442909 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:53.443039 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:53.446688 (+ 3649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:09:53.446693 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:09:53.446696 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:09:53.446727 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:09:53.449151 (+ 2424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:53.449958 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:53.449961 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:53.449964 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:53.450083 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:53.450514 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:53.450517 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:53.450519 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:53.450757 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:09:53.450876 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:53.451684 (+ 808us) server_negotiation.cc:299] Negotiation successful
0812 01:09:53.451883 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":224,"threads_started":1}
I20260812 01:09:53.453379 930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:53.435169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:36869 (local address 127.4.201.65:58013)
0812 01:09:53.435904 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:53.435941 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 01:09:53.437677 (+ 1736us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:09:53.438309 (+ 632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:09:53.438316 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:09:53.438880 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:09:53.439475 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:53.439503 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:53.440844 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:53.440848 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:53.442171 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:53.442187 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:53.443139 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:53.443147 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:53.443365 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:53.444003 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:09:53.444025 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:09:53.446475 (+ 2450us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:09:53.449309 (+ 2834us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:09:53.449317 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:09:53.449333 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:09:53.449843 (+ 510us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:09:53.450178 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:09:53.450182 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:09:53.450186 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:09:53.450412 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:09:53.450875 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:09:53.450882 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:09:53.451274 (+ 392us) client_negotiation.cc:769] Sending connection context
0812 01:09:53.451612 (+ 338us) client_negotiation.cc:240] Negotiation successful
0812 01:09:53.452102 (+ 490us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":285,"threads_started":1}
I20260812 01:09:53.454805 919 heartbeater.cc:347] Connected to a master server at 127.4.201.126:36869
I20260812 01:09:53.455097 919 heartbeater.cc:464] Registering TS with master...
I20260812 01:09:53.455842 919 heartbeater.cc:511] Master 127.4.201.126:36869 requested a full tablet report, sending...
I20260812 01:09:53.458259 619 ts_manager.cc:194] Registered new tserver with Master: c156be4fee524951bd5db2af9fc981f7 (127.4.201.65:34333)
I20260812 01:09:53.459769 619 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.65@KRBTEST.COM'} at 127.4.201.65:58013
WARNING: no policy specified for kudu/127.4.201.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
I20260812 01:09:53.505828 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:0
--local_ip_for_outbound_sockets=127.4.201.66
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:36869
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:41847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:09:53.863639 933 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:09:53.863890 933 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:09:53.864022 933 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:09:53.871093 933 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:09:53.871194 933 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:09:53.871361 933 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:09:53.880877 933 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:41847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:36869
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:09:53.882241 933 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:09:53.883524 933 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:09:53.896186 947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:09:53.896253 953 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:09:53.896490 946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:09:53.897619 933 server_base.cc:1034] running on GCE node
I20260812 01:09:53.898233 933 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:09:53.899145 933 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:09:53.900347 933 hybrid_clock.cc:648] HybridClock initialized: now 1786496993900302 us; error 30 us; skew 500 ppm
I20260812 01:09:53.900655 933 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:09:53 dist-test-slave-bndk krb5kdc[556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496993, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:09:53.903739 933 init.cc:377] Logged in from keytab as kudu/127.4.201.66@KRBTEST.COM (short username kudu)
I20260812 01:09:53.905071 933 webserver.cc:460] Webserver started at http://127.4.201.66:34399/ using document root <none> and password file <none>
I20260812 01:09:53.905747 933 fs_manager.cc:359] Metadata directory not provided
I20260812 01:09:53.905848 933 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:09:53.906118 933 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:09:53.909195 933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-1/data/instance:
uuid: "13e0feaa0abf40419260cbf92df005d7"
format_stamp: "Formatted at 2026-08-12 01:09:53 on dist-test-slave-bndk"
server_key: "fd54c753257752bec7820b2e7fcaeeeb"
server_key_iv: "67fd6d73df5c68162ed8b68c418b4066"
server_key_version: "encryptionkey@0"
I20260812 01:09:53.909997 933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance:
uuid: "13e0feaa0abf40419260cbf92df005d7"
format_stamp: "Formatted at 2026-08-12 01:09:53 on dist-test-slave-bndk"
server_key: "fd54c753257752bec7820b2e7fcaeeeb"
server_key_iv: "67fd6d73df5c68162ed8b68c418b4066"
server_key_version: "encryptionkey@0"
I20260812 01:09:53.914916 933 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 01:09:53.918227 964 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:53.919436 933 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 01:09:53.919591 933 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "13e0feaa0abf40419260cbf92df005d7"
format_stamp: "Formatted at 2026-08-12 01:09:53 on dist-test-slave-bndk"
server_key: "fd54c753257752bec7820b2e7fcaeeeb"
server_key_iv: "67fd6d73df5c68162ed8b68c418b4066"
server_key_version: "encryptionkey@0"
I20260812 01:09:53.919767 933 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:09:53.933015 933 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:09:53.936908 933 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:09:53.937165 933 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:09:53.938071 933 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:09:53.939352 933 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:09:53.939422 933 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:53.939554 933 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:09:53.939610 933 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:53.970031 933 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:37155
I20260812 01:09:53.970074 1139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:37155 every 8 connection(s)
I20260812 01:09:53.971268 933 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:09:53.974426 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 933
I20260812 01:09:53.974608 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance
I20260812 01:09:53.975028 4901 external_mini_cluster.cc:1428] Setting key d77eed790f5d7894eda8210455e0c4c1
Aug 12 01:09:53 dist-test-slave-bndk krb5kdc[556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496993, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:09:53.991999 1145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:53.973722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:57385 (local address 127.4.201.126:36869)
0812 01:09:53.974190 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:53.974197 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:53.975292 (+ 1095us) server_negotiation.cc:407] Connection header received
0812 01:09:53.977645 (+ 2353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:53.977651 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:53.977737 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:53.977856 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:09:53.979295 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:53.980270 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:53.981913 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:53.982483 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:53.982603 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:53.985891 (+ 3288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:09:53.985898 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:09:53.985903 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:09:53.985944 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:09:53.988828 (+ 2884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:53.989566 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:53.989571 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:53.989574 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:53.989763 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:53.990212 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:53.990217 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:53.990219 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:53.990552 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:09:53.990696 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:53.991540 (+ 844us) server_negotiation.cc:299] Negotiation successful
0812 01:09:53.991716 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":219,"threads_started":1}
I20260812 01:09:53.993049 1146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:53.974298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:36869 (local address 127.4.201.66:57385)
0812 01:09:53.975124 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:53.975169 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 01:09:53.977380 (+ 2211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:09:53.978042 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:09:53.978050 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:09:53.978553 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:09:53.979119 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:53.979137 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:53.980407 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:53.980411 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:53.981783 (+ 1372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:53.981796 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:53.982676 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:53.982681 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:53.982877 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:53.983501 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:09:53.983525 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:09:53.985669 (+ 2144us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:09:53.988963 (+ 3294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:09:53.988977 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:09:53.988991 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:09:53.989444 (+ 453us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:09:53.989887 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:09:53.989890 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:09:53.989893 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:09:53.990094 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:09:53.990698 (+ 604us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:09:53.990706 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:09:53.991129 (+ 423us) client_negotiation.cc:769] Sending connection context
0812 01:09:53.991434 (+ 305us) client_negotiation.cc:240] Negotiation successful
0812 01:09:53.991967 (+ 533us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":340,"threads_started":1}
I20260812 01:09:53.994470 1140 heartbeater.cc:347] Connected to a master server at 127.4.201.126:36869
I20260812 01:09:53.994758 1140 heartbeater.cc:464] Registering TS with master...
I20260812 01:09:53.995467 1140 heartbeater.cc:511] Master 127.4.201.126:36869 requested a full tablet report, sending...
I20260812 01:09:53.996913 619 ts_manager.cc:194] Registered new tserver with Master: 13e0feaa0abf40419260cbf92df005d7 (127.4.201.66:37155)
I20260812 01:09:53.997781 619 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.66@KRBTEST.COM'} at 127.4.201.66:57385
WARNING: no policy specified for kudu/127.4.201.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
I20260812 01:09:54.041662 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:0
--local_ip_for_outbound_sockets=127.4.201.67
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:36869
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:41847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:09:54.376585 1151 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:09:54.376880 1151 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:09:54.377031 1151 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:09:54.384344 1151 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:09:54.384471 1151 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:09:54.384635 1151 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:09:54.394445 1151 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:41847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:36869
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:09:54.395741 1151 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:09:54.397075 1151 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:09:54.409878 1162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:09:54.409961 1159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:09:54.410099 1157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:09:54.410502 1151 server_base.cc:1034] running on GCE node
I20260812 01:09:54.411124 1151 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:09:54.412034 1151 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:09:54.413275 1151 hybrid_clock.cc:648] HybridClock initialized: now 1786496994413199 us; error 36 us; skew 500 ppm
I20260812 01:09:54.413594 1151 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:09:54 dist-test-slave-bndk krb5kdc[556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496994, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:09:54.416615 1151 init.cc:377] Logged in from keytab as kudu/127.4.201.67@KRBTEST.COM (short username kudu)
I20260812 01:09:54.418118 1151 webserver.cc:460] Webserver started at http://127.4.201.67:41219/ using document root <none> and password file <none>
I20260812 01:09:54.418780 1151 fs_manager.cc:359] Metadata directory not provided
I20260812 01:09:54.418902 1151 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:09:54.419215 1151 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:09:54.422224 1151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-2/data/instance:
uuid: "e5d7ec18739045eebc0de3005b088964"
format_stamp: "Formatted at 2026-08-12 01:09:54 on dist-test-slave-bndk"
server_key: "1e38489e5797a6b7bcaf69ef52370d6e"
server_key_iv: "2ed93517a7580392abdf4b94bf644c51"
server_key_version: "encryptionkey@0"
I20260812 01:09:54.423053 1151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance:
uuid: "e5d7ec18739045eebc0de3005b088964"
format_stamp: "Formatted at 2026-08-12 01:09:54 on dist-test-slave-bndk"
server_key: "1e38489e5797a6b7bcaf69ef52370d6e"
server_key_iv: "2ed93517a7580392abdf4b94bf644c51"
server_key_version: "encryptionkey@0"
I20260812 01:09:54.428119 1151 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 01:09:54.431622 1174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:54.432988 1151 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260812 01:09:54.433135 1151 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "e5d7ec18739045eebc0de3005b088964"
format_stamp: "Formatted at 2026-08-12 01:09:54 on dist-test-slave-bndk"
server_key: "1e38489e5797a6b7bcaf69ef52370d6e"
server_key_iv: "2ed93517a7580392abdf4b94bf644c51"
server_key_version: "encryptionkey@0"
I20260812 01:09:54.433357 1151 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:09:54.445530 1151 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:09:54.449147 1151 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:09:54.449432 1151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:09:54.450305 1151 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:09:54.451574 1151 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:09:54.451653 1151 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:54.451767 1151 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:09:54.451821 1151 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:54.463073 919 heartbeater.cc:503] Master 127.4.201.126:36869 was elected leader, sending a full tablet report...
I20260812 01:09:54.482331 1151 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:38739
I20260812 01:09:54.482383 1345 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:38739 every 8 connection(s)
I20260812 01:09:54.483573 1151 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:09:54.489688 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 1151
I20260812 01:09:54.489850 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance
I20260812 01:09:54.490254 4901 external_mini_cluster.cc:1428] Setting key 341262b47dbd8c9d968543c5781d2744
Aug 12 01:09:54 dist-test-slave-bndk krb5kdc[556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496994, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:09:54.503115 1145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:54.486119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:59867 (local address 127.4.201.126:36869)
0812 01:09:54.486305 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:54.486309 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:54.487452 (+ 1143us) server_negotiation.cc:407] Connection header received
0812 01:09:54.489293 (+ 1841us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:54.489299 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:54.489404 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:54.489495 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:09:54.491059 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:54.491957 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:54.493969 (+ 2012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:54.494388 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:54.494485 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:54.497770 (+ 3285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:09:54.497775 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:09:54.497778 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:09:54.497808 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:09:54.500262 (+ 2454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:54.500998 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:54.501002 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:54.501005 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:54.501137 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:54.501580 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:54.501583 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:54.501585 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:54.501885 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:09:54.502000 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:54.502688 (+ 688us) server_negotiation.cc:299] Negotiation successful
0812 01:09:54.502872 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 01:09:54.504050 1349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:54.486599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:36869 (local address 127.4.201.67:59867)
0812 01:09:54.487295 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:54.487341 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 01:09:54.488992 (+ 1651us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:09:54.489736 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:09:54.489743 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:09:54.490290 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:09:54.490866 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:54.490886 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:54.492118 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:54.492123 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:54.493830 (+ 1707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:54.493847 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:54.494574 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:54.494579 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:54.494770 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:54.495394 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:09:54.495416 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:09:54.497586 (+ 2170us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:09:54.500413 (+ 2827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:09:54.500421 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:09:54.500434 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:09:54.500876 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:09:54.501254 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:09:54.501258 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:09:54.501262 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:09:54.501448 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:09:54.501983 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:09:54.501989 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:09:54.502295 (+ 306us) client_negotiation.cc:769] Sending connection context
0812 01:09:54.502535 (+ 240us) client_negotiation.cc:240] Negotiation successful
0812 01:09:54.502923 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":290,"threads_started":1}
I20260812 01:09:54.505409 1347 heartbeater.cc:347] Connected to a master server at 127.4.201.126:36869
I20260812 01:09:54.505759 1347 heartbeater.cc:464] Registering TS with master...
I20260812 01:09:54.506436 1347 heartbeater.cc:511] Master 127.4.201.126:36869 requested a full tablet report, sending...
I20260812 01:09:54.507743 619 ts_manager.cc:194] Registered new tserver with Master: e5d7ec18739045eebc0de3005b088964 (127.4.201.67:38739)
I20260812 01:09:54.508529 619 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.67@KRBTEST.COM'} at 127.4.201.67:59867
I20260812 01:09:54.517795 4901 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:09:54.534665 1145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:54.522238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42726 (local address 127.4.201.126:36869)
0812 01:09:54.522402 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:54.522407 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:54.522870 (+ 463us) server_negotiation.cc:407] Connection header received
0812 01:09:54.523094 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:54.523099 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:54.523162 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:54.523242 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:09:54.524773 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:54.525540 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:54.526888 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:54.527296 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:54.527404 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:54.529688 (+ 2284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:09:54.529692 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:09:54.529696 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:09:54.529726 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:09:54.532059 (+ 2333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:54.532702 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:54.532706 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:54.532708 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:54.532836 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:54.533195 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:54.533198 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:54.533200 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:54.533544 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:09:54.533794 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:54.534145 (+ 351us) server_negotiation.cc:299] Negotiation successful
0812 01:09:54.534360 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 01:09:54.538538 619 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42726:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:09:54.545395 619 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:09:54.575860 1374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:54.558375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44230 (local address 127.4.201.67:38739)
0812 01:09:54.564200 (+ 5825us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:54.564209 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:54.564954 (+ 745us) server_negotiation.cc:407] Connection header received
0812 01:09:54.566772 (+ 1818us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:54.566781 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:54.567059 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:54.567227 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:09:54.569315 (+ 2088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:54.571035 (+ 1720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:54.573119 (+ 2084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:54.574579 (+ 1460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:54.574714 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:54.574944 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:54.575371 (+ 427us) server_negotiation.cc:299] Negotiation successful
0812 01:09:54.575551 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5646,"thread_start_us":5447,"threads_started":1}
I20260812 01:09:54.575836 1370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:54.557734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:38739 (local address 127.0.0.1:44230)
0812 01:09:54.564759 (+ 7025us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:54.564805 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 01:09:54.565033 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:09:54.567616 (+ 2583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:09:54.567621 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:09:54.567656 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:09:54.568411 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:54.568427 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:54.571176 (+ 2749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:54.571183 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:54.572956 (+ 1773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:54.572970 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:54.574822 (+ 1852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:54.574829 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:54.575025 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:54.575081 (+ 56us) client_negotiation.cc:769] Sending connection context
0812 01:09:54.575230 (+ 149us) client_negotiation.cc:240] Negotiation successful
0812 01:09:54.575422 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6764,"thread_start_us":8253,"threads_started":1}
I20260812 01:09:54.576169 1378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:54.565351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42064 (local address 127.4.201.66:37155)
0812 01:09:54.568877 (+ 3526us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:54.568885 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:54.569444 (+ 559us) server_negotiation.cc:407] Connection header received
0812 01:09:54.569573 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:54.569578 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:54.569729 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:54.569888 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:09:54.570501 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:54.571743 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:54.573722 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:54.574856 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:54.574991 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:54.575181 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:54.575674 (+ 493us) server_negotiation.cc:299] Negotiation successful
0812 01:09:54.575844 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3386,"thread_start_us":3256,"threads_started":1}
I20260812 01:09:54.576283 1375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:54.565053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:37155 (local address 127.0.0.1:42064)
0812 01:09:54.569306 (+ 4253us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:54.569322 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 01:09:54.569430 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:09:54.570084 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:09:54.570087 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:09:54.570106 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:09:54.570349 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:54.570356 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:54.571881 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:54.571884 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:54.573535 (+ 1651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:54.573554 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:54.575127 (+ 1573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:54.575134 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:54.575299 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:54.575331 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 01:09:54.575410 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 01:09:54.575534 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4115,"thread_start_us":3932,"threads_started":1}
I20260812 01:09:54.578014 1369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:54.557941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:34333 (local address 127.0.0.1:33062)
0812 01:09:54.566277 (+ 8336us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:54.566296 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 01:09:54.566439 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:09:54.567537 (+ 1098us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:09:54.567546 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:09:54.567589 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:09:54.568090 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:54.568104 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:54.573117 (+ 5013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:54.573121 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:54.575154 (+ 2033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:54.575166 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:54.577189 (+ 2023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:54.577195 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:54.577402 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:54.577434 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 01:09:54.577528 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 01:09:54.577654 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8206,"spinlock_wait_cycles":2304,"thread_start_us":7260,"threads_started":1}
I20260812 01:09:54.578083 1371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:54.558294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33062 (local address 127.4.201.65:34333)
0812 01:09:54.558960 (+ 666us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:54.558969 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:54.566432 (+ 7463us) server_negotiation.cc:407] Connection header received
0812 01:09:54.566601 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:54.566610 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:54.566902 (+ 292us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:54.567116 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:09:54.569434 (+ 2318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:54.571035 (+ 1601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:54.575303 (+ 4268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:54.576699 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:54.576839 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:54.577052 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:54.577595 (+ 543us) server_negotiation.cc:299] Negotiation successful
0812 01:09:54.577758 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":511,"thread_start_us":332,"threads_started":1}
I20260812 01:09:54.580338 1240 tablet_service.cc:1467] Processing CreateTablet for tablet 21cd3a941c044f02bb1852d9a652ada1 (DEFAULT_TABLE table=test-table [id=192d6817f05f4782bbfd086d54eb0b4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:09:54.580338 1038 tablet_service.cc:1467] Processing CreateTablet for tablet 21cd3a941c044f02bb1852d9a652ada1 (DEFAULT_TABLE table=test-table [id=192d6817f05f4782bbfd086d54eb0b4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:09:54.581436 809 tablet_service.cc:1467] Processing CreateTablet for tablet 21cd3a941c044f02bb1852d9a652ada1 (DEFAULT_TABLE table=test-table [id=192d6817f05f4782bbfd086d54eb0b4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:09:54.581887 1240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21cd3a941c044f02bb1852d9a652ada1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:09:54.581887 1038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21cd3a941c044f02bb1852d9a652ada1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:09:54.582576 809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21cd3a941c044f02bb1852d9a652ada1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:09:54.593324 1380 tablet_bootstrap.cc:492] T 21cd3a941c044f02bb1852d9a652ada1 P c156be4fee524951bd5db2af9fc981f7: Bootstrap starting.
I20260812 01:09:54.596768 1380 tablet_bootstrap.cc:654] T 21cd3a941c044f02bb1852d9a652ada1 P c156be4fee524951bd5db2af9fc981f7: Neither blocks nor log segments found. Creating new log.
I20260812 01:09:54.597821 1380 log.cc:824] T 21cd3a941c044f02bb1852d9a652ada1 P c156be4fee524951bd5db2af9fc981f7: Log is configured to *not* fsync() on all Append() calls
I20260812 01:09:54.600545 1380 tablet_bootstrap.cc:492] T 21cd3a941c044f02bb1852d9a652ada1 P c156be4fee524951bd5db2af9fc981f7: No bootstrap required, opened a new log
I20260812 01:09:54.600790 1380 ts_tablet_manager.cc:1397] T 21cd3a941c044f02bb1852d9a652ada1 P c156be4fee524951bd5db2af9fc981f7: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260812 01:09:54.601922 1382 tablet_bootstrap.cc:492] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964: Bootstrap starting.
I20260812 01:09:54.602365 1381 tablet_bootstrap.cc:492] T 21cd3a941c044f02bb1852d9a652ada1 P 13e0feaa0abf40419260cbf92df005d7: Bootstrap starting.
I20260812 01:09:54.605610 1382 tablet_bootstrap.cc:654] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964: Neither blocks nor log segments found. Creating new log.
I20260812 01:09:54.605737 1381 tablet_bootstrap.cc:654] T 21cd3a941c044f02bb1852d9a652ada1 P 13e0feaa0abf40419260cbf92df005d7: Neither blocks nor log segments found. Creating new log.
I20260812 01:09:54.606945 1382 log.cc:824] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964: Log is configured to *not* fsync() on all Append() calls
I20260812 01:09:54.606952 1381 log.cc:824] T 21cd3a941c044f02bb1852d9a652ada1 P 13e0feaa0abf40419260cbf92df005d7: Log is configured to *not* fsync() on all Append() calls
I20260812 01:09:54.609138 1380 raft_consensus.cc:348] T 21cd3a941c044f02bb1852d9a652ada1 P c156be4fee524951bd5db2af9fc981f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d7ec18739045eebc0de3005b088964" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38739 } } peers { permanent_uuid: "c156be4fee524951bd5db2af9fc981f7" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34333 } } peers { permanent_uuid: "13e0feaa0abf40419260cbf92df005d7" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 37155 } }
I20260812 01:09:54.609619 1380 raft_consensus.cc:374] T 21cd3a941c044f02bb1852d9a652ada1 P c156be4fee524951bd5db2af9fc981f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:09:54.609735 1380 raft_consensus.cc:729] T 21cd3a941c044f02bb1852d9a652ada1 P c156be4fee524951bd5db2af9fc981f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c156be4fee524951bd5db2af9fc981f7, State: Initialized, Role: FOLLOWER
I20260812 01:09:54.609798 1382 tablet_bootstrap.cc:492] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964: No bootstrap required, opened a new log
I20260812 01:09:54.610061 1382 ts_tablet_manager.cc:1397] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260812 01:09:54.610206 1381 tablet_bootstrap.cc:492] T 21cd3a941c044f02bb1852d9a652ada1 P 13e0feaa0abf40419260cbf92df005d7: No bootstrap required, opened a new log
I20260812 01:09:54.610466 1381 ts_tablet_manager.cc:1397] T 21cd3a941c044f02bb1852d9a652ada1 P 13e0feaa0abf40419260cbf92df005d7: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.000s
I20260812 01:09:54.610394 1380 consensus_queue.cc:260] T 21cd3a941c044f02bb1852d9a652ada1 P c156be4fee524951bd5db2af9fc981f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d7ec18739045eebc0de3005b088964" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38739 } } peers { permanent_uuid: "c156be4fee524951bd5db2af9fc981f7" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34333 } } peers { permanent_uuid: "13e0feaa0abf40419260cbf92df005d7" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 37155 } }
I20260812 01:09:54.612191 1380 ts_tablet_manager.cc:1428] T 21cd3a941c044f02bb1852d9a652ada1 P c156be4fee524951bd5db2af9fc981f7: Time spent starting tablet: real 0.011s user 0.005s sys 0.007s
I20260812 01:09:54.618417 1382 raft_consensus.cc:348] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d7ec18739045eebc0de3005b088964" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38739 } } peers { permanent_uuid: "c156be4fee524951bd5db2af9fc981f7" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34333 } } peers { permanent_uuid: "13e0feaa0abf40419260cbf92df005d7" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 37155 } }
I20260812 01:09:54.618857 1382 raft_consensus.cc:374] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:09:54.618995 1382 raft_consensus.cc:729] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5d7ec18739045eebc0de3005b088964, State: Initialized, Role: FOLLOWER
I20260812 01:09:54.619586 1382 consensus_queue.cc:260] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d7ec18739045eebc0de3005b088964" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38739 } } peers { permanent_uuid: "c156be4fee524951bd5db2af9fc981f7" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34333 } } peers { permanent_uuid: "13e0feaa0abf40419260cbf92df005d7" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 37155 } }
I20260812 01:09:54.619629 1381 raft_consensus.cc:348] T 21cd3a941c044f02bb1852d9a652ada1 P 13e0feaa0abf40419260cbf92df005d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d7ec18739045eebc0de3005b088964" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38739 } } peers { permanent_uuid: "c156be4fee524951bd5db2af9fc981f7" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34333 } } peers { permanent_uuid: "13e0feaa0abf40419260cbf92df005d7" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 37155 } }
I20260812 01:09:54.620026 1381 raft_consensus.cc:374] T 21cd3a941c044f02bb1852d9a652ada1 P 13e0feaa0abf40419260cbf92df005d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:09:54.620123 1381 raft_consensus.cc:729] T 21cd3a941c044f02bb1852d9a652ada1 P 13e0feaa0abf40419260cbf92df005d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13e0feaa0abf40419260cbf92df005d7, State: Initialized, Role: FOLLOWER
I20260812 01:09:54.620728 1347 heartbeater.cc:503] Master 127.4.201.126:36869 was elected leader, sending a full tablet report...
I20260812 01:09:54.620697 1381 consensus_queue.cc:260] T 21cd3a941c044f02bb1852d9a652ada1 P 13e0feaa0abf40419260cbf92df005d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d7ec18739045eebc0de3005b088964" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38739 } } peers { permanent_uuid: "c156be4fee524951bd5db2af9fc981f7" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34333 } } peers { permanent_uuid: "13e0feaa0abf40419260cbf92df005d7" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 37155 } }
I20260812 01:09:54.621126 1382 ts_tablet_manager.cc:1428] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260812 01:09:54.621790 1140 heartbeater.cc:503] Master 127.4.201.126:36869 was elected leader, sending a full tablet report...
I20260812 01:09:54.622480 1381 ts_tablet_manager.cc:1428] T 21cd3a941c044f02bb1852d9a652ada1 P 13e0feaa0abf40419260cbf92df005d7: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
I20260812 01:09:54.677134 1389 raft_consensus.cc:482] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:09:54.677503 1389 raft_consensus.cc:504] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d7ec18739045eebc0de3005b088964" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38739 } } peers { permanent_uuid: "c156be4fee524951bd5db2af9fc981f7" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34333 } } peers { permanent_uuid: "13e0feaa0abf40419260cbf92df005d7" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 37155 } }
I20260812 01:09:54.679627 1389 leader_election.cc:288] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c156be4fee524951bd5db2af9fc981f7 (127.4.201.65:34333), 13e0feaa0abf40419260cbf92df005d7 (127.4.201.66:37155)
W20260812 01:09:54.684389 920 tablet.cc:2369] T 21cd3a941c044f02bb1852d9a652ada1 P c156be4fee524951bd5db2af9fc981f7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:09:54.686055 1378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:54.680274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:38061 (local address 127.4.201.66:37155)
0812 01:09:54.680500 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:54.680507 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:54.681011 (+ 504us) server_negotiation.cc:407] Connection header received
0812 01:09:54.681157 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:54.681163 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:54.681271 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:54.681341 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:09:54.681935 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:54.682655 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:54.684321 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:54.685154 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:54.685325 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:54.685400 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:54.685670 (+ 270us) server_negotiation.cc:299] Negotiation successful
0812 01:09:54.685792 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 01:09:54.686141 1371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:54.680049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:36289 (local address 127.4.201.65:34333)
0812 01:09:54.680282 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:54.680288 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:54.680562 (+ 274us) server_negotiation.cc:407] Connection header received
0812 01:09:54.680757 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:54.680763 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:54.680846 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:54.680929 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:09:54.681488 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:54.682372 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:54.684008 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:54.685283 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:54.685432 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:54.685502 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:54.685769 (+ 267us) server_negotiation.cc:299] Negotiation successful
0812 01:09:54.685892 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260812 01:09:54.686133 1391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:54.680105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:37155 (local address 127.4.201.67:38061)
0812 01:09:54.680894 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:54.680909 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 01:09:54.681030 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:09:54.681375 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:09:54.681380 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:09:54.681407 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:09:54.681775 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:54.681786 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:54.682808 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:54.682812 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:54.684164 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:54.684177 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:54.685371 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:54.685377 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:54.685523 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:54.685547 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 01:09:54.685629 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 01:09:54.685759 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":697,"thread_start_us":437,"threads_started":1}
I20260812 01:09:54.686151 1349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:54.680029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:34333 (local address 127.4.201.67:36289)
0812 01:09:54.680429 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:54.680451 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 01:09:54.680603 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:09:54.680994 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:09:54.680999 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:09:54.681080 (+ 81us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:09:54.681301 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:54.681314 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:54.682514 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:54.682520 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:54.683836 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:54.683852 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:54.685418 (+ 1566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:54.685425 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:54.685620 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:54.685644 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 01:09:54.685723 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 01:09:54.685849 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"spinlock_wait_cycles":28416}
I20260812 01:09:54.687222 847 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21cd3a941c044f02bb1852d9a652ada1" candidate_uuid: "e5d7ec18739045eebc0de3005b088964" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c156be4fee524951bd5db2af9fc981f7" is_pre_election: true
I20260812 01:09:54.687315 1067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21cd3a941c044f02bb1852d9a652ada1" candidate_uuid: "e5d7ec18739045eebc0de3005b088964" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e0feaa0abf40419260cbf92df005d7" is_pre_election: true
I20260812 01:09:54.687723 847 raft_consensus.cc:2454] T 21cd3a941c044f02bb1852d9a652ada1 P c156be4fee524951bd5db2af9fc981f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5d7ec18739045eebc0de3005b088964 in term 0.
I20260812 01:09:54.687801 1067 raft_consensus.cc:2454] T 21cd3a941c044f02bb1852d9a652ada1 P 13e0feaa0abf40419260cbf92df005d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5d7ec18739045eebc0de3005b088964 in term 0.
I20260812 01:09:54.688421 1180 leader_election.cc:302] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e0feaa0abf40419260cbf92df005d7, e5d7ec18739045eebc0de3005b088964; no voters:
I20260812 01:09:54.688792 1389 raft_consensus.cc:2781] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:09:54.688920 1389 raft_consensus.cc:482] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:09:54.689023 1389 raft_consensus.cc:3037] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:09:54.691339 1389 raft_consensus.cc:504] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d7ec18739045eebc0de3005b088964" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38739 } } peers { permanent_uuid: "c156be4fee524951bd5db2af9fc981f7" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34333 } } peers { permanent_uuid: "13e0feaa0abf40419260cbf92df005d7" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 37155 } }
I20260812 01:09:54.691958 1389 leader_election.cc:288] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964 [CANDIDATE]: Term 1 election: Requested vote from peers c156be4fee524951bd5db2af9fc981f7 (127.4.201.65:34333), 13e0feaa0abf40419260cbf92df005d7 (127.4.201.66:37155)
I20260812 01:09:54.692365 847 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21cd3a941c044f02bb1852d9a652ada1" candidate_uuid: "e5d7ec18739045eebc0de3005b088964" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c156be4fee524951bd5db2af9fc981f7"
I20260812 01:09:54.692459 1067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21cd3a941c044f02bb1852d9a652ada1" candidate_uuid: "e5d7ec18739045eebc0de3005b088964" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e0feaa0abf40419260cbf92df005d7"
I20260812 01:09:54.692552 847 raft_consensus.cc:3037] T 21cd3a941c044f02bb1852d9a652ada1 P c156be4fee524951bd5db2af9fc981f7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:09:54.692659 1067 raft_consensus.cc:3037] T 21cd3a941c044f02bb1852d9a652ada1 P 13e0feaa0abf40419260cbf92df005d7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:09:54.694828 847 raft_consensus.cc:2454] T 21cd3a941c044f02bb1852d9a652ada1 P c156be4fee524951bd5db2af9fc981f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5d7ec18739045eebc0de3005b088964 in term 1.
I20260812 01:09:54.694968 1067 raft_consensus.cc:2454] T 21cd3a941c044f02bb1852d9a652ada1 P 13e0feaa0abf40419260cbf92df005d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5d7ec18739045eebc0de3005b088964 in term 1.
I20260812 01:09:54.695230 1182 leader_election.cc:302] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c156be4fee524951bd5db2af9fc981f7, e5d7ec18739045eebc0de3005b088964; no voters:
I20260812 01:09:54.695555 1389 raft_consensus.cc:2781] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:09:54.695976 1389 raft_consensus.cc:686] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964 [term 1 LEADER]: Becoming Leader. State: Replica: e5d7ec18739045eebc0de3005b088964, State: Running, Role: LEADER
I20260812 01:09:54.696470 1389 consensus_queue.cc:237] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d7ec18739045eebc0de3005b088964" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38739 } } peers { permanent_uuid: "c156be4fee524951bd5db2af9fc981f7" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34333 } } peers { permanent_uuid: "13e0feaa0abf40419260cbf92df005d7" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 37155 } }
I20260812 01:09:54.700914 618 catalog_manager.cc:5495] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5d7ec18739045eebc0de3005b088964 (127.4.201.67). New cstate: current_term: 1 leader_uuid: "e5d7ec18739045eebc0de3005b088964" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d7ec18739045eebc0de3005b088964" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 38739 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c156be4fee524951bd5db2af9fc981f7" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13e0feaa0abf40419260cbf92df005d7" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 37155 } health_report { overall_health: UNKNOWN } } }
I20260812 01:09:54.720163 1374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:54.714878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44232 (local address 127.4.201.67:38739)
0812 01:09:54.715074 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:54.715080 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:54.715098 (+ 18us) server_negotiation.cc:407] Connection header received
0812 01:09:54.715288 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:54.715292 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:54.715370 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:54.715498 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:09:54.715887 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:54.716620 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:54.718036 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:54.718422 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:54.718530 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:54.719051 (+ 521us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:09:54.719596 (+ 545us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:09:54.719731 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:54.719830 (+ 99us) server_negotiation.cc:299] Negotiation successful
0812 01:09:54.719912 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
W20260812 01:09:54.723328 1142 tablet.cc:2369] T 21cd3a941c044f02bb1852d9a652ada1 P 13e0feaa0abf40419260cbf92df005d7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:09:54.728848 847 raft_consensus.cc:1261] T 21cd3a941c044f02bb1852d9a652ada1 P c156be4fee524951bd5db2af9fc981f7 [term 1 FOLLOWER]: Refusing update from remote peer e5d7ec18739045eebc0de3005b088964: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:09:54.728848 1067 raft_consensus.cc:1261] T 21cd3a941c044f02bb1852d9a652ada1 P 13e0feaa0abf40419260cbf92df005d7 [term 1 FOLLOWER]: Refusing update from remote peer e5d7ec18739045eebc0de3005b088964: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:09:54.729866 1393 consensus_queue.cc:1035] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13e0feaa0abf40419260cbf92df005d7" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 37155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:09:54.730208 1389 consensus_queue.cc:1035] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c156be4fee524951bd5db2af9fc981f7" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 01:09:54.735086 1348 tablet.cc:2369] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:09:54.755472 619 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42726:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:09:54.755810 619 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42726:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:09:54.759627 619 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c9422648d7ec4e789aa1885d3c59db51: Sending DeleteTablet for 3 replicas of tablet 21cd3a941c044f02bb1852d9a652ada1
I20260812 01:09:54.760782 1240 tablet_service.cc:1514] Processing DeleteTablet for tablet 21cd3a941c044f02bb1852d9a652ada1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:09:54 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:44230
I20260812 01:09:54.761003 1038 tablet_service.cc:1514] Processing DeleteTablet for tablet 21cd3a941c044f02bb1852d9a652ada1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:09:54 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:42064
I20260812 01:09:54.761518 809 tablet_service.cc:1514] Processing DeleteTablet for tablet 21cd3a941c044f02bb1852d9a652ada1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:09:54 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:33062
I20260812 01:09:54.762424 1416 tablet_replica.cc:330] T 21cd3a941c044f02bb1852d9a652ada1 P c156be4fee524951bd5db2af9fc981f7: stopping tablet replica
I20260812 01:09:54.762907 1416 raft_consensus.cc:2229] T 21cd3a941c044f02bb1852d9a652ada1 P c156be4fee524951bd5db2af9fc981f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:09:54.763455 1416 raft_consensus.cc:2258] T 21cd3a941c044f02bb1852d9a652ada1 P c156be4fee524951bd5db2af9fc981f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:09:54.763906 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 716
I20260812 01:09:54.764271 1417 tablet_replica.cc:330] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964: stopping tablet replica
I20260812 01:09:54.764647 1417 raft_consensus.cc:2229] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964 [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:09:54.765358 1417 raft_consensus.cc:2258] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:09:54.769407 1416 ts_tablet_manager.cc:1905] T 21cd3a941c044f02bb1852d9a652ada1 P c156be4fee524951bd5db2af9fc981f7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:09:54.776803 1416 ts_tablet_manager.cc:1918] T 21cd3a941c044f02bb1852d9a652ada1 P c156be4fee524951bd5db2af9fc981f7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:09:54.776983 1416 log.cc:1196] T 21cd3a941c044f02bb1852d9a652ada1 P c156be4fee524951bd5db2af9fc981f7: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-0/wal/wals/21cd3a941c044f02bb1852d9a652ada1
I20260812 01:09:54.777678 1416 ts_tablet_manager.cc:1939] T 21cd3a941c044f02bb1852d9a652ada1 P c156be4fee524951bd5db2af9fc981f7: Deleting consensus metadata
Aug 12 01:09:54 dist-test-slave-bndk krb5kdc[556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496992, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.65@KRBTEST.COM
I20260812 01:09:54.779161 1417 ts_tablet_manager.cc:1905] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:09:54.779651 600 catalog_manager.cc:4841] TS c156be4fee524951bd5db2af9fc981f7 (127.4.201.65:34333): tablet 21cd3a941c044f02bb1852d9a652ada1 (table test-table [id=192d6817f05f4782bbfd086d54eb0b4b]) successfully deleted
I20260812 01:09:54.779954 1411 tablet_replica.cc:330] T 21cd3a941c044f02bb1852d9a652ada1 P 13e0feaa0abf40419260cbf92df005d7: stopping tablet replica
I20260812 01:09:54.780442 1411 raft_consensus.cc:2229] T 21cd3a941c044f02bb1852d9a652ada1 P 13e0feaa0abf40419260cbf92df005d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:09:54.781092 1411 raft_consensus.cc:2258] T 21cd3a941c044f02bb1852d9a652ada1 P 13e0feaa0abf40419260cbf92df005d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:09:54.783159 1411 ts_tablet_manager.cc:1905] T 21cd3a941c044f02bb1852d9a652ada1 P 13e0feaa0abf40419260cbf92df005d7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:09:54.787361 1371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:54.766861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33068 (local address 127.4.201.65:34333)
0812 01:09:54.767049 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:54.767055 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:54.767540 (+ 485us) server_negotiation.cc:407] Connection header received
0812 01:09:54.767819 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:54.767828 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:54.767919 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:54.767995 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:09:54.770120 (+ 2125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:54.771453 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:54.773638 (+ 2185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:54.774379 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:54.774490 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:54.780248 (+ 5758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:09:54.780262 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:09:54.780280 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:09:54.780326 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:09:54.783907 (+ 3581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:54.784787 (+ 880us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:54.784797 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:54.784800 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:54.784977 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:54.785483 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:54.785488 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:54.785492 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:54.785915 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:09:54.786182 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:54.786762 (+ 580us) server_negotiation.cc:299] Negotiation successful
0812 01:09:54.786983 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 01:09:54.788403 1417 ts_tablet_manager.cc:1918] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:09:54.788625 1417 log.cc:1196] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-2/wal/wals/21cd3a941c044f02bb1852d9a652ada1
I20260812 01:09:54.789311 910 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:09:54.789353 1417 ts_tablet_manager.cc:1939] T 21cd3a941c044f02bb1852d9a652ada1 P e5d7ec18739045eebc0de3005b088964: Deleting consensus metadata
I20260812 01:09:54.790072 1411 ts_tablet_manager.cc:1918] T 21cd3a941c044f02bb1852d9a652ada1 P 13e0feaa0abf40419260cbf92df005d7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:09:54.790280 1411 log.cc:1196] T 21cd3a941c044f02bb1852d9a652ada1 P 13e0feaa0abf40419260cbf92df005d7: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786496689953932-4901-0/minicluster-data/ts-1/wal/wals/21cd3a941c044f02bb1852d9a652ada1
I20260812 01:09:54.790887 1411 ts_tablet_manager.cc:1939] T 21cd3a941c044f02bb1852d9a652ada1 P 13e0feaa0abf40419260cbf92df005d7: Deleting consensus metadata
I20260812 01:09:54.791265 601 catalog_manager.cc:4841] TS e5d7ec18739045eebc0de3005b088964 (127.4.201.67:38739): tablet 21cd3a941c044f02bb1852d9a652ada1 (table test-table [id=192d6817f05f4782bbfd086d54eb0b4b]) successfully deleted
I20260812 01:09:54.792766 599 catalog_manager.cc:4841] TS 13e0feaa0abf40419260cbf92df005d7 (127.4.201.66:37155): tablet 21cd3a941c044f02bb1852d9a652ada1 (table test-table [id=192d6817f05f4782bbfd086d54eb0b4b]) successfully deleted
I20260812 01:09:54.896521 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 716
I20260812 01:09:54.918125 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 933
Aug 12 01:09:54 dist-test-slave-bndk krb5kdc[556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496992, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.66@KRBTEST.COM
I20260812 01:09:54.935324 1378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:54.919031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42072 (local address 127.4.201.66:37155)
0812 01:09:54.919205 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:54.919209 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:54.919227 (+ 18us) server_negotiation.cc:407] Connection header received
0812 01:09:54.919411 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:54.919415 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:54.919480 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:54.919573 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:09:54.921184 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:54.921965 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:54.923872 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:54.924348 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:54.924443 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:54.929417 (+ 4974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:09:54.929433 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:09:54.929449 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:09:54.929495 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:09:54.932194 (+ 2699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:54.932943 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:54.932953 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:54.932956 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:54.933115 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:54.933562 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:54.933568 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:54.933571 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:54.933994 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:09:54.934201 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:54.934745 (+ 544us) server_negotiation.cc:299] Negotiation successful
0812 01:09:54.934969 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 01:09:54.936039 1134 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:09:55.045322 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 933
I20260812 01:09:55.069865 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 1151
Aug 12 01:09:55 dist-test-slave-bndk krb5kdc[556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496992, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.67@KRBTEST.COM
I20260812 01:09:55.087383 1374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:55.070718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44244 (local address 127.4.201.67:38739)
0812 01:09:55.070895 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:55.070899 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:55.070961 (+ 62us) server_negotiation.cc:407] Connection header received
0812 01:09:55.071162 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:55.071166 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:55.071234 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:55.071326 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:09:55.073106 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:55.073973 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:55.075761 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:55.076212 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:55.076326 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:55.081078 (+ 4752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:09:55.081093 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:09:55.081115 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:09:55.081175 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:09:55.084179 (+ 3004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:55.085035 (+ 856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:55.085043 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:55.085046 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:55.085454 (+ 408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:09:55.085905 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:09:55.085908 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:09:55.085910 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:09:55.086284 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:09:55.086508 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:55.086888 (+ 380us) server_negotiation.cc:299] Negotiation successful
0812 01:09:55.087054 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 01:09:55.088107 1339 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:09:55.212409 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 1151
I20260812 01:09:55.239791 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 574
I20260812 01:09:55.240927 672 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:09:55.351368 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 574
2026-08-12T01:09:55Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4533 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-12T01:09:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:09:55Z Disabled control of system clock
I20260812 01:09:55.445991 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:40411
--webserver_interface=127.4.201.126
--webserver_port=0
--builtin_ntp_servers=127.4.201.84:45015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:40411
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 01:09:55.784559 1431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:09:55.784845 1431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:09:55.784981 1431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:09:55.792260 1431 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:09:55.792363 1431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:09:55.792428 1431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:09:55.792506 1431 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:09:55.792560 1431 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:09:55.801693 1431 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:45015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:40411
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:40411
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:09:55.802917 1431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:09:55.804716 1431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:09:55.815994 1441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:09:55.816082 1440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:09:55.816104 1443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:09:55.817098 1431 server_base.cc:1034] running on GCE node
I20260812 01:09:55.817831 1431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:09:55.819103 1431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:09:55.820302 1431 hybrid_clock.cc:648] HybridClock initialized: now 1786496995820251 us; error 45 us; skew 500 ppm
I20260812 01:09:55.820634 1431 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:09:55.829629 1431 webserver.cc:460] Webserver started at http://127.4.201.126:38199/ using document root <none> and password file <none>
I20260812 01:09:55.830355 1431 fs_manager.cc:359] Metadata directory not provided
I20260812 01:09:55.830462 1431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:09:55.830782 1431 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:09:55.833762 1431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "ef7ab5975dd64c9c8b88eda1ef95e280"
format_stamp: "Formatted at 2026-08-12 01:09:55 on dist-test-slave-bndk"
server_key: "48e0427657808b7db58f125c1b181819"
server_key_iv: "9866ff21ab48f0a178d93ba9d057a784"
server_key_version: "encryptionkey@0"
I20260812 01:09:55.834625 1431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "ef7ab5975dd64c9c8b88eda1ef95e280"
format_stamp: "Formatted at 2026-08-12 01:09:55 on dist-test-slave-bndk"
server_key: "48e0427657808b7db58f125c1b181819"
server_key_iv: "9866ff21ab48f0a178d93ba9d057a784"
server_key_version: "encryptionkey@0"
I20260812 01:09:55.839668 1431 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 01:09:55.843022 1452 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:55.844288 1431 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 01:09:55.844449 1431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "ef7ab5975dd64c9c8b88eda1ef95e280"
format_stamp: "Formatted at 2026-08-12 01:09:55 on dist-test-slave-bndk"
server_key: "48e0427657808b7db58f125c1b181819"
server_key_iv: "9866ff21ab48f0a178d93ba9d057a784"
server_key_version: "encryptionkey@0"
I20260812 01:09:55.844648 1431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:09:55.865625 1431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:09:55.866387 1431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:09:55.866645 1431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:09:55.883848 1431 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:40411
I20260812 01:09:55.883884 1527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:40411 every 8 connection(s)
I20260812 01:09:55.885124 1431 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:09:55.888808 1528 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:09:55.892321 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 1431
I20260812 01:09:55.892525 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:09:55.893060 4901 external_mini_cluster.cc:1428] Setting key 62ca685c7daaa1579fa5387631323233
I20260812 01:09:55.901427 1528 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef7ab5975dd64c9c8b88eda1ef95e280: Bootstrap starting.
I20260812 01:09:55.904956 1528 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ef7ab5975dd64c9c8b88eda1ef95e280: Neither blocks nor log segments found. Creating new log.
I20260812 01:09:55.906116 1528 log.cc:824] T 00000000000000000000000000000000 P ef7ab5975dd64c9c8b88eda1ef95e280: Log is configured to *not* fsync() on all Append() calls
I20260812 01:09:55.906606 1531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:55.894969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58922 (local address 127.4.201.126:40411)
0812 01:09:55.895905 (+ 936us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:55.895915 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:55.895956 (+ 41us) server_negotiation.cc:407] Connection header received
0812 01:09:55.897625 (+ 1669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:55.897652 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:55.898107 (+ 455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:55.898429 (+ 322us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:09:55.899053 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:55.900322 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:55.902211 (+ 1889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:55.902902 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:55.903054 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:55.904219 (+ 1165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:09:55.904230 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:09:55.904243 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:09:55.904747 (+ 504us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:09:55.904842 (+ 95us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:09:55.904866 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:09:55.904952 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:55.905202 (+ 250us) server_negotiation.cc:299] Negotiation successful
0812 01:09:55.905575 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":559,"thread_start_us":337,"threads_started":1}
I20260812 01:09:55.909063 1528 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef7ab5975dd64c9c8b88eda1ef95e280: No bootstrap required, opened a new log
I20260812 01:09:55.915993 1528 raft_consensus.cc:348] T 00000000000000000000000000000000 P ef7ab5975dd64c9c8b88eda1ef95e280 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef7ab5975dd64c9c8b88eda1ef95e280" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 40411 } }
I20260812 01:09:55.916404 1528 raft_consensus.cc:374] T 00000000000000000000000000000000 P ef7ab5975dd64c9c8b88eda1ef95e280 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:09:55.916500 1528 raft_consensus.cc:729] T 00000000000000000000000000000000 P ef7ab5975dd64c9c8b88eda1ef95e280 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7ab5975dd64c9c8b88eda1ef95e280, State: Initialized, Role: FOLLOWER
I20260812 01:09:55.917049 1528 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef7ab5975dd64c9c8b88eda1ef95e280 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef7ab5975dd64c9c8b88eda1ef95e280" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 40411 } }
I20260812 01:09:55.917289 1528 raft_consensus.cc:388] T 00000000000000000000000000000000 P ef7ab5975dd64c9c8b88eda1ef95e280 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:09:55.917418 1528 raft_consensus.cc:482] T 00000000000000000000000000000000 P ef7ab5975dd64c9c8b88eda1ef95e280 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:09:55.917563 1528 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ef7ab5975dd64c9c8b88eda1ef95e280 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:09:55.919622 1528 raft_consensus.cc:504] T 00000000000000000000000000000000 P ef7ab5975dd64c9c8b88eda1ef95e280 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef7ab5975dd64c9c8b88eda1ef95e280" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 40411 } }
I20260812 01:09:55.920090 1528 leader_election.cc:302] T 00000000000000000000000000000000 P ef7ab5975dd64c9c8b88eda1ef95e280 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ef7ab5975dd64c9c8b88eda1ef95e280; no voters:
I20260812 01:09:55.920657 1528 leader_election.cc:288] T 00000000000000000000000000000000 P ef7ab5975dd64c9c8b88eda1ef95e280 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:09:55.920818 1534 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ef7ab5975dd64c9c8b88eda1ef95e280 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:09:55.921909 1534 raft_consensus.cc:686] T 00000000000000000000000000000000 P ef7ab5975dd64c9c8b88eda1ef95e280 [term 1 LEADER]: Becoming Leader. State: Replica: ef7ab5975dd64c9c8b88eda1ef95e280, State: Running, Role: LEADER
I20260812 01:09:55.922427 1534 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef7ab5975dd64c9c8b88eda1ef95e280 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef7ab5975dd64c9c8b88eda1ef95e280" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 40411 } }
I20260812 01:09:55.922796 1528 sys_catalog.cc:564] T 00000000000000000000000000000000 P ef7ab5975dd64c9c8b88eda1ef95e280 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:09:55.924948 1536 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef7ab5975dd64c9c8b88eda1ef95e280 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef7ab5975dd64c9c8b88eda1ef95e280. Latest consensus state: current_term: 1 leader_uuid: "ef7ab5975dd64c9c8b88eda1ef95e280" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef7ab5975dd64c9c8b88eda1ef95e280" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 40411 } } }
I20260812 01:09:55.925639 1536 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef7ab5975dd64c9c8b88eda1ef95e280 [sys.catalog]: This master's current role is: LEADER
I20260812 01:09:55.925150 1535 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef7ab5975dd64c9c8b88eda1ef95e280 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ef7ab5975dd64c9c8b88eda1ef95e280" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef7ab5975dd64c9c8b88eda1ef95e280" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 40411 } } }
I20260812 01:09:55.926219 1535 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef7ab5975dd64c9c8b88eda1ef95e280 [sys.catalog]: This master's current role is: LEADER
I20260812 01:09:55.926909 1546 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:09:55.932142 1546 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:09:55.940219 1546 catalog_manager.cc:1347] Generated new cluster ID: c026f413ccaa43259c2b24a726484b75
I20260812 01:09:55.940357 1546 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:09:55.951537 1546 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:09:55.952708 1546 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:09:55.969533 1546 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ef7ab5975dd64c9c8b88eda1ef95e280: Generated new TSK 0
I20260812 01:09:55.970350 1546 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:09:55.986389 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:0
--local_ip_for_outbound_sockets=127.4.201.65
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:40411
--builtin_ntp_servers=127.4.201.84:45015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 01:09:56.334721 1560 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:09:56.335022 1560 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:09:56.335163 1560 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:09:56.342665 1560 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:09:56.342768 1560 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:09:56.342885 1560 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:09:56.352058 1560 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:45015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:40411
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:09:56.353307 1560 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:09:56.355137 1560 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:09:56.367805 1571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:09:56.367882 1572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:09:56.368037 1575 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:09:56.368669 1560 server_base.cc:1034] running on GCE node
I20260812 01:09:56.369320 1560 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:09:56.370275 1560 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:09:56.371470 1560 hybrid_clock.cc:648] HybridClock initialized: now 1786496996371406 us; error 58 us; skew 500 ppm
I20260812 01:09:56.371765 1560 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:09:56.373939 1560 webserver.cc:460] Webserver started at http://127.4.201.65:41117/ using document root <none> and password file <none>
I20260812 01:09:56.374603 1560 fs_manager.cc:359] Metadata directory not provided
I20260812 01:09:56.374703 1560 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:09:56.375029 1560 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:09:56.377885 1560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-0/data/instance:
uuid: "176e45e5ca024573b26b83b6c4b9587a"
format_stamp: "Formatted at 2026-08-12 01:09:56 on dist-test-slave-bndk"
server_key: "eb51d066e8134572dae6b6c6791f0a4b"
server_key_iv: "403a025abc90b4979ce91b9d73a1d12a"
server_key_version: "encryptionkey@0"
I20260812 01:09:56.378651 1560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance:
uuid: "176e45e5ca024573b26b83b6c4b9587a"
format_stamp: "Formatted at 2026-08-12 01:09:56 on dist-test-slave-bndk"
server_key: "eb51d066e8134572dae6b6c6791f0a4b"
server_key_iv: "403a025abc90b4979ce91b9d73a1d12a"
server_key_version: "encryptionkey@0"
I20260812 01:09:56.383632 1560 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 01:09:56.387084 1583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:56.388339 1560 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 01:09:56.388484 1560 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "176e45e5ca024573b26b83b6c4b9587a"
format_stamp: "Formatted at 2026-08-12 01:09:56 on dist-test-slave-bndk"
server_key: "eb51d066e8134572dae6b6c6791f0a4b"
server_key_iv: "403a025abc90b4979ce91b9d73a1d12a"
server_key_version: "encryptionkey@0"
I20260812 01:09:56.388676 1560 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:09:56.402083 1560 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:09:56.402802 1560 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:09:56.403082 1560 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:09:56.403946 1560 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:09:56.405366 1560 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:09:56.405476 1560 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:56.405591 1560 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:09:56.405666 1560 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:56.436055 1560 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:46113
I20260812 01:09:56.436093 1776 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:46113 every 8 connection(s)
I20260812 01:09:56.437338 1560 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:09:56.437587 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 1560
I20260812 01:09:56.437734 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance
I20260812 01:09:56.438215 4901 external_mini_cluster.cc:1428] Setting key c17bfa4cc2396f58f0cc9cec53352061
I20260812 01:09:56.441440 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:0
--local_ip_for_outbound_sockets=127.4.201.66
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:40411
--builtin_ntp_servers=127.4.201.84:45015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 01:09:56.449759 1779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:56.439930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:38349 (local address 127.4.201.126:40411)
0812 01:09:56.440328 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:56.440335 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:56.443492 (+ 3157us) server_negotiation.cc:407] Connection header received
0812 01:09:56.443548 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:56.443552 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:56.443613 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:56.443703 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:09:56.444778 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:56.445532 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:56.447021 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:56.447424 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:56.447548 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:56.448847 (+ 1299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:09:56.448852 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:09:56.448855 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:09:56.448872 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:09:56.448911 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:09:56.448923 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:09:56.448998 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:56.449282 (+ 284us) server_negotiation.cc:299] Negotiation successful
0812 01:09:56.449378 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":194,"threads_started":1}
I20260812 01:09:56.450608 1782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:56.440564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:40411 (local address 127.4.201.65:38349)
0812 01:09:56.441608 (+ 1044us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:56.441652 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 01:09:56.443226 (+ 1574us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:09:56.443958 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:09:56.443967 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:09:56.444058 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:09:56.444608 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:56.444626 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:56.445687 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:56.445691 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:56.446876 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:56.446889 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:56.447638 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:56.447646 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:56.447866 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:56.448563 (+ 697us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:09:56.448565 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:09:56.448603 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:09:56.448674 (+ 71us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:09:56.449028 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:09:56.449041 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:09:56.449048 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 01:09:56.449233 (+ 185us) client_negotiation.cc:240] Negotiation successful
0812 01:09:56.449603 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":322,"threads_started":1}
I20260812 01:09:56.451941 1777 heartbeater.cc:347] Connected to a master server at 127.4.201.126:40411
I20260812 01:09:56.452212 1777 heartbeater.cc:464] Registering TS with master...
I20260812 01:09:56.452924 1777 heartbeater.cc:511] Master 127.4.201.126:40411 requested a full tablet report, sending...
I20260812 01:09:56.455246 1473 ts_manager.cc:194] Registered new tserver with Master: 176e45e5ca024573b26b83b6c4b9587a (127.4.201.65:46113)
I20260812 01:09:56.457199 1473 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.201.65:38349
W20260812 01:09:56.774776 1783 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:09:56.775053 1783 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:09:56.775149 1783 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:09:56.782104 1783 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:09:56.782195 1783 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:09:56.782303 1783 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:09:56.790930 1783 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:45015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:40411
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:09:56.792183 1783 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:09:56.793937 1783 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:09:56.806536 1795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:09:56.806536 1800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:09:56.806569 1797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:09:56.807314 1783 server_base.cc:1034] running on GCE node
I20260812 01:09:56.807896 1783 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:09:56.808773 1783 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:09:56.809976 1783 hybrid_clock.cc:648] HybridClock initialized: now 1786496996809915 us; error 48 us; skew 500 ppm
I20260812 01:09:56.810281 1783 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:09:56.812428 1783 webserver.cc:460] Webserver started at http://127.4.201.66:41233/ using document root <none> and password file <none>
I20260812 01:09:56.813078 1783 fs_manager.cc:359] Metadata directory not provided
I20260812 01:09:56.813181 1783 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:09:56.813513 1783 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:09:56.816244 1783 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-1/data/instance:
uuid: "87085bb0536e49d9a1451b4a07ecfffd"
format_stamp: "Formatted at 2026-08-12 01:09:56 on dist-test-slave-bndk"
server_key: "bd1e4b235afc89ec07c531667d1dea3a"
server_key_iv: "c28e49e9257573d4b0baf98ae7754b30"
server_key_version: "encryptionkey@0"
I20260812 01:09:56.817008 1783 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance:
uuid: "87085bb0536e49d9a1451b4a07ecfffd"
format_stamp: "Formatted at 2026-08-12 01:09:56 on dist-test-slave-bndk"
server_key: "bd1e4b235afc89ec07c531667d1dea3a"
server_key_iv: "c28e49e9257573d4b0baf98ae7754b30"
server_key_version: "encryptionkey@0"
I20260812 01:09:56.821810 1783 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260812 01:09:56.825130 1808 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:56.826437 1783 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 01:09:56.826592 1783 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "87085bb0536e49d9a1451b4a07ecfffd"
format_stamp: "Formatted at 2026-08-12 01:09:56 on dist-test-slave-bndk"
server_key: "bd1e4b235afc89ec07c531667d1dea3a"
server_key_iv: "c28e49e9257573d4b0baf98ae7754b30"
server_key_version: "encryptionkey@0"
I20260812 01:09:56.826784 1783 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:09:56.838503 1783 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:09:56.839267 1783 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:09:56.839548 1783 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:09:56.840447 1783 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:09:56.841903 1783 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:09:56.842010 1783 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:56.842126 1783 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:09:56.842199 1783 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:56.872180 1783 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:34411
I20260812 01:09:56.872246 1997 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:34411 every 8 connection(s)
I20260812 01:09:56.873520 1783 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:09:56.881836 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 1783
I20260812 01:09:56.882021 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance
I20260812 01:09:56.882447 4901 external_mini_cluster.cc:1428] Setting key 9734610970d6a3c62def1b4c5737c010
I20260812 01:09:56.885682 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:0
--local_ip_for_outbound_sockets=127.4.201.67
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:40411
--builtin_ntp_servers=127.4.201.84:45015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 01:09:56.885733 1779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:56.875938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:53471 (local address 127.4.201.126:40411)
0812 01:09:56.876099 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:56.876103 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:56.877495 (+ 1392us) server_negotiation.cc:407] Connection header received
0812 01:09:56.879160 (+ 1665us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:56.879164 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:56.879233 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:56.879318 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:09:56.880263 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:56.880962 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:56.882576 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:56.883122 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:56.883251 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:56.884756 (+ 1505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:09:56.884763 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:09:56.884767 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:09:56.884790 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:09:56.884827 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:09:56.884843 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:09:56.884938 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:56.885184 (+ 246us) server_negotiation.cc:299] Negotiation successful
0812 01:09:56.885431 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 01:09:56.886751 2002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:56.876415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:40411 (local address 127.4.201.66:53471)
0812 01:09:56.877329 (+ 914us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:56.877365 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 01:09:56.878935 (+ 1570us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:09:56.879500 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:09:56.879507 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:09:56.879592 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:09:56.880123 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:56.880139 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:56.881088 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:56.881092 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:56.882407 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:56.882421 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:56.883492 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:56.883503 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:56.883748 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:56.884386 (+ 638us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:09:56.884389 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:09:56.884456 (+ 67us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:09:56.884540 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:09:56.884950 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:09:56.884962 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:09:56.884970 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 01:09:56.885166 (+ 196us) client_negotiation.cc:240] Negotiation successful
0812 01:09:56.885563 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":264,"threads_started":1}
I20260812 01:09:56.888217 1998 heartbeater.cc:347] Connected to a master server at 127.4.201.126:40411
I20260812 01:09:56.888518 1998 heartbeater.cc:464] Registering TS with master...
I20260812 01:09:56.889353 1998 heartbeater.cc:511] Master 127.4.201.126:40411 requested a full tablet report, sending...
I20260812 01:09:56.890829 1473 ts_manager.cc:194] Registered new tserver with Master: 87085bb0536e49d9a1451b4a07ecfffd (127.4.201.66:34411)
I20260812 01:09:56.891989 1473 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.201.66:53471
W20260812 01:09:57.224144 2003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:09:57.224455 2003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:09:57.224591 2003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:09:57.232055 2003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:09:57.232172 2003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:09:57.232331 2003 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:09:57.241438 2003 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:45015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:40411
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:09:57.242703 2003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:09:57.244500 2003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:09:57.257524 2013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:09:57.257575 2018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:09:57.257472 2016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:09:57.258155 2003 server_base.cc:1034] running on GCE node
I20260812 01:09:57.258760 2003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:09:57.259655 2003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:09:57.260861 2003 hybrid_clock.cc:648] HybridClock initialized: now 1786496997260814 us; error 36 us; skew 500 ppm
I20260812 01:09:57.261174 2003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:09:57.263334 2003 webserver.cc:460] Webserver started at http://127.4.201.67:45721/ using document root <none> and password file <none>
I20260812 01:09:57.263983 2003 fs_manager.cc:359] Metadata directory not provided
I20260812 01:09:57.264088 2003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:09:57.264393 2003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:09:57.267169 2003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-2/data/instance:
uuid: "61a26c5095d34de3813e8e20e7838cd3"
format_stamp: "Formatted at 2026-08-12 01:09:57 on dist-test-slave-bndk"
server_key: "11b6647c0bfa4410044ce8e5f40a3a44"
server_key_iv: "88342c3740e6897fcf23fe02b4237894"
server_key_version: "encryptionkey@0"
I20260812 01:09:57.267956 2003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance:
uuid: "61a26c5095d34de3813e8e20e7838cd3"
format_stamp: "Formatted at 2026-08-12 01:09:57 on dist-test-slave-bndk"
server_key: "11b6647c0bfa4410044ce8e5f40a3a44"
server_key_iv: "88342c3740e6897fcf23fe02b4237894"
server_key_version: "encryptionkey@0"
I20260812 01:09:57.272754 2003 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260812 01:09:57.276054 2025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:57.277314 2003 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 01:09:57.277457 2003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "61a26c5095d34de3813e8e20e7838cd3"
format_stamp: "Formatted at 2026-08-12 01:09:57 on dist-test-slave-bndk"
server_key: "11b6647c0bfa4410044ce8e5f40a3a44"
server_key_iv: "88342c3740e6897fcf23fe02b4237894"
server_key_version: "encryptionkey@0"
I20260812 01:09:57.277657 2003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:09:57.305487 2003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:09:57.306318 2003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:09:57.306612 2003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:09:57.307551 2003 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:09:57.309001 2003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:09:57.309100 2003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:09:57.309211 2003 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:09:57.309306 2003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260812 01:09:57.339730 2003 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:37657
I20260812 01:09:57.339795 2208 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:37657 every 8 connection(s)
I20260812 01:09:57.340986 2003 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:09:57.349164 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 2003
I20260812 01:09:57.349382 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance
I20260812 01:09:57.350039 4901 external_mini_cluster.cc:1428] Setting key 3b9c4e5621d06e3a2e66c2cfde20106e
I20260812 01:09:57.353945 1779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:57.343490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:53317 (local address 127.4.201.126:40411)
0812 01:09:57.343729 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:57.343735 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:57.345093 (+ 1358us) server_negotiation.cc:407] Connection header received
0812 01:09:57.346914 (+ 1821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:57.346920 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:57.347006 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:57.347099 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:09:57.348172 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:57.348996 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:57.351060 (+ 2064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:57.351584 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:57.351722 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:57.353259 (+ 1537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:09:57.353266 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:09:57.353271 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:09:57.353291 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:09:57.353324 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:09:57.353337 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:09:57.353405 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:57.353617 (+ 212us) server_negotiation.cc:299] Negotiation successful
0812 01:09:57.353697 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260812 01:09:57.354959 2211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:57.344053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:40411 (local address 127.4.201.67:53317)
0812 01:09:57.344928 (+ 875us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:57.344964 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 01:09:57.346604 (+ 1640us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:09:57.347301 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:09:57.347309 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:09:57.347395 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:09:57.347993 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:57.348017 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:57.349162 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:57.349168 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:57.350871 (+ 1703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:57.350885 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:57.351832 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:57.351842 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:57.352118 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:57.352849 (+ 731us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:09:57.352853 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:09:57.352918 (+ 65us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:09:57.353024 (+ 106us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:09:57.353423 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:09:57.353431 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:09:57.353437 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 01:09:57.353601 (+ 164us) client_negotiation.cc:240] Negotiation successful
0812 01:09:57.353890 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":275,"threads_started":1}
I20260812 01:09:57.356292 2209 heartbeater.cc:347] Connected to a master server at 127.4.201.126:40411
I20260812 01:09:57.356549 2209 heartbeater.cc:464] Registering TS with master...
I20260812 01:09:57.357298 2209 heartbeater.cc:511] Master 127.4.201.126:40411 requested a full tablet report, sending...
I20260812 01:09:57.358644 1473 ts_manager.cc:194] Registered new tserver with Master: 61a26c5095d34de3813e8e20e7838cd3 (127.4.201.67:37657)
I20260812 01:09:57.359427 1473 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.201.67:53317
I20260812 01:09:57.365270 4901 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:09:57.374646 1779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:57.369170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42698 (local address 127.4.201.126:40411)
0812 01:09:57.369352 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:57.369358 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:57.369867 (+ 509us) server_negotiation.cc:407] Connection header received
0812 01:09:57.370007 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:57.370010 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:57.370081 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:57.370159 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:09:57.370634 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:57.371448 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:57.372764 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:57.373158 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:57.373276 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:57.374140 (+ 864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:09:57.374145 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:09:57.374148 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:09:57.374165 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:09:57.374195 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:09:57.374206 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:09:57.374273 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:57.374356 (+ 83us) server_negotiation.cc:299] Negotiation successful
0812 01:09:57.374427 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260812 01:09:57.378332 1473 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42698:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:09:57.385283 1473 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:09:57.410507 2232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:57.397937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56238 (local address 127.4.201.65:46113)
0812 01:09:57.399543 (+ 1606us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:57.399553 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:57.403157 (+ 3604us) server_negotiation.cc:407] Connection header received
0812 01:09:57.403345 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:57.403353 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:57.403634 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:57.403838 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:09:57.404572 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:57.405785 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:57.408004 (+ 2219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:57.409436 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:57.409567 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:57.409818 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:57.410014 (+ 196us) server_negotiation.cc:299] Negotiation successful
0812 01:09:57.410174 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1421,"thread_start_us":1289,"threads_started":1}
I20260812 01:09:57.410499 2228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:57.397395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:46113 (local address 127.0.0.1:56238)
0812 01:09:57.403015 (+ 5620us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:57.403035 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 01:09:57.403170 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:09:57.403940 (+ 770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:09:57.403947 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:09:57.403990 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:09:57.404369 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:57.404383 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:57.405926 (+ 1543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:57.405931 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:57.407798 (+ 1867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:57.407814 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:57.409597 (+ 1783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:57.409603 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:57.409778 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:57.409826 (+ 48us) client_negotiation.cc:769] Sending connection context
0812 01:09:57.409956 (+ 130us) client_negotiation.cc:240] Negotiation successful
0812 01:09:57.410148 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5456,"mutex_wait_us":35,"thread_start_us":5309,"threads_started":1}
I20260812 01:09:57.411926 2225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:57.397165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:34411 (local address 127.0.0.1:41258)
0812 01:09:57.400121 (+ 2956us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:57.400158 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 01:09:57.401420 (+ 1262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:09:57.404530 (+ 3110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:09:57.404535 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:09:57.404559 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:09:57.404916 (+ 357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:57.404929 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:57.406864 (+ 1935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:57.406868 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:57.409316 (+ 2448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:57.409334 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:57.411070 (+ 1736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:57.411077 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:57.411349 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:57.411389 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 01:09:57.411479 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 01:09:57.411597 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2698,"mutex_wait_us":115,"thread_start_us":2535,"threads_started":1}
I20260812 01:09:57.412081 2230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:57.397431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41258 (local address 127.4.201.66:34411)
0812 01:09:57.403915 (+ 6484us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:57.403923 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:57.403952 (+ 29us) server_negotiation.cc:407] Connection header received
0812 01:09:57.404059 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:57.404068 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:57.404305 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:57.405121 (+ 816us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:09:57.405406 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:57.406740 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:57.409511 (+ 2771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:57.410832 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:57.411010 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:57.411214 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:57.411541 (+ 327us) server_negotiation.cc:299] Negotiation successful
0812 01:09:57.411716 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6336,"thread_start_us":6219,"threads_started":1}
I20260812 01:09:57.412123 2235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:57.400841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37388 (local address 127.4.201.67:37657)
0812 01:09:57.402516 (+ 1675us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:57.402525 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:57.403711 (+ 1186us) server_negotiation.cc:407] Connection header received
0812 01:09:57.404341 (+ 630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:57.404348 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:57.404554 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:57.404710 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:09:57.405604 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:57.406664 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:57.409354 (+ 2690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:57.410709 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:57.410840 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:57.411105 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:57.411648 (+ 543us) server_negotiation.cc:299] Negotiation successful
0812 01:09:57.411786 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1505,"thread_start_us":1310,"threads_started":1}
I20260812 01:09:57.412773 2238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:57.401417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:37657 (local address 127.0.0.1:37388)
0812 01:09:57.403606 (+ 2189us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:57.403621 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 01:09:57.404142 (+ 521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:09:57.405028 (+ 886us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:09:57.405032 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:09:57.405057 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:09:57.405428 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:57.405442 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:57.406800 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:57.406805 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:57.409152 (+ 2347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:57.409165 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:57.411245 (+ 2080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:57.411252 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:57.411439 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:57.411477 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 01:09:57.412332 (+ 855us) client_negotiation.cc:240] Negotiation successful
0812 01:09:57.412458 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2079,"mutex_wait_us":119,"thread_start_us":1963,"threads_started":1}
I20260812 01:09:57.414958 1676 tablet_service.cc:1467] Processing CreateTablet for tablet dc279d441ad5441ba1814c112b2adef9 (DEFAULT_TABLE table=test-table [id=8a4c422448804474a0517524f5af951e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:09:57.415503 1887 tablet_service.cc:1467] Processing CreateTablet for tablet dc279d441ad5441ba1814c112b2adef9 (DEFAULT_TABLE table=test-table [id=8a4c422448804474a0517524f5af951e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:09:57.416510 1676 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc279d441ad5441ba1814c112b2adef9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:09:57.416596 1887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc279d441ad5441ba1814c112b2adef9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:09:57.416472 2109 tablet_service.cc:1467] Processing CreateTablet for tablet dc279d441ad5441ba1814c112b2adef9 (DEFAULT_TABLE table=test-table [id=8a4c422448804474a0517524f5af951e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:09:57.417867 2109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc279d441ad5441ba1814c112b2adef9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:09:57.429951 2243 tablet_bootstrap.cc:492] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd: Bootstrap starting.
I20260812 01:09:57.433116 2246 tablet_bootstrap.cc:492] T dc279d441ad5441ba1814c112b2adef9 P 176e45e5ca024573b26b83b6c4b9587a: Bootstrap starting.
I20260812 01:09:57.432329 2247 tablet_bootstrap.cc:492] T dc279d441ad5441ba1814c112b2adef9 P 61a26c5095d34de3813e8e20e7838cd3: Bootstrap starting.
I20260812 01:09:57.434271 2243 tablet_bootstrap.cc:654] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd: Neither blocks nor log segments found. Creating new log.
I20260812 01:09:57.435671 2243 log.cc:824] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd: Log is configured to *not* fsync() on all Append() calls
I20260812 01:09:57.436273 2247 tablet_bootstrap.cc:654] T dc279d441ad5441ba1814c112b2adef9 P 61a26c5095d34de3813e8e20e7838cd3: Neither blocks nor log segments found. Creating new log.
I20260812 01:09:57.436736 2246 tablet_bootstrap.cc:654] T dc279d441ad5441ba1814c112b2adef9 P 176e45e5ca024573b26b83b6c4b9587a: Neither blocks nor log segments found. Creating new log.
I20260812 01:09:57.437548 2247 log.cc:824] T dc279d441ad5441ba1814c112b2adef9 P 61a26c5095d34de3813e8e20e7838cd3: Log is configured to *not* fsync() on all Append() calls
I20260812 01:09:57.438438 2246 log.cc:824] T dc279d441ad5441ba1814c112b2adef9 P 176e45e5ca024573b26b83b6c4b9587a: Log is configured to *not* fsync() on all Append() calls
I20260812 01:09:57.445863 2243 tablet_bootstrap.cc:492] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd: No bootstrap required, opened a new log
I20260812 01:09:57.446189 2243 ts_tablet_manager.cc:1397] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd: Time spent bootstrapping tablet: real 0.016s user 0.010s sys 0.004s
I20260812 01:09:57.447783 2246 tablet_bootstrap.cc:492] T dc279d441ad5441ba1814c112b2adef9 P 176e45e5ca024573b26b83b6c4b9587a: No bootstrap required, opened a new log
I20260812 01:09:57.448190 2246 ts_tablet_manager.cc:1397] T dc279d441ad5441ba1814c112b2adef9 P 176e45e5ca024573b26b83b6c4b9587a: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.005s
I20260812 01:09:57.455200 2247 tablet_bootstrap.cc:492] T dc279d441ad5441ba1814c112b2adef9 P 61a26c5095d34de3813e8e20e7838cd3: No bootstrap required, opened a new log
I20260812 01:09:57.455513 2247 ts_tablet_manager.cc:1397] T dc279d441ad5441ba1814c112b2adef9 P 61a26c5095d34de3813e8e20e7838cd3: Time spent bootstrapping tablet: real 0.023s user 0.016s sys 0.005s
I20260812 01:09:57.456806 2246 raft_consensus.cc:348] T dc279d441ad5441ba1814c112b2adef9 P 176e45e5ca024573b26b83b6c4b9587a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87085bb0536e49d9a1451b4a07ecfffd" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 34411 } } peers { permanent_uuid: "176e45e5ca024573b26b83b6c4b9587a" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 46113 } } peers { permanent_uuid: "61a26c5095d34de3813e8e20e7838cd3" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37657 } }
I20260812 01:09:57.457154 2246 raft_consensus.cc:374] T dc279d441ad5441ba1814c112b2adef9 P 176e45e5ca024573b26b83b6c4b9587a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:09:57.457307 2246 raft_consensus.cc:729] T dc279d441ad5441ba1814c112b2adef9 P 176e45e5ca024573b26b83b6c4b9587a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 176e45e5ca024573b26b83b6c4b9587a, State: Initialized, Role: FOLLOWER
I20260812 01:09:57.457338 2243 raft_consensus.cc:348] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87085bb0536e49d9a1451b4a07ecfffd" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 34411 } } peers { permanent_uuid: "176e45e5ca024573b26b83b6c4b9587a" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 46113 } } peers { permanent_uuid: "61a26c5095d34de3813e8e20e7838cd3" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37657 } }
I20260812 01:09:57.457763 2243 raft_consensus.cc:374] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:09:57.457861 2243 raft_consensus.cc:729] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87085bb0536e49d9a1451b4a07ecfffd, State: Initialized, Role: FOLLOWER
I20260812 01:09:57.457912 2246 consensus_queue.cc:260] T dc279d441ad5441ba1814c112b2adef9 P 176e45e5ca024573b26b83b6c4b9587a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87085bb0536e49d9a1451b4a07ecfffd" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 34411 } } peers { permanent_uuid: "176e45e5ca024573b26b83b6c4b9587a" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 46113 } } peers { permanent_uuid: "61a26c5095d34de3813e8e20e7838cd3" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37657 } }
I20260812 01:09:57.458426 2243 consensus_queue.cc:260] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87085bb0536e49d9a1451b4a07ecfffd" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 34411 } } peers { permanent_uuid: "176e45e5ca024573b26b83b6c4b9587a" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 46113 } } peers { permanent_uuid: "61a26c5095d34de3813e8e20e7838cd3" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37657 } }
I20260812 01:09:57.459017 1777 heartbeater.cc:503] Master 127.4.201.126:40411 was elected leader, sending a full tablet report...
I20260812 01:09:57.459652 2246 ts_tablet_manager.cc:1428] T dc279d441ad5441ba1814c112b2adef9 P 176e45e5ca024573b26b83b6c4b9587a: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260812 01:09:57.460608 1998 heartbeater.cc:503] Master 127.4.201.126:40411 was elected leader, sending a full tablet report...
I20260812 01:09:57.461199 2243 ts_tablet_manager.cc:1428] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd: Time spent starting tablet: real 0.015s user 0.009s sys 0.004s
I20260812 01:09:57.465157 2247 raft_consensus.cc:348] T dc279d441ad5441ba1814c112b2adef9 P 61a26c5095d34de3813e8e20e7838cd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87085bb0536e49d9a1451b4a07ecfffd" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 34411 } } peers { permanent_uuid: "176e45e5ca024573b26b83b6c4b9587a" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 46113 } } peers { permanent_uuid: "61a26c5095d34de3813e8e20e7838cd3" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37657 } }
I20260812 01:09:57.465587 2247 raft_consensus.cc:374] T dc279d441ad5441ba1814c112b2adef9 P 61a26c5095d34de3813e8e20e7838cd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:09:57.465699 2247 raft_consensus.cc:729] T dc279d441ad5441ba1814c112b2adef9 P 61a26c5095d34de3813e8e20e7838cd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61a26c5095d34de3813e8e20e7838cd3, State: Initialized, Role: FOLLOWER
I20260812 01:09:57.466249 2247 consensus_queue.cc:260] T dc279d441ad5441ba1814c112b2adef9 P 61a26c5095d34de3813e8e20e7838cd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87085bb0536e49d9a1451b4a07ecfffd" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 34411 } } peers { permanent_uuid: "176e45e5ca024573b26b83b6c4b9587a" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 46113 } } peers { permanent_uuid: "61a26c5095d34de3813e8e20e7838cd3" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37657 } }
I20260812 01:09:57.467212 2209 heartbeater.cc:503] Master 127.4.201.126:40411 was elected leader, sending a full tablet report...
I20260812 01:09:57.467831 2247 ts_tablet_manager.cc:1428] T dc279d441ad5441ba1814c112b2adef9 P 61a26c5095d34de3813e8e20e7838cd3: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
W20260812 01:09:57.592717 2210 tablet.cc:2369] T dc279d441ad5441ba1814c112b2adef9 P 61a26c5095d34de3813e8e20e7838cd3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:09:57.625545 2001 tablet.cc:2369] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:09:57.690006 1778 tablet.cc:2369] T dc279d441ad5441ba1814c112b2adef9 P 176e45e5ca024573b26b83b6c4b9587a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:09:57.807458 2254 raft_consensus.cc:482] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:09:57.807823 2254 raft_consensus.cc:504] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87085bb0536e49d9a1451b4a07ecfffd" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 34411 } } peers { permanent_uuid: "176e45e5ca024573b26b83b6c4b9587a" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 46113 } } peers { permanent_uuid: "61a26c5095d34de3813e8e20e7838cd3" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37657 } }
I20260812 01:09:57.809659 2254 leader_election.cc:288] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 176e45e5ca024573b26b83b6c4b9587a (127.4.201.65:46113), 61a26c5095d34de3813e8e20e7838cd3 (127.4.201.67:37657)
I20260812 01:09:57.816303 2235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:57.810094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:38379 (local address 127.4.201.67:37657)
0812 01:09:57.810321 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:57.810327 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:57.810997 (+ 670us) server_negotiation.cc:407] Connection header received
0812 01:09:57.811206 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:57.811210 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:57.811271 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:57.811365 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:09:57.811926 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:57.812642 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:57.814718 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:57.815443 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:57.815613 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:57.815684 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:57.815933 (+ 249us) server_negotiation.cc:299] Negotiation successful
0812 01:09:57.816065 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
I20260812 01:09:57.816416 2256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:57.810183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:37657 (local address 127.4.201.66:38379)
0812 01:09:57.810864 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:57.810880 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 01:09:57.811057 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:09:57.811457 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:09:57.811463 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:09:57.811500 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:09:57.811787 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:57.811795 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:57.812774 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:57.812778 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:57.814524 (+ 1746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:57.814540 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:57.815627 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:57.815634 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:57.815788 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:57.815813 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 01:09:57.815892 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 01:09:57.816012 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"mutex_wait_us":84,"thread_start_us":387,"threads_started":1}
I20260812 01:09:57.816418 2232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:57.810140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:39485 (local address 127.4.201.65:46113)
0812 01:09:57.810321 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:57.810328 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:57.811368 (+ 1040us) server_negotiation.cc:407] Connection header received
0812 01:09:57.811547 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:57.811551 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:57.811623 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:57.811701 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:09:57.812268 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:57.812955 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:57.814801 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:57.815543 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:57.815692 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:57.815761 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:57.816030 (+ 269us) server_negotiation.cc:299] Negotiation successful
0812 01:09:57.816155 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 01:09:57.816511 2262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:57.810216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:46113 (local address 127.4.201.66:39485)
0812 01:09:57.811247 (+ 1031us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:57.811261 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 01:09:57.811393 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:09:57.811746 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:09:57.811750 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:09:57.811782 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:09:57.812108 (+ 326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:57.812118 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:57.813100 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:57.813104 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:57.814614 (+ 1510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:09:57.814627 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:09:57.815730 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:09:57.815737 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:09:57.815871 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:57.815893 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 01:09:57.815981 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 01:09:57.816128 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":925,"mutex_wait_us":34,"thread_start_us":710,"threads_started":1}
I20260812 01:09:57.817416 2145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc279d441ad5441ba1814c112b2adef9" candidate_uuid: "87085bb0536e49d9a1451b4a07ecfffd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61a26c5095d34de3813e8e20e7838cd3" is_pre_election: true
I20260812 01:09:57.817497 1709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc279d441ad5441ba1814c112b2adef9" candidate_uuid: "87085bb0536e49d9a1451b4a07ecfffd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "176e45e5ca024573b26b83b6c4b9587a" is_pre_election: true
I20260812 01:09:57.817914 2145 raft_consensus.cc:2454] T dc279d441ad5441ba1814c112b2adef9 P 61a26c5095d34de3813e8e20e7838cd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87085bb0536e49d9a1451b4a07ecfffd in term 0.
I20260812 01:09:57.817965 1709 raft_consensus.cc:2454] T dc279d441ad5441ba1814c112b2adef9 P 176e45e5ca024573b26b83b6c4b9587a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87085bb0536e49d9a1451b4a07ecfffd in term 0.
I20260812 01:09:57.818534 1811 leader_election.cc:302] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 176e45e5ca024573b26b83b6c4b9587a, 87085bb0536e49d9a1451b4a07ecfffd; no voters:
I20260812 01:09:57.818943 2254 raft_consensus.cc:2781] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:09:57.819097 2254 raft_consensus.cc:482] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:09:57.819200 2254 raft_consensus.cc:3037] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:09:57.821382 2254 raft_consensus.cc:504] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87085bb0536e49d9a1451b4a07ecfffd" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 34411 } } peers { permanent_uuid: "176e45e5ca024573b26b83b6c4b9587a" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 46113 } } peers { permanent_uuid: "61a26c5095d34de3813e8e20e7838cd3" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37657 } }
I20260812 01:09:57.821961 2254 leader_election.cc:288] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd [CANDIDATE]: Term 1 election: Requested vote from peers 176e45e5ca024573b26b83b6c4b9587a (127.4.201.65:46113), 61a26c5095d34de3813e8e20e7838cd3 (127.4.201.67:37657)
I20260812 01:09:57.822379 1709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc279d441ad5441ba1814c112b2adef9" candidate_uuid: "87085bb0536e49d9a1451b4a07ecfffd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "176e45e5ca024573b26b83b6c4b9587a"
I20260812 01:09:57.822466 2145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc279d441ad5441ba1814c112b2adef9" candidate_uuid: "87085bb0536e49d9a1451b4a07ecfffd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61a26c5095d34de3813e8e20e7838cd3"
I20260812 01:09:57.822582 1709 raft_consensus.cc:3037] T dc279d441ad5441ba1814c112b2adef9 P 176e45e5ca024573b26b83b6c4b9587a [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:09:57.822660 2145 raft_consensus.cc:3037] T dc279d441ad5441ba1814c112b2adef9 P 61a26c5095d34de3813e8e20e7838cd3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:09:57.824815 1709 raft_consensus.cc:2454] T dc279d441ad5441ba1814c112b2adef9 P 176e45e5ca024573b26b83b6c4b9587a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87085bb0536e49d9a1451b4a07ecfffd in term 1.
I20260812 01:09:57.824978 2145 raft_consensus.cc:2454] T dc279d441ad5441ba1814c112b2adef9 P 61a26c5095d34de3813e8e20e7838cd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87085bb0536e49d9a1451b4a07ecfffd in term 1.
I20260812 01:09:57.825237 1811 leader_election.cc:302] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 176e45e5ca024573b26b83b6c4b9587a, 87085bb0536e49d9a1451b4a07ecfffd; no voters:
I20260812 01:09:57.825560 2254 raft_consensus.cc:2781] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:09:57.825992 2254 raft_consensus.cc:686] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd [term 1 LEADER]: Becoming Leader. State: Replica: 87085bb0536e49d9a1451b4a07ecfffd, State: Running, Role: LEADER
I20260812 01:09:57.826455 2254 consensus_queue.cc:237] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87085bb0536e49d9a1451b4a07ecfffd" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 34411 } } peers { permanent_uuid: "176e45e5ca024573b26b83b6c4b9587a" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 46113 } } peers { permanent_uuid: "61a26c5095d34de3813e8e20e7838cd3" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37657 } }
I20260812 01:09:57.831328 1473 catalog_manager.cc:5495] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd reported cstate change: term changed from 0 to 1, leader changed from <none> to 87085bb0536e49d9a1451b4a07ecfffd (127.4.201.66). New cstate: current_term: 1 leader_uuid: "87085bb0536e49d9a1451b4a07ecfffd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87085bb0536e49d9a1451b4a07ecfffd" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 34411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "176e45e5ca024573b26b83b6c4b9587a" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 46113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61a26c5095d34de3813e8e20e7838cd3" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37657 } health_report { overall_health: UNKNOWN } } }
I20260812 01:09:57.865645 2230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:57.860691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41264 (local address 127.4.201.66:34411)
0812 01:09:57.860905 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:57.860910 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:57.860932 (+ 22us) server_negotiation.cc:407] Connection header received
0812 01:09:57.861139 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:57.861143 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:57.861264 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:57.861394 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:09:57.861722 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:57.862408 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:57.863684 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:57.864090 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:57.864183 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:57.864600 (+ 417us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:09:57.865121 (+ 521us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:09:57.865270 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:57.865313 (+ 43us) server_negotiation.cc:299] Negotiation successful
0812 01:09:57.865378 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 01:09:57.874107 1709 raft_consensus.cc:1261] T dc279d441ad5441ba1814c112b2adef9 P 176e45e5ca024573b26b83b6c4b9587a [term 1 FOLLOWER]: Refusing update from remote peer 87085bb0536e49d9a1451b4a07ecfffd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:09:57.874219 2145 raft_consensus.cc:1261] T dc279d441ad5441ba1814c112b2adef9 P 61a26c5095d34de3813e8e20e7838cd3 [term 1 FOLLOWER]: Refusing update from remote peer 87085bb0536e49d9a1451b4a07ecfffd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:09:57.875099 2263 consensus_queue.cc:1035] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd [LEADER]: Connected to new peer: Peer: permanent_uuid: "176e45e5ca024573b26b83b6c4b9587a" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 46113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:09:57.875465 2254 consensus_queue.cc:1035] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd [LEADER]: Connected to new peer: Peer: permanent_uuid: "61a26c5095d34de3813e8e20e7838cd3" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 37657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:09:57.893114 2267 mvcc.cc:205] Tried to move back new op lower bound from 7317491703282036736 to 7317491703100968960. Current Snapshot: MvccSnapshot[applied={T|T < 7317491703282036736}]
I20260812 01:09:57.894102 2270 mvcc.cc:205] Tried to move back new op lower bound from 7317491703282036736 to 7317491703100968960. Current Snapshot: MvccSnapshot[applied={T|T < 7317491703282036736}]
I20260812 01:09:57.913591 1473 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42698:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:09:57.913858 1473 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42698:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:09:57.917490 1473 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ef7ab5975dd64c9c8b88eda1ef95e280: Sending DeleteTablet for 3 replicas of tablet dc279d441ad5441ba1814c112b2adef9
I20260812 01:09:57.918602 1676 tablet_service.cc:1514] Processing DeleteTablet for tablet dc279d441ad5441ba1814c112b2adef9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:09:57 UTC) from {username='slave'} at 127.0.0.1:56238
I20260812 01:09:57.918684 1887 tablet_service.cc:1514] Processing DeleteTablet for tablet dc279d441ad5441ba1814c112b2adef9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:09:57 UTC) from {username='slave'} at 127.0.0.1:41258
I20260812 01:09:57.919279 2109 tablet_service.cc:1514] Processing DeleteTablet for tablet dc279d441ad5441ba1814c112b2adef9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:09:57 UTC) from {username='slave'} at 127.0.0.1:37388
I20260812 01:09:57.920003 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 1560
I20260812 01:09:57.931602 2285 tablet_replica.cc:330] T dc279d441ad5441ba1814c112b2adef9 P 61a26c5095d34de3813e8e20e7838cd3: stopping tablet replica
I20260812 01:09:57.932099 2285 raft_consensus.cc:2229] T dc279d441ad5441ba1814c112b2adef9 P 61a26c5095d34de3813e8e20e7838cd3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:09:57.932686 2285 raft_consensus.cc:2258] T dc279d441ad5441ba1814c112b2adef9 P 61a26c5095d34de3813e8e20e7838cd3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:09:57.935385 2284 tablet_replica.cc:330] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd: stopping tablet replica
I20260812 01:09:57.935787 2284 raft_consensus.cc:2229] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:09:57.936529 2284 raft_consensus.cc:2258] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:09:57.936909 2285 ts_tablet_manager.cc:1905] T dc279d441ad5441ba1814c112b2adef9 P 61a26c5095d34de3813e8e20e7838cd3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:09:57.938860 2284 ts_tablet_manager.cc:1905] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:09:57.941725 2281 tablet_replica.cc:330] T dc279d441ad5441ba1814c112b2adef9 P 176e45e5ca024573b26b83b6c4b9587a: stopping tablet replica
I20260812 01:09:57.942242 2281 raft_consensus.cc:2229] T dc279d441ad5441ba1814c112b2adef9 P 176e45e5ca024573b26b83b6c4b9587a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:09:57.942833 2281 raft_consensus.cc:2258] T dc279d441ad5441ba1814c112b2adef9 P 176e45e5ca024573b26b83b6c4b9587a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:09:57.943913 2285 ts_tablet_manager.cc:1918] T dc279d441ad5441ba1814c112b2adef9 P 61a26c5095d34de3813e8e20e7838cd3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:09:57.944100 2285 log.cc:1196] T dc279d441ad5441ba1814c112b2adef9 P 61a26c5095d34de3813e8e20e7838cd3: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-2/wal/wals/dc279d441ad5441ba1814c112b2adef9
I20260812 01:09:57.944638 2285 ts_tablet_manager.cc:1939] T dc279d441ad5441ba1814c112b2adef9 P 61a26c5095d34de3813e8e20e7838cd3: Deleting consensus metadata
I20260812 01:09:57.946133 2284 ts_tablet_manager.cc:1918] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:09:57.946326 2284 log.cc:1196] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786496689953932-4901-0/minicluster-data/ts-1/wal/wals/dc279d441ad5441ba1814c112b2adef9
I20260812 01:09:57.946904 2284 ts_tablet_manager.cc:1939] T dc279d441ad5441ba1814c112b2adef9 P 87085bb0536e49d9a1451b4a07ecfffd: Deleting consensus metadata
I20260812 01:09:57.947201 1457 catalog_manager.cc:4841] TS 61a26c5095d34de3813e8e20e7838cd3 (127.4.201.67:37657): tablet dc279d441ad5441ba1814c112b2adef9 (table test-table [id=8a4c422448804474a0517524f5af951e]) successfully deleted
I20260812 01:09:57.948491 2232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:57.920907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56246 (local address 127.4.201.65:46113)
0812 01:09:57.921067 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:57.921073 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:57.935028 (+ 13955us) server_negotiation.cc:407] Connection header received
0812 01:09:57.936077 (+ 1049us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:57.936082 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:57.936192 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:57.936271 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:09:57.937850 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:57.938952 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:57.943047 (+ 4095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:57.943657 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:57.943758 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:57.946774 (+ 3016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:09:57.946785 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:09:57.946815 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:09:57.947540 (+ 725us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:09:57.947601 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:09:57.947626 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:09:57.947734 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:57.948045 (+ 311us) server_negotiation.cc:299] Negotiation successful
0812 01:09:57.948163 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 01:09:57.948700 1457 catalog_manager.cc:4841] TS 87085bb0536e49d9a1451b4a07ecfffd (127.4.201.66:34411): tablet dc279d441ad5441ba1814c112b2adef9 (table test-table [id=8a4c422448804474a0517524f5af951e]) successfully deleted
I20260812 01:09:57.949018 2281 ts_tablet_manager.cc:1905] T dc279d441ad5441ba1814c112b2adef9 P 176e45e5ca024573b26b83b6c4b9587a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:09:57.949190 1772 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:09:58.035871 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 1560
I20260812 01:09:58.067487 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 1783
W20260812 01:09:58.067562 1454 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.201.65:46113 (error 108)
I20260812 01:09:58.070410 2289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:58.069556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:46113 (local address 127.0.0.1:56256)
0812 01:09:58.070048 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:58.070190 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:46113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":220,"threads_started":1}
W20260812 01:09:58.070647 1454 catalog_manager.cc:4584] TS 176e45e5ca024573b26b83b6c4b9587a (127.4.201.65:46113): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet dc279d441ad5441ba1814c112b2adef9: Network error: Client connection negotiation failed: client connection to 127.4.201.65:46113: connect: Connection refused (error 111)
I20260812 01:09:58.075235 2230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:58.068239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41274 (local address 127.4.201.66:34411)
0812 01:09:58.068454 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:58.068460 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:58.068579 (+ 119us) server_negotiation.cc:407] Connection header received
0812 01:09:58.068781 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:58.068787 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:58.068908 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:58.069036 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:09:58.069675 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:58.070763 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:58.072110 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:58.072529 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:58.072645 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:58.073839 (+ 1194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:09:58.073848 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:09:58.073866 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:09:58.074484 (+ 618us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:09:58.074540 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:09:58.074567 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:09:58.074659 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:58.074811 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 01:09:58.074912 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 01:09:58.075966 1992 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:09:58.124217 2289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:58.123725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:46113 (local address 127.0.0.1:56262)
0812 01:09:58.123925 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:58.124030 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:46113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260812 01:09:58.125211 2289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:58.124873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:46113 (local address 127.0.0.1:56276)
0812 01:09:58.125010 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:58.125079 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:46113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260812 01:09:58.186089 2289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:58.185581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:46113 (local address 127.0.0.1:56280)
0812 01:09:58.185806 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:58.185923 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:46113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260812 01:09:58.186865 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 1783
I20260812 01:09:58.194293 2289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:58.193824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:46113 (local address 127.0.0.1:56282)
0812 01:09:58.194022 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:58.194119 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:46113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260812 01:09:58.211778 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 2003
I20260812 01:09:58.218290 2235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:58.212589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37402 (local address 127.4.201.67:37657)
0812 01:09:58.212773 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 01:09:58.212778 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:09:58.212797 (+ 19us) server_negotiation.cc:407] Connection header received
0812 01:09:58.212856 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:09:58.212859 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:09:58.212942 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:09:58.213033 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:09:58.213420 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:58.214128 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:58.215501 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:09:58.215901 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:09:58.216005 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:09:58.216933 (+ 928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:09:58.216943 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:09:58.216961 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:09:58.217617 (+ 656us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:09:58.217667 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:09:58.217688 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:09:58.217770 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 01:09:58.217887 (+ 117us) server_negotiation.cc:299] Negotiation successful
0812 01:09:58.217988 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 01:09:58.218930 2202 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:09:58.274863 2289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:58.274394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:46113 (local address 127.0.0.1:56286)
0812 01:09:58.274625 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:58.274714 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:46113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260812 01:09:58.275941 2289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:09:58.275509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:46113 (local address 127.0.0.1:56302)
0812 01:09:58.275706 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0812 01:09:58.275796 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:46113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260812 01:09:58.305511 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 2003
I20260812 01:09:58.330224 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 1431
I20260812 01:09:58.331439 1523 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:09:58.438445 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 1431
2026-08-12T01:09:58Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (3081 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:09:58 dist-test-slave-bndk krb5kdc[2301](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:09:58 dist-test-slave-bndk krb5kdc[2301](info): set up 2 sockets
Aug 12 01:09:58 dist-test-slave-bndk krb5kdc[2301](info): commencing operation
krb5kdc: starting...
W20260812 01:09:59.691879 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.208s user 0.000s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:09:59 dist-test-slave-bndk krb5kdc[2301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496999, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:09:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:09:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.201.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
I20260812 01:09:59.973806 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:39619
--webserver_interface=127.4.201.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:35605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:39619
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:10:00.308943 2329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:00.309257 2329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:00.309396 2329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:00.316449 2329 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:10:00.316560 2329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:00.316635 2329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:00.316709 2329 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:10:00.316769 2329 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:10:00.326448 2329 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:35605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:39619
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:39619
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:00.327790 2329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:00.329087 2329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:00.340627 2337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:00.340651 2338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:00.340580 2340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:00.341277 2329 server_base.cc:1034] running on GCE node
I20260812 01:10:00.342082 2329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:00.343413 2329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:00.344616 2329 hybrid_clock.cc:648] HybridClock initialized: now 1786497000344570 us; error 29 us; skew 500 ppm
I20260812 01:10:00.344946 2329 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:10:00 dist-test-slave-bndk krb5kdc[2301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497000, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:10:00.347978 2329 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:10:00.349434 2329 webserver.cc:460] Webserver started at http://127.4.201.126:41581/ using document root <none> and password file <none>
I20260812 01:10:00.350087 2329 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:00.350191 2329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:00.350453 2329 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:00.353446 2329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "300cb5a5001c4cf295bf5aab1ccd5b07"
format_stamp: "Formatted at 2026-08-12 01:10:00 on dist-test-slave-bndk"
server_key: "963ea72281af1f2ed1064e1389312755"
server_key_iv: "0144ed045cf795c09f71d58c8354333f"
server_key_version: "encryptionkey@0"
I20260812 01:10:00.354166 2329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "300cb5a5001c4cf295bf5aab1ccd5b07"
format_stamp: "Formatted at 2026-08-12 01:10:00 on dist-test-slave-bndk"
server_key: "963ea72281af1f2ed1064e1389312755"
server_key_iv: "0144ed045cf795c09f71d58c8354333f"
server_key_version: "encryptionkey@0"
I20260812 01:10:00.359316 2329 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 01:10:00.362675 2361 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:00.363927 2329 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 01:10:00.364094 2329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "300cb5a5001c4cf295bf5aab1ccd5b07"
format_stamp: "Formatted at 2026-08-12 01:10:00 on dist-test-slave-bndk"
server_key: "963ea72281af1f2ed1064e1389312755"
server_key_iv: "0144ed045cf795c09f71d58c8354333f"
server_key_version: "encryptionkey@0"
I20260812 01:10:00.364276 2329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:00.385331 2329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:00.389430 2329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:00.389715 2329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:00.407611 2329 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:39619
I20260812 01:10:00.407620 2433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:39619 every 8 connection(s)
I20260812 01:10:00.408985 2329 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:10:00.410573 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 2329
I20260812 01:10:00.410760 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:10:00.411346 4901 external_mini_cluster.cc:1428] Setting key bc148d08ab853504fb2c6439a31b0d7f
I20260812 01:10:00.413681 2434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 12 01:10:00 dist-test-slave-bndk krb5kdc[2301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496999, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:10:00.426393 2434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 300cb5a5001c4cf295bf5aab1ccd5b07: Bootstrap starting.
I20260812 01:10:00.430424 2434 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 300cb5a5001c4cf295bf5aab1ccd5b07: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:00.431635 2434 log.cc:824] T 00000000000000000000000000000000 P 300cb5a5001c4cf295bf5aab1ccd5b07: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:00.434571 2434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 300cb5a5001c4cf295bf5aab1ccd5b07: No bootstrap required, opened a new log
I20260812 01:10:00.434592 2439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:00.413233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43080 (local address 127.4.201.126:39619)
0812 01:10:00.413979 (+ 746us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:00.413990 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:00.414031 (+ 41us) server_negotiation.cc:407] Connection header received
0812 01:10:00.415644 (+ 1613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:00.415665 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:00.416019 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:00.416348 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:00.418191 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:00.419510 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:00.421319 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:00.421960 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:00.422080 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:00.426820 (+ 4740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:00.426832 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:00.426849 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:00.426895 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:00.430598 (+ 3703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:00.431252 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:00.431260 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:00.431273 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:00.431513 (+ 240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:00.431871 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:00.431875 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:00.431877 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:00.432430 (+ 553us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:00.432762 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:00.433170 (+ 408us) server_negotiation.cc:299] Negotiation successful
0812 01:10:00.433610 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":537,"thread_start_us":324,"threads_started":1}
I20260812 01:10:00.442078 2434 raft_consensus.cc:348] T 00000000000000000000000000000000 P 300cb5a5001c4cf295bf5aab1ccd5b07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "300cb5a5001c4cf295bf5aab1ccd5b07" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 39619 } }
I20260812 01:10:00.442435 2434 raft_consensus.cc:374] T 00000000000000000000000000000000 P 300cb5a5001c4cf295bf5aab1ccd5b07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:00.442559 2434 raft_consensus.cc:729] T 00000000000000000000000000000000 P 300cb5a5001c4cf295bf5aab1ccd5b07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 300cb5a5001c4cf295bf5aab1ccd5b07, State: Initialized, Role: FOLLOWER
I20260812 01:10:00.443071 2434 consensus_queue.cc:260] T 00000000000000000000000000000000 P 300cb5a5001c4cf295bf5aab1ccd5b07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "300cb5a5001c4cf295bf5aab1ccd5b07" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 39619 } }
I20260812 01:10:00.443271 2434 raft_consensus.cc:388] T 00000000000000000000000000000000 P 300cb5a5001c4cf295bf5aab1ccd5b07 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:10:00.443372 2434 raft_consensus.cc:482] T 00000000000000000000000000000000 P 300cb5a5001c4cf295bf5aab1ccd5b07 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:10:00.443506 2434 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 300cb5a5001c4cf295bf5aab1ccd5b07 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:00.445883 2434 raft_consensus.cc:504] T 00000000000000000000000000000000 P 300cb5a5001c4cf295bf5aab1ccd5b07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "300cb5a5001c4cf295bf5aab1ccd5b07" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 39619 } }
I20260812 01:10:00.446321 2434 leader_election.cc:302] T 00000000000000000000000000000000 P 300cb5a5001c4cf295bf5aab1ccd5b07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 300cb5a5001c4cf295bf5aab1ccd5b07; no voters:
I20260812 01:10:00.446848 2434 leader_election.cc:288] T 00000000000000000000000000000000 P 300cb5a5001c4cf295bf5aab1ccd5b07 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:10:00.446970 2443 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 300cb5a5001c4cf295bf5aab1ccd5b07 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:10:00.447587 2443 raft_consensus.cc:686] T 00000000000000000000000000000000 P 300cb5a5001c4cf295bf5aab1ccd5b07 [term 1 LEADER]: Becoming Leader. State: Replica: 300cb5a5001c4cf295bf5aab1ccd5b07, State: Running, Role: LEADER
I20260812 01:10:00.448137 2443 consensus_queue.cc:237] T 00000000000000000000000000000000 P 300cb5a5001c4cf295bf5aab1ccd5b07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "300cb5a5001c4cf295bf5aab1ccd5b07" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 39619 } }
I20260812 01:10:00.448726 2434 sys_catalog.cc:564] T 00000000000000000000000000000000 P 300cb5a5001c4cf295bf5aab1ccd5b07 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:10:00.450522 2449 sys_catalog.cc:455] T 00000000000000000000000000000000 P 300cb5a5001c4cf295bf5aab1ccd5b07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 300cb5a5001c4cf295bf5aab1ccd5b07. Latest consensus state: current_term: 1 leader_uuid: "300cb5a5001c4cf295bf5aab1ccd5b07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "300cb5a5001c4cf295bf5aab1ccd5b07" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 39619 } } }
I20260812 01:10:00.450990 2449 sys_catalog.cc:458] T 00000000000000000000000000000000 P 300cb5a5001c4cf295bf5aab1ccd5b07 [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:00.451016 2444 sys_catalog.cc:455] T 00000000000000000000000000000000 P 300cb5a5001c4cf295bf5aab1ccd5b07 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "300cb5a5001c4cf295bf5aab1ccd5b07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "300cb5a5001c4cf295bf5aab1ccd5b07" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 39619 } } }
I20260812 01:10:00.451386 2444 sys_catalog.cc:458] T 00000000000000000000000000000000 P 300cb5a5001c4cf295bf5aab1ccd5b07 [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:00.453652 2456 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:10:00.458485 2456 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:10:00.467193 2456 catalog_manager.cc:1347] Generated new cluster ID: 51259cc0e01c47eca3b7f8eda64f6556
I20260812 01:10:00.467306 2456 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:10:00.484050 2456 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:10:00.485893 2456 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:10:00.500485 2456 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 300cb5a5001c4cf295bf5aab1ccd5b07: Generated new TSK 0
I20260812 01:10:00.501576 2456 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.201.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
I20260812 01:10:00.588641 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:0
--local_ip_for_outbound_sockets=127.4.201.65
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:39619
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:35605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:10:00.926613 2474 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:00.926896 2474 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:00.927029 2474 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:00.934144 2474 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:00.934253 2474 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:00.934394 2474 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:10:00.943881 2474 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:35605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:39619
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:00.945073 2474 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:00.946388 2474 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:00.959455 2484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:00.959414 2485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:00.959589 2489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:00.960188 2474 server_base.cc:1034] running on GCE node
I20260812 01:10:00.960752 2474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:00.961653 2474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:00.962850 2474 hybrid_clock.cc:648] HybridClock initialized: now 1786497000962803 us; error 40 us; skew 500 ppm
I20260812 01:10:00.963137 2474 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:10:00 dist-test-slave-bndk krb5kdc[2301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497000, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:10:00.970131 2474 init.cc:377] Logged in from keytab as kudu/127.4.201.65@KRBTEST.COM (short username kudu)
I20260812 01:10:00.971525 2474 webserver.cc:460] Webserver started at http://127.4.201.65:41457/ using document root <none> and password file <none>
I20260812 01:10:00.972167 2474 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:00.972268 2474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:00.972543 2474 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:00.975348 2474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-0/data/instance:
uuid: "33819682d2b74f0eb6ee65616b750e57"
format_stamp: "Formatted at 2026-08-12 01:10:00 on dist-test-slave-bndk"
server_key: "61af841e68962913fa258bcdd315ecb2"
server_key_iv: "d2680704a9781459631a27e72b011b5e"
server_key_version: "encryptionkey@0"
I20260812 01:10:00.976083 2474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance:
uuid: "33819682d2b74f0eb6ee65616b750e57"
format_stamp: "Formatted at 2026-08-12 01:10:00 on dist-test-slave-bndk"
server_key: "61af841e68962913fa258bcdd315ecb2"
server_key_iv: "d2680704a9781459631a27e72b011b5e"
server_key_version: "encryptionkey@0"
I20260812 01:10:00.980970 2474 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 01:10:00.984287 2500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:00.985549 2474 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:10:00.985684 2474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "33819682d2b74f0eb6ee65616b750e57"
format_stamp: "Formatted at 2026-08-12 01:10:00 on dist-test-slave-bndk"
server_key: "61af841e68962913fa258bcdd315ecb2"
server_key_iv: "d2680704a9781459631a27e72b011b5e"
server_key_version: "encryptionkey@0"
I20260812 01:10:00.985842 2474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:01.005463 2474 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:01.009719 2474 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:01.009958 2474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:01.010877 2474 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:10:01.012171 2474 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:10:01.012245 2474 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:01.012336 2474 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:10:01.012378 2474 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:01.041936 2474 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:39759
I20260812 01:10:01.042006 2676 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:39759 every 8 connection(s)
I20260812 01:10:01.043169 2474 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:10:01.047652 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 2474
I20260812 01:10:01.047842 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance
I20260812 01:10:01.048429 4901 external_mini_cluster.cc:1428] Setting key 4b85ae3442bc0339d00fa1e7f93fc698
Aug 12 01:10:01 dist-test-slave-bndk krb5kdc[2301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497000, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:10:01.063910 2684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:01.045651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:43895 (local address 127.4.201.126:39619)
0812 01:10:01.046111 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:01.046116 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:01.047010 (+ 894us) server_negotiation.cc:407] Connection header received
0812 01:10:01.049405 (+ 2395us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:01.049411 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:01.049503 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:01.049600 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:01.051364 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:01.052064 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:01.054139 (+ 2075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:01.054562 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:01.054676 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:01.058487 (+ 3811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:01.058492 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:01.058496 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:01.058528 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:01.060936 (+ 2408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:01.061756 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:01.061760 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:01.061762 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:01.061882 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:01.062303 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:01.062305 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:01.062307 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:01.062549 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:01.062658 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:01.063435 (+ 777us) server_negotiation.cc:299] Negotiation successful
0812 01:10:01.063595 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":216,"threads_started":1}
I20260812 01:10:01.064851 2685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:01.046175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:39619 (local address 127.4.201.65:43895)
0812 01:10:01.046845 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:01.046890 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:01.049116 (+ 2226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:01.049844 (+ 728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:01.049851 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:01.050389 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:10:01.051167 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:01.051200 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:01.052232 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:01.052238 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:01.054013 (+ 1775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:01.054028 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:01.054785 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:01.054791 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:01.055049 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:01.055699 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:10:01.055727 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:10:01.058256 (+ 2529us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:10:01.061078 (+ 2822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:01.061086 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:01.061100 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:01.061654 (+ 554us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:01.061976 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:01.061986 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:01.061989 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:01.062214 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:01.062661 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:10:01.062669 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:10:01.063077 (+ 408us) client_negotiation.cc:769] Sending connection context
0812 01:10:01.063350 (+ 273us) client_negotiation.cc:240] Negotiation successful
0812 01:10:01.063825 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":255,"threads_started":1}
I20260812 01:10:01.066311 2679 heartbeater.cc:347] Connected to a master server at 127.4.201.126:39619
I20260812 01:10:01.066617 2679 heartbeater.cc:464] Registering TS with master...
I20260812 01:10:01.067505 2679 heartbeater.cc:511] Master 127.4.201.126:39619 requested a full tablet report, sending...
I20260812 01:10:01.069898 2380 ts_manager.cc:194] Registered new tserver with Master: 33819682d2b74f0eb6ee65616b750e57 (127.4.201.65:39759)
I20260812 01:10:01.071818 2380 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.65@KRBTEST.COM'} at 127.4.201.65:43895
WARNING: no policy specified for kudu/127.4.201.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
I20260812 01:10:01.113831 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:0
--local_ip_for_outbound_sockets=127.4.201.66
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:39619
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:35605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:10:01.444264 2692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:01.444541 2692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:01.444677 2692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:01.451835 2692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:01.451934 2692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:01.452080 2692 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:10:01.461398 2692 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:35605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:39619
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:01.462595 2692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:01.463852 2692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:01.476758 2705 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:01.476960 2709 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:01.476986 2701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:01.477849 2692 server_base.cc:1034] running on GCE node
I20260812 01:10:01.478392 2692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:01.479240 2692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:01.480440 2692 hybrid_clock.cc:648] HybridClock initialized: now 1786497001480394 us; error 33 us; skew 500 ppm
I20260812 01:10:01.480744 2692 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:10:01 dist-test-slave-bndk krb5kdc[2301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497001, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:10:01.483768 2692 init.cc:377] Logged in from keytab as kudu/127.4.201.66@KRBTEST.COM (short username kudu)
I20260812 01:10:01.485185 2692 webserver.cc:460] Webserver started at http://127.4.201.66:35891/ using document root <none> and password file <none>
I20260812 01:10:01.485878 2692 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:01.485991 2692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:01.486292 2692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:01.489128 2692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-1/data/instance:
uuid: "220df6baeccf4dcea80c28aafc3c6692"
format_stamp: "Formatted at 2026-08-12 01:10:01 on dist-test-slave-bndk"
server_key: "e41f741aefc26fffadb80253372a3a3f"
server_key_iv: "97b52ccae6cb00e9f9feb9e1449cbe8a"
server_key_version: "encryptionkey@0"
I20260812 01:10:01.489926 2692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance:
uuid: "220df6baeccf4dcea80c28aafc3c6692"
format_stamp: "Formatted at 2026-08-12 01:10:01 on dist-test-slave-bndk"
server_key: "e41f741aefc26fffadb80253372a3a3f"
server_key_iv: "97b52ccae6cb00e9f9feb9e1449cbe8a"
server_key_version: "encryptionkey@0"
I20260812 01:10:01.494932 2692 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260812 01:10:01.498257 2716 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:01.499488 2692 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 01:10:01.499616 2692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "220df6baeccf4dcea80c28aafc3c6692"
format_stamp: "Formatted at 2026-08-12 01:10:01 on dist-test-slave-bndk"
server_key: "e41f741aefc26fffadb80253372a3a3f"
server_key_iv: "97b52ccae6cb00e9f9feb9e1449cbe8a"
server_key_version: "encryptionkey@0"
I20260812 01:10:01.499779 2692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:01.524398 2692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:01.528246 2692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:01.528496 2692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:01.529397 2692 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:10:01.530660 2692 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:10:01.530732 2692 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:01.530823 2692 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:10:01.530865 2692 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:01.560977 2692 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:41185
I20260812 01:10:01.561028 2889 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:41185 every 8 connection(s)
I20260812 01:10:01.562216 2692 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:10:01.569459 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 2692
I20260812 01:10:01.569650 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance
I20260812 01:10:01.570103 4901 external_mini_cluster.cc:1428] Setting key ce355e30c5e845d5879228791d001015
Aug 12 01:10:01 dist-test-slave-bndk krb5kdc[2301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497001, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:10:01.582334 2896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:01.564563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:55919 (local address 127.4.201.126:39619)
0812 01:10:01.564969 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:01.564973 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:01.565968 (+ 995us) server_negotiation.cc:407] Connection header received
0812 01:10:01.567844 (+ 1876us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:01.567851 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:01.567937 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:01.568046 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:01.569762 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:01.570509 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:01.572264 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:01.572694 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:01.572803 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:01.576392 (+ 3589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:01.576397 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:01.576400 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:01.576434 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:01.578787 (+ 2353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:01.579642 (+ 855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:01.579666 (+ 24us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:01.579669 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:01.579827 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:01.580422 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:01.580427 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:01.580431 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:01.580776 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:01.580925 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:01.581732 (+ 807us) server_negotiation.cc:299] Negotiation successful
0812 01:10:01.581960 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":203,"threads_started":1}
I20260812 01:10:01.583269 2899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:01.565029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:39619 (local address 127.4.201.66:55919)
0812 01:10:01.565799 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:01.565854 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:01.567554 (+ 1700us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:01.568300 (+ 746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:01.568307 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:01.568795 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:10:01.569564 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:01.569594 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:01.570670 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:01.570675 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:01.572128 (+ 1453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:01.572144 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:01.572910 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:01.572917 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:01.573151 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:01.573796 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:10:01.573819 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:10:01.576176 (+ 2357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:10:01.578931 (+ 2755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:01.578940 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:01.578956 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:01.579505 (+ 549us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:01.579961 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:01.579966 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:01.579969 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:01.580222 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:01.580900 (+ 678us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:10:01.580908 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:10:01.581259 (+ 351us) client_negotiation.cc:769] Sending connection context
0812 01:10:01.581577 (+ 318us) client_negotiation.cc:240] Negotiation successful
0812 01:10:01.582084 (+ 507us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":289,"threads_started":1}
I20260812 01:10:01.586025 2891 heartbeater.cc:347] Connected to a master server at 127.4.201.126:39619
I20260812 01:10:01.586319 2891 heartbeater.cc:464] Registering TS with master...
I20260812 01:10:01.587097 2891 heartbeater.cc:511] Master 127.4.201.126:39619 requested a full tablet report, sending...
I20260812 01:10:01.588626 2380 ts_manager.cc:194] Registered new tserver with Master: 220df6baeccf4dcea80c28aafc3c6692 (127.4.201.66:41185)
I20260812 01:10:01.589524 2380 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.66@KRBTEST.COM'} at 127.4.201.66:55919
WARNING: no policy specified for kudu/127.4.201.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
I20260812 01:10:01.634262 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:0
--local_ip_for_outbound_sockets=127.4.201.67
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:39619
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:35605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:10:01.964774 2903 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:01.965052 2903 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:01.965161 2903 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:01.972345 2903 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:01.972462 2903 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:01.972584 2903 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:10:01.982244 2903 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:35605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:39619
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:01.983474 2903 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:01.984782 2903 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:01.997496 2910 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:01.997546 2913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:01.997483 2909 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:01.998332 2903 server_base.cc:1034] running on GCE node
I20260812 01:10:01.998888 2903 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:01.999765 2903 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:02.000959 2903 hybrid_clock.cc:648] HybridClock initialized: now 1786497002000913 us; error 31 us; skew 500 ppm
I20260812 01:10:02.001299 2903 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:10:01 dist-test-slave-bndk krb5kdc[2301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497001, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:10:02.004492 2903 init.cc:377] Logged in from keytab as kudu/127.4.201.67@KRBTEST.COM (short username kudu)
I20260812 01:10:02.005860 2903 webserver.cc:460] Webserver started at http://127.4.201.67:43965/ using document root <none> and password file <none>
I20260812 01:10:02.006500 2903 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:02.006604 2903 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:02.006870 2903 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:02.009840 2903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-2/data/instance:
uuid: "17078433d87e42babe4d4af528f684d7"
format_stamp: "Formatted at 2026-08-12 01:10:02 on dist-test-slave-bndk"
server_key: "186516c185fb7f9d9d8fa1a531f57e0a"
server_key_iv: "030b5dddc5d0d51270d595e20b5cbed1"
server_key_version: "encryptionkey@0"
I20260812 01:10:02.010589 2903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance:
uuid: "17078433d87e42babe4d4af528f684d7"
format_stamp: "Formatted at 2026-08-12 01:10:02 on dist-test-slave-bndk"
server_key: "186516c185fb7f9d9d8fa1a531f57e0a"
server_key_iv: "030b5dddc5d0d51270d595e20b5cbed1"
server_key_version: "encryptionkey@0"
I20260812 01:10:02.015403 2903 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 01:10:02.018637 2921 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:02.019832 2903 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 01:10:02.019970 2903 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "17078433d87e42babe4d4af528f684d7"
format_stamp: "Formatted at 2026-08-12 01:10:02 on dist-test-slave-bndk"
server_key: "186516c185fb7f9d9d8fa1a531f57e0a"
server_key_iv: "030b5dddc5d0d51270d595e20b5cbed1"
server_key_version: "encryptionkey@0"
I20260812 01:10:02.020161 2903 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:02.071774 2903 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:02.075233 2679 heartbeater.cc:503] Master 127.4.201.126:39619 was elected leader, sending a full tablet report...
I20260812 01:10:02.076148 2903 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:02.076465 2903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:02.077643 2903 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:10:02.078940 2903 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:10:02.079018 2903 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:02.079115 2903 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:10:02.079159 2903 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:02.110903 2903 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:34607
I20260812 01:10:02.110948 3100 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:34607 every 8 connection(s)
I20260812 01:10:02.112197 2903 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:10:02.112552 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 2903
I20260812 01:10:02.112723 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance
I20260812 01:10:02.113307 4901 external_mini_cluster.cc:1428] Setting key 324f3cebafd155b7b7a58b8f1bdf5420
Aug 12 01:10:02 dist-test-slave-bndk krb5kdc[2301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497001, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:10:02.131649 3104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:02.115053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:54365 (local address 127.4.201.126:39619)
0812 01:10:02.115548 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:02.115553 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:02.116696 (+ 1143us) server_negotiation.cc:407] Connection header received
0812 01:10:02.118494 (+ 1798us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:02.118498 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:02.118565 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:02.118660 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:02.120029 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.120791 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.122310 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.122692 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.122780 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:02.126148 (+ 3368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:02.126153 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:02.126156 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:02.126189 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:02.129116 (+ 2927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:02.129789 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:02.129793 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:02.129795 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:02.129919 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:02.130253 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:02.130255 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:02.130257 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:02.130513 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:02.130626 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:02.131193 (+ 567us) server_negotiation.cc:299] Negotiation successful
0812 01:10:02.131368 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":235,"threads_started":1}
I20260812 01:10:02.132578 3106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:02.115736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:39619 (local address 127.4.201.67:54365)
0812 01:10:02.116517 (+ 781us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:02.116562 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:02.118257 (+ 1695us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:02.118844 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:02.118852 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:02.119332 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:10:02.119893 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:02.119910 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.120922 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.120926 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:02.122186 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:02.122199 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.122855 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.122860 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:02.123115 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:02.123715 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:10:02.123737 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:10:02.125936 (+ 2199us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:10:02.129261 (+ 3325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:02.129268 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:02.129279 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:02.129688 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:02.129998 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:02.130001 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:02.130003 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:02.130172 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:02.130599 (+ 427us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:10:02.130605 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:10:02.130892 (+ 287us) client_negotiation.cc:769] Sending connection context
0812 01:10:02.131118 (+ 226us) client_negotiation.cc:240] Negotiation successful
0812 01:10:02.131497 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":303,"threads_started":1}
I20260812 01:10:02.133844 3102 heartbeater.cc:347] Connected to a master server at 127.4.201.126:39619
I20260812 01:10:02.134114 3102 heartbeater.cc:464] Registering TS with master...
I20260812 01:10:02.134768 3102 heartbeater.cc:511] Master 127.4.201.126:39619 requested a full tablet report, sending...
I20260812 01:10:02.136132 2380 ts_manager.cc:194] Registered new tserver with Master: 17078433d87e42babe4d4af528f684d7 (127.4.201.67:34607)
I20260812 01:10:02.136924 2380 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.67@KRBTEST.COM'} at 127.4.201.67:54365
I20260812 01:10:02.140802 4901 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:10:02.157298 3104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:02.144803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43090 (local address 127.4.201.126:39619)
0812 01:10:02.145043 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:02.145050 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:02.145445 (+ 395us) server_negotiation.cc:407] Connection header received
0812 01:10:02.145576 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:02.145580 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:02.145640 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:02.145716 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:02.147075 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.147796 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.149173 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.149633 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.149728 (+ 95us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:02.152193 (+ 2465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:02.152198 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:02.152201 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:02.152232 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:02.154827 (+ 2595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:02.155584 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:02.155589 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:02.155592 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:02.155749 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:02.156119 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:02.156122 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:02.156124 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:02.156428 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:02.156636 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:02.156888 (+ 252us) server_negotiation.cc:299] Negotiation successful
0812 01:10:02.157026 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 01:10:02.160992 2380 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43090:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:10:02.167954 2380 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:10:02.200445 3122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:02.179792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:41185 (local address 127.0.0.1:32994)
0812 01:10:02.191506 (+ 11714us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:02.191528 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:02.191742 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:02.192901 (+ 1159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:02.192909 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:02.192946 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:10:02.193442 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:02.193457 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.195264 (+ 1807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.195269 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:02.197265 (+ 1996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:02.197281 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.199343 (+ 2062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.199350 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:02.199565 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:02.199618 (+ 53us) client_negotiation.cc:769] Sending connection context
0812 01:10:02.199744 (+ 126us) client_negotiation.cc:240] Negotiation successful
0812 01:10:02.199938 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11589,"mutex_wait_us":41,"thread_start_us":12951,"threads_started":1}
I20260812 01:10:02.200620 3121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:02.180295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32994 (local address 127.4.201.66:41185)
0812 01:10:02.190842 (+ 10547us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:02.190852 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:02.191624 (+ 772us) server_negotiation.cc:407] Connection header received
0812 01:10:02.191953 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:02.191962 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:02.192367 (+ 405us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:02.192581 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:10:02.193634 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.195100 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.197424 (+ 2324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.198879 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.199013 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:02.199215 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:02.200122 (+ 907us) server_negotiation.cc:299] Negotiation successful
0812 01:10:02.200300 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9983,"thread_start_us":9834,"threads_started":1}
I20260812 01:10:02.201020 3124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:02.181154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40246 (local address 127.4.201.65:39759)
0812 01:10:02.191135 (+ 9981us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:02.191144 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:02.193341 (+ 2197us) server_negotiation.cc:407] Connection header received
0812 01:10:02.193439 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:02.193445 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:02.193632 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:02.193835 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:10:02.194572 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.196190 (+ 1618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.198515 (+ 2325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.199621 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.199751 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:02.199972 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:02.200547 (+ 575us) server_negotiation.cc:299] Negotiation successful
0812 01:10:02.200717 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9818,"thread_start_us":9705,"threads_started":1}
I20260812 01:10:02.201310 3118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:02.179504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:34607 (local address 127.0.0.1:59592)
0812 01:10:02.180421 (+ 917us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:02.180457 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:02.180633 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:02.193991 (+ 13358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:02.193995 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:02.194021 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:10:02.194442 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:02.194452 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.196574 (+ 2122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.196578 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:02.198663 (+ 2085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:02.198680 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.200457 (+ 1777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.200464 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:02.200629 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:02.200657 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 01:10:02.200718 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 01:10:02.200834 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":689,"mutex_wait_us":26,"thread_start_us":559,"threads_started":1}
I20260812 01:10:02.201743 3119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:02.179732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59592 (local address 127.4.201.67:34607)
0812 01:10:02.193449 (+ 13717us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:02.193456 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:02.193501 (+ 45us) server_negotiation.cc:407] Connection header received
0812 01:10:02.193598 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:02.193605 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:02.193772 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:02.194651 (+ 879us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:10:02.194938 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.196431 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.198848 (+ 2417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.200205 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.201047 (+ 842us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:02.201290 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:02.201356 (+ 66us) server_negotiation.cc:299] Negotiation successful
0812 01:10:02.201504 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13547,"thread_start_us":13342,"threads_started":1}
I20260812 01:10:02.202402 3120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:02.180860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:39759 (local address 127.0.0.1:40246)
0812 01:10:02.193085 (+ 12225us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:02.193104 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:02.193268 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:02.193834 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:02.193839 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:02.193865 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:10:02.194364 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:02.194380 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.196336 (+ 1956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.196342 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:02.198328 (+ 1986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:02.198343 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.199837 (+ 1494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.199844 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:02.200021 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:02.200053 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 01:10:02.200142 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 01:10:02.200266 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12081,"mutex_wait_us":67,"spinlock_wait_cycles":7040,"thread_start_us":10364,"threads_started":1}
I20260812 01:10:02.205116 2786 tablet_service.cc:1467] Processing CreateTablet for tablet 0fd207cb2e99409891646cc530400c99 (DEFAULT_TABLE table=test-table [id=9696e5d0725e4a0d842dfd546add2e7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:10:02.205418 2994 tablet_service.cc:1467] Processing CreateTablet for tablet 0fd207cb2e99409891646cc530400c99 (DEFAULT_TABLE table=test-table [id=9696e5d0725e4a0d842dfd546add2e7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:10:02.206465 2786 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0fd207cb2e99409891646cc530400c99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:02.206067 2579 tablet_service.cc:1467] Processing CreateTablet for tablet 0fd207cb2e99409891646cc530400c99 (DEFAULT_TABLE table=test-table [id=9696e5d0725e4a0d842dfd546add2e7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:10:02.206893 2994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0fd207cb2e99409891646cc530400c99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:02.207391 2579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0fd207cb2e99409891646cc530400c99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:02.217963 3125 tablet_bootstrap.cc:492] T 0fd207cb2e99409891646cc530400c99 P 220df6baeccf4dcea80c28aafc3c6692: Bootstrap starting.
I20260812 01:10:02.221108 3125 tablet_bootstrap.cc:654] T 0fd207cb2e99409891646cc530400c99 P 220df6baeccf4dcea80c28aafc3c6692: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:02.221980 3126 tablet_bootstrap.cc:492] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57: Bootstrap starting.
I20260812 01:10:02.222847 3127 tablet_bootstrap.cc:492] T 0fd207cb2e99409891646cc530400c99 P 17078433d87e42babe4d4af528f684d7: Bootstrap starting.
I20260812 01:10:02.223953 3125 log.cc:824] T 0fd207cb2e99409891646cc530400c99 P 220df6baeccf4dcea80c28aafc3c6692: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:02.226459 3127 tablet_bootstrap.cc:654] T 0fd207cb2e99409891646cc530400c99 P 17078433d87e42babe4d4af528f684d7: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:02.226675 3125 tablet_bootstrap.cc:492] T 0fd207cb2e99409891646cc530400c99 P 220df6baeccf4dcea80c28aafc3c6692: No bootstrap required, opened a new log
I20260812 01:10:02.226925 3125 ts_tablet_manager.cc:1397] T 0fd207cb2e99409891646cc530400c99 P 220df6baeccf4dcea80c28aafc3c6692: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260812 01:10:02.227699 3127 log.cc:824] T 0fd207cb2e99409891646cc530400c99 P 17078433d87e42babe4d4af528f684d7: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:02.228132 3126 tablet_bootstrap.cc:654] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:02.229158 3126 log.cc:824] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:02.230741 3127 tablet_bootstrap.cc:492] T 0fd207cb2e99409891646cc530400c99 P 17078433d87e42babe4d4af528f684d7: No bootstrap required, opened a new log
I20260812 01:10:02.231061 3127 ts_tablet_manager.cc:1397] T 0fd207cb2e99409891646cc530400c99 P 17078433d87e42babe4d4af528f684d7: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.002s
I20260812 01:10:02.232158 3126 tablet_bootstrap.cc:492] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57: No bootstrap required, opened a new log
I20260812 01:10:02.232417 3126 ts_tablet_manager.cc:1397] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260812 01:10:02.235170 3125 raft_consensus.cc:348] T 0fd207cb2e99409891646cc530400c99 P 220df6baeccf4dcea80c28aafc3c6692 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17078433d87e42babe4d4af528f684d7" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 34607 } } peers { permanent_uuid: "220df6baeccf4dcea80c28aafc3c6692" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 41185 } } peers { permanent_uuid: "33819682d2b74f0eb6ee65616b750e57" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 39759 } }
I20260812 01:10:02.235517 3125 raft_consensus.cc:374] T 0fd207cb2e99409891646cc530400c99 P 220df6baeccf4dcea80c28aafc3c6692 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:02.235646 3125 raft_consensus.cc:729] T 0fd207cb2e99409891646cc530400c99 P 220df6baeccf4dcea80c28aafc3c6692 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 220df6baeccf4dcea80c28aafc3c6692, State: Initialized, Role: FOLLOWER
I20260812 01:10:02.236222 3125 consensus_queue.cc:260] T 0fd207cb2e99409891646cc530400c99 P 220df6baeccf4dcea80c28aafc3c6692 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17078433d87e42babe4d4af528f684d7" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 34607 } } peers { permanent_uuid: "220df6baeccf4dcea80c28aafc3c6692" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 41185 } } peers { permanent_uuid: "33819682d2b74f0eb6ee65616b750e57" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 39759 } }
I20260812 01:10:02.237329 2891 heartbeater.cc:503] Master 127.4.201.126:39619 was elected leader, sending a full tablet report...
I20260812 01:10:02.237838 3125 ts_tablet_manager.cc:1428] T 0fd207cb2e99409891646cc530400c99 P 220df6baeccf4dcea80c28aafc3c6692: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260812 01:10:02.242655 3126 raft_consensus.cc:348] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17078433d87e42babe4d4af528f684d7" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 34607 } } peers { permanent_uuid: "220df6baeccf4dcea80c28aafc3c6692" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 41185 } } peers { permanent_uuid: "33819682d2b74f0eb6ee65616b750e57" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 39759 } }
I20260812 01:10:02.243271 3126 raft_consensus.cc:374] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:02.243381 3126 raft_consensus.cc:729] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33819682d2b74f0eb6ee65616b750e57, State: Initialized, Role: FOLLOWER
I20260812 01:10:02.243180 3127 raft_consensus.cc:348] T 0fd207cb2e99409891646cc530400c99 P 17078433d87e42babe4d4af528f684d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17078433d87e42babe4d4af528f684d7" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 34607 } } peers { permanent_uuid: "220df6baeccf4dcea80c28aafc3c6692" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 41185 } } peers { permanent_uuid: "33819682d2b74f0eb6ee65616b750e57" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 39759 } }
I20260812 01:10:02.243610 3127 raft_consensus.cc:374] T 0fd207cb2e99409891646cc530400c99 P 17078433d87e42babe4d4af528f684d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:02.243721 3127 raft_consensus.cc:729] T 0fd207cb2e99409891646cc530400c99 P 17078433d87e42babe4d4af528f684d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17078433d87e42babe4d4af528f684d7, State: Initialized, Role: FOLLOWER
I20260812 01:10:02.244035 3126 consensus_queue.cc:260] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17078433d87e42babe4d4af528f684d7" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 34607 } } peers { permanent_uuid: "220df6baeccf4dcea80c28aafc3c6692" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 41185 } } peers { permanent_uuid: "33819682d2b74f0eb6ee65616b750e57" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 39759 } }
I20260812 01:10:02.244277 3127 consensus_queue.cc:260] T 0fd207cb2e99409891646cc530400c99 P 17078433d87e42babe4d4af528f684d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17078433d87e42babe4d4af528f684d7" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 34607 } } peers { permanent_uuid: "220df6baeccf4dcea80c28aafc3c6692" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 41185 } } peers { permanent_uuid: "33819682d2b74f0eb6ee65616b750e57" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 39759 } }
I20260812 01:10:02.245370 3102 heartbeater.cc:503] Master 127.4.201.126:39619 was elected leader, sending a full tablet report...
I20260812 01:10:02.245872 3126 ts_tablet_manager.cc:1428] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57: Time spent starting tablet: real 0.013s user 0.015s sys 0.000s
I20260812 01:10:02.245872 3127 ts_tablet_manager.cc:1428] T 0fd207cb2e99409891646cc530400c99 P 17078433d87e42babe4d4af528f684d7: Time spent starting tablet: real 0.015s user 0.009s sys 0.003s
W20260812 01:10:02.295418 2682 tablet.cc:2369] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:10:02.314127 2894 tablet.cc:2369] T 0fd207cb2e99409891646cc530400c99 P 220df6baeccf4dcea80c28aafc3c6692: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:10:02.322638 3136 raft_consensus.cc:482] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:10:02.322948 3136 raft_consensus.cc:504] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17078433d87e42babe4d4af528f684d7" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 34607 } } peers { permanent_uuid: "220df6baeccf4dcea80c28aafc3c6692" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 41185 } } peers { permanent_uuid: "33819682d2b74f0eb6ee65616b750e57" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 39759 } }
I20260812 01:10:02.324731 3136 leader_election.cc:288] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17078433d87e42babe4d4af528f684d7 (127.4.201.67:34607), 220df6baeccf4dcea80c28aafc3c6692 (127.4.201.66:41185)
I20260812 01:10:02.331646 3119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:02.325145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:36411 (local address 127.4.201.67:34607)
0812 01:10:02.325389 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:02.325396 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:02.326337 (+ 941us) server_negotiation.cc:407] Connection header received
0812 01:10:02.326551 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:02.326556 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:02.326626 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:02.326721 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:10:02.327333 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.328025 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.329938 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.330718 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.330889 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:02.330959 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:02.331254 (+ 295us) server_negotiation.cc:299] Negotiation successful
0812 01:10:02.331395 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260812 01:10:02.331672 3121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:02.325425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:39035 (local address 127.4.201.66:41185)
0812 01:10:02.325655 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:02.325661 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:02.326185 (+ 524us) server_negotiation.cc:407] Connection header received
0812 01:10:02.326446 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:02.326452 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:02.326548 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:02.326623 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:10:02.327246 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.327966 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.329913 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.330676 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.330798 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:02.330872 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:02.331277 (+ 405us) server_negotiation.cc:299] Negotiation successful
0812 01:10:02.331412 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 01:10:02.331802 3142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:02.325050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:41185 (local address 127.4.201.65:39035)
0812 01:10:02.326057 (+ 1007us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:02.326077 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:02.326251 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:02.326662 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:02.326667 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:02.326692 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:10:02.327103 (+ 411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:02.327114 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.328101 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.328107 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:02.329764 (+ 1657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:02.329778 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.330903 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.330910 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:02.331080 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:02.331146 (+ 66us) client_negotiation.cc:769] Sending connection context
0812 01:10:02.331233 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 01:10:02.331371 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":836,"mutex_wait_us":76,"thread_start_us":928,"threads_started":1}
I20260812 01:10:02.331861 3140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:02.325158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:34607 (local address 127.4.201.65:36411)
0812 01:10:02.326237 (+ 1079us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:02.326253 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:02.326391 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:02.326762 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:02.326767 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:02.326807 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:10:02.327179 (+ 372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:02.327190 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.328180 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.328184 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:02.329785 (+ 1601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:02.329798 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.330946 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.330950 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:02.331083 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:02.331125 (+ 42us) client_negotiation.cc:769] Sending connection context
0812 01:10:02.331198 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 01:10:02.331336 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":967,"mutex_wait_us":44,"thread_start_us":443,"threads_started":1}
I20260812 01:10:02.332882 3028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fd207cb2e99409891646cc530400c99" candidate_uuid: "33819682d2b74f0eb6ee65616b750e57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17078433d87e42babe4d4af528f684d7" is_pre_election: true
I20260812 01:10:02.332883 2818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fd207cb2e99409891646cc530400c99" candidate_uuid: "33819682d2b74f0eb6ee65616b750e57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "220df6baeccf4dcea80c28aafc3c6692" is_pre_election: true
I20260812 01:10:02.333405 3028 raft_consensus.cc:2454] T 0fd207cb2e99409891646cc530400c99 P 17078433d87e42babe4d4af528f684d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33819682d2b74f0eb6ee65616b750e57 in term 0.
I20260812 01:10:02.333405 2818 raft_consensus.cc:2454] T 0fd207cb2e99409891646cc530400c99 P 220df6baeccf4dcea80c28aafc3c6692 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33819682d2b74f0eb6ee65616b750e57 in term 0.
I20260812 01:10:02.334043 2503 leader_election.cc:302] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17078433d87e42babe4d4af528f684d7, 33819682d2b74f0eb6ee65616b750e57; no voters:
I20260812 01:10:02.334425 3136 raft_consensus.cc:2781] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:10:02.334576 3136 raft_consensus.cc:482] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:10:02.334692 3136 raft_consensus.cc:3037] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:02.336845 3136 raft_consensus.cc:504] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17078433d87e42babe4d4af528f684d7" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 34607 } } peers { permanent_uuid: "220df6baeccf4dcea80c28aafc3c6692" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 41185 } } peers { permanent_uuid: "33819682d2b74f0eb6ee65616b750e57" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 39759 } }
I20260812 01:10:02.337514 3136 leader_election.cc:288] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57 [CANDIDATE]: Term 1 election: Requested vote from peers 17078433d87e42babe4d4af528f684d7 (127.4.201.67:34607), 220df6baeccf4dcea80c28aafc3c6692 (127.4.201.66:41185)
I20260812 01:10:02.337880 3028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fd207cb2e99409891646cc530400c99" candidate_uuid: "33819682d2b74f0eb6ee65616b750e57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17078433d87e42babe4d4af528f684d7"
I20260812 01:10:02.337973 2818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fd207cb2e99409891646cc530400c99" candidate_uuid: "33819682d2b74f0eb6ee65616b750e57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "220df6baeccf4dcea80c28aafc3c6692"
I20260812 01:10:02.338065 3028 raft_consensus.cc:3037] T 0fd207cb2e99409891646cc530400c99 P 17078433d87e42babe4d4af528f684d7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:02.338184 2818 raft_consensus.cc:3037] T 0fd207cb2e99409891646cc530400c99 P 220df6baeccf4dcea80c28aafc3c6692 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:02.340339 2818 raft_consensus.cc:2454] T 0fd207cb2e99409891646cc530400c99 P 220df6baeccf4dcea80c28aafc3c6692 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33819682d2b74f0eb6ee65616b750e57 in term 1.
I20260812 01:10:02.340432 3028 raft_consensus.cc:2454] T 0fd207cb2e99409891646cc530400c99 P 17078433d87e42babe4d4af528f684d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33819682d2b74f0eb6ee65616b750e57 in term 1.
I20260812 01:10:02.340724 2501 leader_election.cc:302] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 220df6baeccf4dcea80c28aafc3c6692, 33819682d2b74f0eb6ee65616b750e57; no voters:
I20260812 01:10:02.341042 3136 raft_consensus.cc:2781] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:10:02.341502 3136 raft_consensus.cc:686] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57 [term 1 LEADER]: Becoming Leader. State: Replica: 33819682d2b74f0eb6ee65616b750e57, State: Running, Role: LEADER
I20260812 01:10:02.341976 3136 consensus_queue.cc:237] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17078433d87e42babe4d4af528f684d7" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 34607 } } peers { permanent_uuid: "220df6baeccf4dcea80c28aafc3c6692" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 41185 } } peers { permanent_uuid: "33819682d2b74f0eb6ee65616b750e57" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 39759 } }
I20260812 01:10:02.346891 2380 catalog_manager.cc:5495] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33819682d2b74f0eb6ee65616b750e57 (127.4.201.65). New cstate: current_term: 1 leader_uuid: "33819682d2b74f0eb6ee65616b750e57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17078433d87e42babe4d4af528f684d7" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 34607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "220df6baeccf4dcea80c28aafc3c6692" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 41185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33819682d2b74f0eb6ee65616b750e57" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 39759 } health_report { overall_health: HEALTHY } } }
W20260812 01:10:02.364094 3103 tablet.cc:2369] T 0fd207cb2e99409891646cc530400c99 P 17078433d87e42babe4d4af528f684d7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:10:02.395589 3124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:02.390222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40262 (local address 127.4.201.65:39759)
0812 01:10:02.390428 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:02.390434 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:02.390453 (+ 19us) server_negotiation.cc:407] Connection header received
0812 01:10:02.390638 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:02.390642 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:02.390722 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:02.390853 (+ 131us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:10:02.391277 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.391993 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.393382 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.393799 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.393912 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:02.394502 (+ 590us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:10:02.395002 (+ 500us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:10:02.395200 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:02.395310 (+ 110us) server_negotiation.cc:299] Negotiation successful
0812 01:10:02.395356 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 01:10:02.403723 3028 raft_consensus.cc:1261] T 0fd207cb2e99409891646cc530400c99 P 17078433d87e42babe4d4af528f684d7 [term 1 FOLLOWER]: Refusing update from remote peer 33819682d2b74f0eb6ee65616b750e57: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:10:02.403726 2818 raft_consensus.cc:1261] T 0fd207cb2e99409891646cc530400c99 P 220df6baeccf4dcea80c28aafc3c6692 [term 1 FOLLOWER]: Refusing update from remote peer 33819682d2b74f0eb6ee65616b750e57: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:10:02.404649 3136 consensus_queue.cc:1035] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "220df6baeccf4dcea80c28aafc3c6692" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 41185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:10:02.404935 3144 consensus_queue.cc:1035] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17078433d87e42babe4d4af528f684d7" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 34607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:10:02.424647 3150 mvcc.cc:205] Tried to move back new op lower bound from 7317491721835732992 to 7317491721596960768. Current Snapshot: MvccSnapshot[applied={T|T < 7317491721835732992}]
I20260812 01:10:02.441610 2378 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43090:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:10:02.441920 2378 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43090:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:10:02.445698 2378 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 300cb5a5001c4cf295bf5aab1ccd5b07: Sending DeleteTablet for 3 replicas of tablet 0fd207cb2e99409891646cc530400c99
I20260812 01:10:02.446841 2579 tablet_service.cc:1514] Processing DeleteTablet for tablet 0fd207cb2e99409891646cc530400c99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:10:02 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:40246
I20260812 01:10:02.446846 2994 tablet_service.cc:1514] Processing DeleteTablet for tablet 0fd207cb2e99409891646cc530400c99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:10:02 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:59592
I20260812 01:10:02.447520 2786 tablet_service.cc:1514] Processing DeleteTablet for tablet 0fd207cb2e99409891646cc530400c99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:10:02 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:32994
I20260812 01:10:02.447849 3163 tablet_replica.cc:330] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57: stopping tablet replica
I20260812 01:10:02.448259 3163 raft_consensus.cc:2229] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57 [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:10:02.449025 3163 raft_consensus.cc:2258] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:10:02.450337 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 2474
I20260812 01:10:02.453896 3163 ts_tablet_manager.cc:1905] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:10:02.461405 3163 ts_tablet_manager.cc:1918] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:10:02.461652 3163 log.cc:1196] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-0/wal/wals/0fd207cb2e99409891646cc530400c99
I20260812 01:10:02.462311 3163 ts_tablet_manager.cc:1939] T 0fd207cb2e99409891646cc530400c99 P 33819682d2b74f0eb6ee65616b750e57: Deleting consensus metadata
I20260812 01:10:02.462924 3164 tablet_replica.cc:330] T 0fd207cb2e99409891646cc530400c99 P 17078433d87e42babe4d4af528f684d7: stopping tablet replica
I20260812 01:10:02.464161 3164 raft_consensus.cc:2229] T 0fd207cb2e99409891646cc530400c99 P 17078433d87e42babe4d4af528f684d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:10:02.464238 2364 catalog_manager.cc:4841] TS 33819682d2b74f0eb6ee65616b750e57 (127.4.201.65:39759): tablet 0fd207cb2e99409891646cc530400c99 (table test-table [id=9696e5d0725e4a0d842dfd546add2e7d]) successfully deleted
I20260812 01:10:02.464720 3164 raft_consensus.cc:2258] T 0fd207cb2e99409891646cc530400c99 P 17078433d87e42babe4d4af528f684d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:10:02.464936 3168 tablet_replica.cc:330] T 0fd207cb2e99409891646cc530400c99 P 220df6baeccf4dcea80c28aafc3c6692: stopping tablet replica
I20260812 01:10:02.465327 3168 raft_consensus.cc:2229] T 0fd207cb2e99409891646cc530400c99 P 220df6baeccf4dcea80c28aafc3c6692 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:10:02.465847 3168 raft_consensus.cc:2258] T 0fd207cb2e99409891646cc530400c99 P 220df6baeccf4dcea80c28aafc3c6692 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:10:02.466840 3164 ts_tablet_manager.cc:1905] T 0fd207cb2e99409891646cc530400c99 P 17078433d87e42babe4d4af528f684d7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:10:02.467931 3168 ts_tablet_manager.cc:1905] T 0fd207cb2e99409891646cc530400c99 P 220df6baeccf4dcea80c28aafc3c6692: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:10:02.473982 3164 ts_tablet_manager.cc:1918] T 0fd207cb2e99409891646cc530400c99 P 17078433d87e42babe4d4af528f684d7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:10:02.474215 3164 log.cc:1196] T 0fd207cb2e99409891646cc530400c99 P 17078433d87e42babe4d4af528f684d7: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-2/wal/wals/0fd207cb2e99409891646cc530400c99
Aug 12 01:10:02 dist-test-slave-bndk krb5kdc[2301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496999, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.65@KRBTEST.COM
I20260812 01:10:02.474871 3164 ts_tablet_manager.cc:1939] T 0fd207cb2e99409891646cc530400c99 P 17078433d87e42babe4d4af528f684d7: Deleting consensus metadata
I20260812 01:10:02.474895 3168 ts_tablet_manager.cc:1918] T 0fd207cb2e99409891646cc530400c99 P 220df6baeccf4dcea80c28aafc3c6692: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:10:02.475142 3168 log.cc:1196] T 0fd207cb2e99409891646cc530400c99 P 220df6baeccf4dcea80c28aafc3c6692: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786496689953932-4901-0/minicluster-data/ts-1/wal/wals/0fd207cb2e99409891646cc530400c99
I20260812 01:10:02.475724 3168 ts_tablet_manager.cc:1939] T 0fd207cb2e99409891646cc530400c99 P 220df6baeccf4dcea80c28aafc3c6692: Deleting consensus metadata
I20260812 01:10:02.476840 2364 catalog_manager.cc:4841] TS 17078433d87e42babe4d4af528f684d7 (127.4.201.67:34607): tablet 0fd207cb2e99409891646cc530400c99 (table test-table [id=9696e5d0725e4a0d842dfd546add2e7d]) successfully deleted
I20260812 01:10:02.477517 2362 catalog_manager.cc:4841] TS 220df6baeccf4dcea80c28aafc3c6692 (127.4.201.66:41185): tablet 0fd207cb2e99409891646cc530400c99 (table test-table [id=9696e5d0725e4a0d842dfd546add2e7d]) successfully deleted
I20260812 01:10:02.481907 3124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:02.451956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40272 (local address 127.4.201.65:39759)
0812 01:10:02.452167 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:02.452174 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:02.463509 (+ 11335us) server_negotiation.cc:407] Connection header received
0812 01:10:02.463700 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:02.463705 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:02.463791 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:02.463884 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:02.465761 (+ 1877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.466900 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.468926 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.469630 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.469727 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:02.475696 (+ 5969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:02.475711 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:02.475734 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:02.475781 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:02.479127 (+ 3346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:02.479796 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:02.479803 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:02.479805 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:02.479951 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:02.480338 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:02.480342 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:02.480344 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:02.480708 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:02.481013 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:02.481343 (+ 330us) server_negotiation.cc:299] Negotiation successful
0812 01:10:02.481586 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 01:10:02.482532 2669 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:10:02.587239 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 2474
I20260812 01:10:02.610563 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 2692
Aug 12 01:10:02 dist-test-slave-bndk krb5kdc[2301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496999, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.66@KRBTEST.COM
I20260812 01:10:02.625092 3121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:02.611274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33008 (local address 127.4.201.66:41185)
0812 01:10:02.611445 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:02.611450 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:02.611517 (+ 67us) server_negotiation.cc:407] Connection header received
0812 01:10:02.611684 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:02.611687 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:02.611765 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:02.611843 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:02.613089 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.613862 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.615180 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.615561 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.615655 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:02.619970 (+ 4315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:02.619993 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:02.620011 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:02.620047 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:02.622636 (+ 2589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:02.623291 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:02.623299 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:02.623301 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:02.623427 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:02.623759 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:02.623762 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:02.623764 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:02.624166 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:02.624419 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:02.624656 (+ 237us) server_negotiation.cc:299] Negotiation successful
0812 01:10:02.624822 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 01:10:02.625767 2885 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:10:02.723014 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 2692
I20260812 01:10:02.745604 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 2903
Aug 12 01:10:02 dist-test-slave-bndk krb5kdc[2301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786496999, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.67@KRBTEST.COM
I20260812 01:10:02.759855 3119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:02.746336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59608 (local address 127.4.201.67:34607)
0812 01:10:02.746537 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:02.746542 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:02.746560 (+ 18us) server_negotiation.cc:407] Connection header received
0812 01:10:02.746657 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:02.746660 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:02.746728 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:02.746821 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:02.748102 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.748859 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.750129 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:02.750522 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:02.750621 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:02.754842 (+ 4221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:02.754858 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:02.754878 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:02.754912 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:02.757615 (+ 2703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:02.758210 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:02.758217 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:02.758219 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:02.758356 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:02.758624 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:02.758627 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:02.758629 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:02.758943 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:02.759185 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:02.759364 (+ 179us) server_negotiation.cc:299] Negotiation successful
0812 01:10:02.759523 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260812 01:10:02.760476 3096 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:10:02.847433 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 2903
I20260812 01:10:02.872552 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 2329
I20260812 01:10:02.873646 2427 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:10:02.982955 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 2329
2026-08-12T01:10:03Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4548 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-12T01:10:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:10:03Z Disabled control of system clock
I20260812 01:10:03.074792 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:45533
--webserver_interface=127.4.201.126
--webserver_port=0
--builtin_ntp_servers=127.4.201.84:38655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:45533
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 01:10:03.408360 3182 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:03.408675 3182 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:03.408802 3182 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:03.416024 3182 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:10:03.416131 3182 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:03.416194 3182 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:03.416268 3182 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:10:03.416327 3182 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:10:03.425443 3182 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:38655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:45533
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:45533
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:03.426674 3182 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:03.428511 3182 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:03.440021 3188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:03.439942 3189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:03.439976 3193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:03.440706 3182 server_base.cc:1034] running on GCE node
I20260812 01:10:03.441569 3182 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:03.442986 3182 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:03.444192 3182 hybrid_clock.cc:648] HybridClock initialized: now 1786497003444147 us; error 29 us; skew 500 ppm
I20260812 01:10:03.444540 3182 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:10:03.446923 3182 webserver.cc:460] Webserver started at http://127.4.201.126:37583/ using document root <none> and password file <none>
I20260812 01:10:03.447656 3182 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:03.447762 3182 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:03.448094 3182 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:03.451231 3182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "fdc54907834e4e21b05840f5cebd3ac1"
format_stamp: "Formatted at 2026-08-12 01:10:03 on dist-test-slave-bndk"
server_key: "f851c0612f41ad5d28ad26bedafbd38a"
server_key_iv: "d22e994336dd19a14f3e91dbf275a30b"
server_key_version: "encryptionkey@0"
I20260812 01:10:03.452049 3182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "fdc54907834e4e21b05840f5cebd3ac1"
format_stamp: "Formatted at 2026-08-12 01:10:03 on dist-test-slave-bndk"
server_key: "f851c0612f41ad5d28ad26bedafbd38a"
server_key_iv: "d22e994336dd19a14f3e91dbf275a30b"
server_key_version: "encryptionkey@0"
I20260812 01:10:03.456944 3182 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260812 01:10:03.460546 3205 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:03.461817 3182 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:10:03.461982 3182 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "fdc54907834e4e21b05840f5cebd3ac1"
format_stamp: "Formatted at 2026-08-12 01:10:03 on dist-test-slave-bndk"
server_key: "f851c0612f41ad5d28ad26bedafbd38a"
server_key_iv: "d22e994336dd19a14f3e91dbf275a30b"
server_key_version: "encryptionkey@0"
I20260812 01:10:03.462167 3182 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:03.487010 3182 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:03.487800 3182 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:03.488060 3182 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:03.504796 3182 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:45533
I20260812 01:10:03.504815 3289 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:45533 every 8 connection(s)
I20260812 01:10:03.506138 3182 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:10:03.508441 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 3182
I20260812 01:10:03.508602 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:10:03.509057 4901 external_mini_cluster.cc:1428] Setting key d27bea4b056b877702870c94f0d1f9a0
I20260812 01:10:03.510177 3291 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:03.523689 3296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:03.510875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40206 (local address 127.4.201.126:45533)
0812 01:10:03.511935 (+ 1060us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:03.511950 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:03.512004 (+ 54us) server_negotiation.cc:407] Connection header received
0812 01:10:03.513824 (+ 1820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:03.513853 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:03.514453 (+ 600us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:03.514891 (+ 438us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:03.515422 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:03.517497 (+ 2075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:03.518798 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:03.519773 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:03.519955 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:03.520965 (+ 1010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:03.520976 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:03.520994 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:03.521732 (+ 738us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:03.521833 (+ 101us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:03.521863 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:03.521984 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:03.522147 (+ 163us) server_negotiation.cc:299] Negotiation successful
0812 01:10:03.522468 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":551,"thread_start_us":347,"threads_started":1}
I20260812 01:10:03.524930 3291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdc54907834e4e21b05840f5cebd3ac1: Bootstrap starting.
I20260812 01:10:03.528199 3291 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fdc54907834e4e21b05840f5cebd3ac1: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:03.529126 3291 log.cc:824] T 00000000000000000000000000000000 P fdc54907834e4e21b05840f5cebd3ac1: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:03.531659 3291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdc54907834e4e21b05840f5cebd3ac1: No bootstrap required, opened a new log
I20260812 01:10:03.538604 3291 raft_consensus.cc:348] T 00000000000000000000000000000000 P fdc54907834e4e21b05840f5cebd3ac1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdc54907834e4e21b05840f5cebd3ac1" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45533 } }
I20260812 01:10:03.538911 3291 raft_consensus.cc:374] T 00000000000000000000000000000000 P fdc54907834e4e21b05840f5cebd3ac1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:03.538996 3291 raft_consensus.cc:729] T 00000000000000000000000000000000 P fdc54907834e4e21b05840f5cebd3ac1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdc54907834e4e21b05840f5cebd3ac1, State: Initialized, Role: FOLLOWER
I20260812 01:10:03.539544 3291 consensus_queue.cc:260] T 00000000000000000000000000000000 P fdc54907834e4e21b05840f5cebd3ac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdc54907834e4e21b05840f5cebd3ac1" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45533 } }
I20260812 01:10:03.539821 3291 raft_consensus.cc:388] T 00000000000000000000000000000000 P fdc54907834e4e21b05840f5cebd3ac1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:10:03.539968 3291 raft_consensus.cc:482] T 00000000000000000000000000000000 P fdc54907834e4e21b05840f5cebd3ac1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:10:03.540144 3291 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fdc54907834e4e21b05840f5cebd3ac1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:03.542186 3291 raft_consensus.cc:504] T 00000000000000000000000000000000 P fdc54907834e4e21b05840f5cebd3ac1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdc54907834e4e21b05840f5cebd3ac1" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45533 } }
I20260812 01:10:03.542613 3291 leader_election.cc:302] T 00000000000000000000000000000000 P fdc54907834e4e21b05840f5cebd3ac1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fdc54907834e4e21b05840f5cebd3ac1; no voters:
I20260812 01:10:03.543121 3291 leader_election.cc:288] T 00000000000000000000000000000000 P fdc54907834e4e21b05840f5cebd3ac1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:10:03.543251 3298 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fdc54907834e4e21b05840f5cebd3ac1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:10:03.543949 3298 raft_consensus.cc:686] T 00000000000000000000000000000000 P fdc54907834e4e21b05840f5cebd3ac1 [term 1 LEADER]: Becoming Leader. State: Replica: fdc54907834e4e21b05840f5cebd3ac1, State: Running, Role: LEADER
I20260812 01:10:03.544490 3298 consensus_queue.cc:237] T 00000000000000000000000000000000 P fdc54907834e4e21b05840f5cebd3ac1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdc54907834e4e21b05840f5cebd3ac1" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45533 } }
I20260812 01:10:03.545123 3291 sys_catalog.cc:564] T 00000000000000000000000000000000 P fdc54907834e4e21b05840f5cebd3ac1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:10:03.547204 3299 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdc54907834e4e21b05840f5cebd3ac1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fdc54907834e4e21b05840f5cebd3ac1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdc54907834e4e21b05840f5cebd3ac1" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45533 } } }
I20260812 01:10:03.547266 3302 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdc54907834e4e21b05840f5cebd3ac1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fdc54907834e4e21b05840f5cebd3ac1. Latest consensus state: current_term: 1 leader_uuid: "fdc54907834e4e21b05840f5cebd3ac1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdc54907834e4e21b05840f5cebd3ac1" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45533 } } }
I20260812 01:10:03.547704 3299 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdc54907834e4e21b05840f5cebd3ac1 [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:03.547711 3302 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdc54907834e4e21b05840f5cebd3ac1 [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:03.549885 3311 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:10:03.554522 3311 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:10:03.562166 3311 catalog_manager.cc:1347] Generated new cluster ID: 35bc412e42ce4ecea184dfb87fb019d2
I20260812 01:10:03.562268 3311 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:10:03.573033 3311 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:10:03.574733 3311 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:10:03.587338 3311 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fdc54907834e4e21b05840f5cebd3ac1: Generated new TSK 0
I20260812 01:10:03.588281 3311 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:10:03.594946 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:0
--local_ip_for_outbound_sockets=127.4.201.65
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:45533
--builtin_ntp_servers=127.4.201.84:38655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 01:10:03.953656 3329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:03.953936 3329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:03.954077 3329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:03.961473 3329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:03.961586 3329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:03.961733 3329 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:10:03.971194 3329 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:38655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:45533
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:03.972561 3329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:03.974429 3329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:03.987399 3341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:03.987372 3338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:03.987323 3337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:03.988174 3329 server_base.cc:1034] running on GCE node
I20260812 01:10:03.988806 3329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:03.989792 3329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:03.990993 3329 hybrid_clock.cc:648] HybridClock initialized: now 1786497003990943 us; error 47 us; skew 500 ppm
I20260812 01:10:03.991314 3329 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:10:03.993584 3329 webserver.cc:460] Webserver started at http://127.4.201.65:42659/ using document root <none> and password file <none>
I20260812 01:10:03.994283 3329 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:03.994397 3329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:03.994716 3329 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:03.997637 3329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-0/data/instance:
uuid: "f5ffd3285c2d4374ab0d8d38c8d2eabe"
format_stamp: "Formatted at 2026-08-12 01:10:03 on dist-test-slave-bndk"
server_key: "716d2b415b12cbc0d67970ea9956d332"
server_key_iv: "ff5c54c9ff6984e01b99baadac25c09e"
server_key_version: "encryptionkey@0"
I20260812 01:10:03.998402 3329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance:
uuid: "f5ffd3285c2d4374ab0d8d38c8d2eabe"
format_stamp: "Formatted at 2026-08-12 01:10:03 on dist-test-slave-bndk"
server_key: "716d2b415b12cbc0d67970ea9956d332"
server_key_iv: "ff5c54c9ff6984e01b99baadac25c09e"
server_key_version: "encryptionkey@0"
I20260812 01:10:04.003473 3329 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260812 01:10:04.006943 3349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:04.008222 3329 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 01:10:04.008368 3329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "f5ffd3285c2d4374ab0d8d38c8d2eabe"
format_stamp: "Formatted at 2026-08-12 01:10:03 on dist-test-slave-bndk"
server_key: "716d2b415b12cbc0d67970ea9956d332"
server_key_iv: "ff5c54c9ff6984e01b99baadac25c09e"
server_key_version: "encryptionkey@0"
I20260812 01:10:04.008605 3329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:04.032200 3329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:04.032958 3329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:04.033280 3329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:04.034189 3329 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:10:04.035578 3329 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:10:04.035669 3329 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:04.035770 3329 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:10:04.035857 3329 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:04.065613 3329 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:37883
I20260812 01:10:04.065696 3536 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:37883 every 8 connection(s)
I20260812 01:10:04.066913 3329 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:10:04.069681 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 3329
I20260812 01:10:04.069866 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance
I20260812 01:10:04.070354 4901 external_mini_cluster.cc:1428] Setting key 5b47016b7138e1eafc535ac0b37cf918
I20260812 01:10:04.073417 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:0
--local_ip_for_outbound_sockets=127.4.201.66
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:45533
--builtin_ntp_servers=127.4.201.84:38655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 01:10:04.080013 3540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:04.069265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:34203 (local address 127.4.201.126:45533)
0812 01:10:04.069733 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:04.069740 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:04.071110 (+ 1370us) server_negotiation.cc:407] Connection header received
0812 01:10:04.073322 (+ 2212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:04.073326 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:04.073389 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:04.073474 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:04.074740 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:04.075432 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:04.077463 (+ 2031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:04.077857 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:04.077947 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:04.079342 (+ 1395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:04.079347 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:04.079350 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:04.079367 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:04.079404 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:04.079416 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:04.079478 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:04.079696 (+ 218us) server_negotiation.cc:299] Negotiation successful
0812 01:10:04.079765 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":214,"threads_started":1}
I20260812 01:10:04.081246 3541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:04.069897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45533 (local address 127.4.201.65:34203)
0812 01:10:04.070942 (+ 1045us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:04.070999 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:04.073030 (+ 2031us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:04.073718 (+ 688us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:04.073728 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:04.073837 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:10:04.074575 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:04.074600 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:04.075586 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:04.075591 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:04.077345 (+ 1754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:04.077360 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:04.078074 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:04.078081 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:04.078350 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:04.079016 (+ 666us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:10:04.079019 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:10:04.079067 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:10:04.079161 (+ 94us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:10:04.079497 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:10:04.079509 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:10:04.079517 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 01:10:04.079684 (+ 167us) client_negotiation.cc:240] Negotiation successful
0812 01:10:04.080049 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":270,"threads_started":1}
I20260812 01:10:04.082602 3537 heartbeater.cc:347] Connected to a master server at 127.4.201.126:45533
I20260812 01:10:04.082897 3537 heartbeater.cc:464] Registering TS with master...
I20260812 01:10:04.083729 3537 heartbeater.cc:511] Master 127.4.201.126:45533 requested a full tablet report, sending...
I20260812 01:10:04.085896 3235 ts_manager.cc:194] Registered new tserver with Master: f5ffd3285c2d4374ab0d8d38c8d2eabe (127.4.201.65:37883)
I20260812 01:10:04.087764 3235 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.201.65:34203
W20260812 01:10:04.413131 3542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:04.413496 3542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:04.413599 3542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:04.420584 3542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:04.420683 3542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:04.420795 3542 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:10:04.429733 3542 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:38655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:45533
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:04.430951 3542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:04.432796 3542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:04.445286 3550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:04.445363 3553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:04.445883 3548 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:04.446676 3542 server_base.cc:1034] running on GCE node
I20260812 01:10:04.447240 3542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:04.448141 3542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:04.449316 3542 hybrid_clock.cc:648] HybridClock initialized: now 1786497004449259 us; error 42 us; skew 500 ppm
I20260812 01:10:04.449637 3542 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:10:04.451741 3542 webserver.cc:460] Webserver started at http://127.4.201.66:35423/ using document root <none> and password file <none>
I20260812 01:10:04.452411 3542 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:04.452533 3542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:04.452845 3542 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:04.455741 3542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-1/data/instance:
uuid: "cfe4a47c358f405197f017b53d4ca623"
format_stamp: "Formatted at 2026-08-12 01:10:04 on dist-test-slave-bndk"
server_key: "b3d5fc081ee1a0dd15790d7880a55dc5"
server_key_iv: "fdb3d9e1b3029c38d087c1c6aea24ca4"
server_key_version: "encryptionkey@0"
I20260812 01:10:04.456542 3542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance:
uuid: "cfe4a47c358f405197f017b53d4ca623"
format_stamp: "Formatted at 2026-08-12 01:10:04 on dist-test-slave-bndk"
server_key: "b3d5fc081ee1a0dd15790d7880a55dc5"
server_key_iv: "fdb3d9e1b3029c38d087c1c6aea24ca4"
server_key_version: "encryptionkey@0"
I20260812 01:10:04.461551 3542 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 01:10:04.464880 3559 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:04.466310 3542 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:10:04.466542 3542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "cfe4a47c358f405197f017b53d4ca623"
format_stamp: "Formatted at 2026-08-12 01:10:04 on dist-test-slave-bndk"
server_key: "b3d5fc081ee1a0dd15790d7880a55dc5"
server_key_iv: "fdb3d9e1b3029c38d087c1c6aea24ca4"
server_key_version: "encryptionkey@0"
I20260812 01:10:04.466781 3542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:04.485716 3542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:04.486547 3542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:04.486853 3542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:04.487880 3542 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:10:04.489468 3542 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:10:04.489559 3542 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:04.489650 3542 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:10:04.489704 3542 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:04.520023 3542 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:39859
I20260812 01:10:04.520063 3759 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:39859 every 8 connection(s)
I20260812 01:10:04.521625 3542 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:10:04.524930 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 3542
I20260812 01:10:04.525097 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance
I20260812 01:10:04.525713 4901 external_mini_cluster.cc:1428] Setting key 99ffd62234cb8af73f532752aa8f77ef
I20260812 01:10:04.528784 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:0
--local_ip_for_outbound_sockets=127.4.201.67
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:45533
--builtin_ntp_servers=127.4.201.84:38655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 01:10:04.535012 3540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:04.524244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:45281 (local address 127.4.201.126:45533)
0812 01:10:04.524406 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:04.524411 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:04.526209 (+ 1798us) server_negotiation.cc:407] Connection header received
0812 01:10:04.528050 (+ 1841us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:04.528054 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:04.528118 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:04.528196 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:04.529560 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:04.530253 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:04.532361 (+ 2108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:04.532835 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:04.532930 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:04.534363 (+ 1433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:04.534369 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:04.534373 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:04.534390 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:04.534423 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:04.534435 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:04.534503 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:04.534720 (+ 217us) server_negotiation.cc:299] Negotiation successful
0812 01:10:04.534794 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 01:10:04.536245 3762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:04.524891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45533 (local address 127.4.201.66:45281)
0812 01:10:04.526026 (+ 1135us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:04.526100 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:04.527759 (+ 1659us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:04.528450 (+ 691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:04.528461 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:04.528575 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:10:04.529396 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:04.529420 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:04.530410 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:04.530415 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:04.532174 (+ 1759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:04.532189 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:04.533072 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:04.533080 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:04.533364 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:04.534040 (+ 676us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:10:04.534043 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:10:04.534091 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:10:04.534189 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:10:04.534523 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:10:04.534533 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:10:04.534540 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 01:10:04.534700 (+ 160us) client_negotiation.cc:240] Negotiation successful
0812 01:10:04.535064 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":325,"threads_started":1}
I20260812 01:10:04.537596 3760 heartbeater.cc:347] Connected to a master server at 127.4.201.126:45533
I20260812 01:10:04.537905 3760 heartbeater.cc:464] Registering TS with master...
I20260812 01:10:04.538748 3760 heartbeater.cc:511] Master 127.4.201.126:45533 requested a full tablet report, sending...
I20260812 01:10:04.540236 3235 ts_manager.cc:194] Registered new tserver with Master: cfe4a47c358f405197f017b53d4ca623 (127.4.201.66:39859)
I20260812 01:10:04.541208 3235 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.201.66:45281
W20260812 01:10:04.861178 3763 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:04.861506 3763 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:04.861649 3763 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:04.868805 3763 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:04.868921 3763 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:04.869076 3763 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:10:04.878144 3763 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:38655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:45533
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:04.879415 3763 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:04.881147 3763 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:04.893735 3773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:04.893675 3774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:04.893774 3776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:04.894243 3763 server_base.cc:1034] running on GCE node
I20260812 01:10:04.894788 3763 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:04.895637 3763 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:04.896824 3763 hybrid_clock.cc:648] HybridClock initialized: now 1786497004896763 us; error 51 us; skew 500 ppm
I20260812 01:10:04.897114 3763 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:10:04.899248 3763 webserver.cc:460] Webserver started at http://127.4.201.67:37219/ using document root <none> and password file <none>
I20260812 01:10:04.899902 3763 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:04.899997 3763 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:04.900303 3763 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:04.903100 3763 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-2/data/instance:
uuid: "dd5ab1666c4c427b8d38ef19cab7b32c"
format_stamp: "Formatted at 2026-08-12 01:10:04 on dist-test-slave-bndk"
server_key: "a991d3470010b3d169ba15c3656ba284"
server_key_iv: "2a7aff625153da3674dc26708ae90f3d"
server_key_version: "encryptionkey@0"
I20260812 01:10:04.903853 3763 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance:
uuid: "dd5ab1666c4c427b8d38ef19cab7b32c"
format_stamp: "Formatted at 2026-08-12 01:10:04 on dist-test-slave-bndk"
server_key: "a991d3470010b3d169ba15c3656ba284"
server_key_iv: "2a7aff625153da3674dc26708ae90f3d"
server_key_version: "encryptionkey@0"
I20260812 01:10:04.908891 3763 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 01:10:04.912192 3782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:04.913509 3763 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:10:04.913658 3763 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "dd5ab1666c4c427b8d38ef19cab7b32c"
format_stamp: "Formatted at 2026-08-12 01:10:04 on dist-test-slave-bndk"
server_key: "a991d3470010b3d169ba15c3656ba284"
server_key_iv: "2a7aff625153da3674dc26708ae90f3d"
server_key_version: "encryptionkey@0"
I20260812 01:10:04.913846 3763 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:04.925740 3763 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:04.926434 3763 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:04.926708 3763 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:04.927603 3763 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:10:04.928965 3763 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:10:04.929064 3763 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:04.929169 3763 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:10:04.929260 3763 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:04.959121 3763 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:44755
I20260812 01:10:04.959163 3968 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:44755 every 8 connection(s)
I20260812 01:10:04.960371 3763 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:10:04.968667 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 3763
I20260812 01:10:04.968835 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance
I20260812 01:10:04.969296 4901 external_mini_cluster.cc:1428] Setting key 83bbf96d2a3a99fb43903fe94f4188ae
I20260812 01:10:04.972791 3540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:04.962867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:43305 (local address 127.4.201.126:45533)
0812 01:10:04.963053 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:04.963058 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:04.964414 (+ 1356us) server_negotiation.cc:407] Connection header received
0812 01:10:04.966271 (+ 1857us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:04.966277 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:04.966356 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:04.966444 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:04.967585 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:04.968320 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:04.969948 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:04.970517 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:04.970628 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:04.971967 (+ 1339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:04.971983 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:04.971987 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:04.972004 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:04.972037 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:04.972049 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:04.972124 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:04.972338 (+ 214us) server_negotiation.cc:299] Negotiation successful
0812 01:10:04.972443 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 01:10:04.973762 3977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:04.963379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45533 (local address 127.4.201.67:43305)
0812 01:10:04.964255 (+ 876us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:04.964289 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:04.966001 (+ 1712us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:04.966707 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:04.966715 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:04.966827 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:10:04.967413 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:04.967431 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:04.968466 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:04.968470 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:04.969802 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:04.969817 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:04.970744 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:04.970752 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:04.970954 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:04.971672 (+ 718us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:10:04.971674 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:10:04.971717 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:10:04.971793 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:10:04.972137 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:10:04.972148 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:10:04.972157 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 01:10:04.972323 (+ 166us) client_negotiation.cc:240] Negotiation successful
0812 01:10:04.972716 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":265,"threads_started":1}
I20260812 01:10:04.974963 3974 heartbeater.cc:347] Connected to a master server at 127.4.201.126:45533
I20260812 01:10:04.975245 3974 heartbeater.cc:464] Registering TS with master...
I20260812 01:10:04.975955 3974 heartbeater.cc:511] Master 127.4.201.126:45533 requested a full tablet report, sending...
I20260812 01:10:04.977362 3235 ts_manager.cc:194] Registered new tserver with Master: dd5ab1666c4c427b8d38ef19cab7b32c (127.4.201.67:44755)
I20260812 01:10:04.978139 3235 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.201.67:43305
I20260812 01:10:04.984239 4901 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:10:04.993656 3540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:04.988231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40208 (local address 127.4.201.126:45533)
0812 01:10:04.988375 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:04.988379 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:04.988771 (+ 392us) server_negotiation.cc:407] Connection header received
0812 01:10:04.988900 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:04.988903 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:04.988964 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:04.989052 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:04.989564 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:04.990235 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:04.991584 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:04.991985 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:04.992074 (+ 89us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:04.993060 (+ 986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:04.993065 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:04.993068 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:04.993085 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:04.993117 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:04.993128 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:04.993266 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:04.993391 (+ 125us) server_negotiation.cc:299] Negotiation successful
0812 01:10:04.993435 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 01:10:04.997463 3235 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40208:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:10:05.004115 3235 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:10:05.027697 3991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:05.015441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:39859 (local address 127.0.0.1:45566)
0812 01:10:05.017061 (+ 1620us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:05.017118 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:05.017323 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:05.018444 (+ 1121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:05.018453 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:05.018486 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:10:05.019221 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:05.019236 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:05.021964 (+ 2728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:05.021970 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:05.024422 (+ 2452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:05.024441 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:05.026755 (+ 2314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:05.026763 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:05.027019 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:05.027078 (+ 59us) client_negotiation.cc:769] Sending connection context
0812 01:10:05.027211 (+ 133us) client_negotiation.cc:240] Negotiation successful
0812 01:10:05.027387 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1132,"thread_start_us":1005,"threads_started":1}
I20260812 01:10:05.028261 3996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:05.015726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45566 (local address 127.4.201.66:39859)
0812 01:10:05.016427 (+ 701us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:05.016437 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:05.017531 (+ 1094us) server_negotiation.cc:407] Connection header received
0812 01:10:05.017658 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:05.017667 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:05.017930 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:05.018119 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:10:05.019434 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:05.021768 (+ 2334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:05.024665 (+ 2897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:05.026198 (+ 1533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:05.026333 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:05.026618 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:05.027769 (+ 1151us) server_negotiation.cc:299] Negotiation successful
0812 01:10:05.027927 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":530,"thread_start_us":416,"threads_started":1}
I20260812 01:10:05.032954 3653 tablet_service.cc:1467] Processing CreateTablet for tablet e963492b6e974600bcc692a575d6bd63 (DEFAULT_TABLE table=test-table [id=ec123ed619bb4300a4df4a48754d2edc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:10:05.034487 3653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e963492b6e974600bcc692a575d6bd63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:05.035629 3991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:05.018745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:37883 (local address 127.0.0.1:32850)
0812 01:10:05.028230 (+ 9485us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:05.028249 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:05.028522 (+ 273us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:05.029826 (+ 1304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:05.029832 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:05.029862 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:10:05.030046 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:05.030057 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:05.031778 (+ 1721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:05.031782 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:05.033211 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:05.033252 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:05.034602 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:05.034611 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:05.035044 (+ 433us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:05.035077 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 01:10:05.035165 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 01:10:05.035297 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9388,"mutex_wait_us":19,"thread_start_us":9907,"threads_started":1}
I20260812 01:10:05.036410 3998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:05.017705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32850 (local address 127.4.201.65:37883)
0812 01:10:05.029199 (+ 11494us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:05.029209 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:05.029275 (+ 66us) server_negotiation.cc:407] Connection header received
0812 01:10:05.029375 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:05.029382 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:05.029618 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:05.029816 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:10:05.030238 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:05.031641 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:05.033380 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:05.034428 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:05.034566 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:05.034788 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:05.035891 (+ 1103us) server_negotiation.cc:299] Negotiation successful
0812 01:10:05.036067 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11300,"thread_start_us":11343,"threads_started":1}
I20260812 01:10:05.039371 3995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:05.015614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:44755 (local address 127.0.0.1:49532)
0812 01:10:05.027273 (+ 11659us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:05.027297 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:05.027396 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:05.031881 (+ 4485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:05.031885 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:05.031916 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:10:05.032393 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:05.032407 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:05.034218 (+ 1811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:05.034224 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:05.036157 (+ 1933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:05.036170 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:05.038621 (+ 2451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:05.038628 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:05.038811 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:05.038843 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 01:10:05.038941 (+ 98us) client_negotiation.cc:240] Negotiation successful
0812 01:10:05.039070 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11517,"mutex_wait_us":50,"thread_start_us":11862,"threads_started":1}
I20260812 01:10:05.039510 3997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:05.016227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49532 (local address 127.4.201.67:44755)
0812 01:10:05.031339 (+ 15112us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:05.031356 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:05.031388 (+ 32us) server_negotiation.cc:407] Connection header received
0812 01:10:05.031495 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:05.031501 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:05.031693 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:05.031874 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:10:05.032597 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:05.034072 (+ 1475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:05.036329 (+ 2257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:05.038426 (+ 2097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:05.038556 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:05.038817 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:05.038993 (+ 176us) server_negotiation.cc:299] Negotiation successful
0812 01:10:05.039150 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14927,"thread_start_us":14771,"threads_started":1}
I20260812 01:10:05.039726 3429 tablet_service.cc:1467] Processing CreateTablet for tablet e963492b6e974600bcc692a575d6bd63 (DEFAULT_TABLE table=test-table [id=ec123ed619bb4300a4df4a48754d2edc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:10:05.041038 3429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e963492b6e974600bcc692a575d6bd63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:05.043027 3869 tablet_service.cc:1467] Processing CreateTablet for tablet e963492b6e974600bcc692a575d6bd63 (DEFAULT_TABLE table=test-table [id=ec123ed619bb4300a4df4a48754d2edc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:10:05.044495 3869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e963492b6e974600bcc692a575d6bd63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:05.052337 4002 tablet_bootstrap.cc:492] T e963492b6e974600bcc692a575d6bd63 P f5ffd3285c2d4374ab0d8d38c8d2eabe: Bootstrap starting.
I20260812 01:10:05.055136 4001 tablet_bootstrap.cc:492] T e963492b6e974600bcc692a575d6bd63 P cfe4a47c358f405197f017b53d4ca623: Bootstrap starting.
I20260812 01:10:05.055426 4002 tablet_bootstrap.cc:654] T e963492b6e974600bcc692a575d6bd63 P f5ffd3285c2d4374ab0d8d38c8d2eabe: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:05.056377 4002 log.cc:824] T e963492b6e974600bcc692a575d6bd63 P f5ffd3285c2d4374ab0d8d38c8d2eabe: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:05.058488 4001 tablet_bootstrap.cc:654] T e963492b6e974600bcc692a575d6bd63 P cfe4a47c358f405197f017b53d4ca623: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:05.059363 4005 tablet_bootstrap.cc:492] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c: Bootstrap starting.
I20260812 01:10:05.060348 4002 tablet_bootstrap.cc:492] T e963492b6e974600bcc692a575d6bd63 P f5ffd3285c2d4374ab0d8d38c8d2eabe: No bootstrap required, opened a new log
I20260812 01:10:05.060341 4001 log.cc:824] T e963492b6e974600bcc692a575d6bd63 P cfe4a47c358f405197f017b53d4ca623: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:05.060635 4002 ts_tablet_manager.cc:1397] T e963492b6e974600bcc692a575d6bd63 P f5ffd3285c2d4374ab0d8d38c8d2eabe: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260812 01:10:05.062669 4001 tablet_bootstrap.cc:492] T e963492b6e974600bcc692a575d6bd63 P cfe4a47c358f405197f017b53d4ca623: No bootstrap required, opened a new log
I20260812 01:10:05.062744 4005 tablet_bootstrap.cc:654] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:05.062923 4001 ts_tablet_manager.cc:1397] T e963492b6e974600bcc692a575d6bd63 P cfe4a47c358f405197f017b53d4ca623: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260812 01:10:05.063889 4005 log.cc:824] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:05.066954 4005 tablet_bootstrap.cc:492] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c: No bootstrap required, opened a new log
I20260812 01:10:05.067217 4005 ts_tablet_manager.cc:1397] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260812 01:10:05.071844 4002 raft_consensus.cc:348] T e963492b6e974600bcc692a575d6bd63 P f5ffd3285c2d4374ab0d8d38c8d2eabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe4a47c358f405197f017b53d4ca623" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 39859 } } peers { permanent_uuid: "dd5ab1666c4c427b8d38ef19cab7b32c" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 44755 } } peers { permanent_uuid: "f5ffd3285c2d4374ab0d8d38c8d2eabe" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 37883 } }
I20260812 01:10:05.072381 4002 raft_consensus.cc:374] T e963492b6e974600bcc692a575d6bd63 P f5ffd3285c2d4374ab0d8d38c8d2eabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:05.072513 4002 raft_consensus.cc:729] T e963492b6e974600bcc692a575d6bd63 P f5ffd3285c2d4374ab0d8d38c8d2eabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5ffd3285c2d4374ab0d8d38c8d2eabe, State: Initialized, Role: FOLLOWER
I20260812 01:10:05.072573 4001 raft_consensus.cc:348] T e963492b6e974600bcc692a575d6bd63 P cfe4a47c358f405197f017b53d4ca623 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe4a47c358f405197f017b53d4ca623" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 39859 } } peers { permanent_uuid: "dd5ab1666c4c427b8d38ef19cab7b32c" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 44755 } } peers { permanent_uuid: "f5ffd3285c2d4374ab0d8d38c8d2eabe" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 37883 } }
I20260812 01:10:05.073061 4001 raft_consensus.cc:374] T e963492b6e974600bcc692a575d6bd63 P cfe4a47c358f405197f017b53d4ca623 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:05.073205 4001 raft_consensus.cc:729] T e963492b6e974600bcc692a575d6bd63 P cfe4a47c358f405197f017b53d4ca623 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe4a47c358f405197f017b53d4ca623, State: Initialized, Role: FOLLOWER
I20260812 01:10:05.073168 4002 consensus_queue.cc:260] T e963492b6e974600bcc692a575d6bd63 P f5ffd3285c2d4374ab0d8d38c8d2eabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe4a47c358f405197f017b53d4ca623" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 39859 } } peers { permanent_uuid: "dd5ab1666c4c427b8d38ef19cab7b32c" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 44755 } } peers { permanent_uuid: "f5ffd3285c2d4374ab0d8d38c8d2eabe" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 37883 } }
I20260812 01:10:05.074023 4001 consensus_queue.cc:260] T e963492b6e974600bcc692a575d6bd63 P cfe4a47c358f405197f017b53d4ca623 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe4a47c358f405197f017b53d4ca623" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 39859 } } peers { permanent_uuid: "dd5ab1666c4c427b8d38ef19cab7b32c" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 44755 } } peers { permanent_uuid: "f5ffd3285c2d4374ab0d8d38c8d2eabe" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 37883 } }
I20260812 01:10:05.077389 4005 raft_consensus.cc:348] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe4a47c358f405197f017b53d4ca623" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 39859 } } peers { permanent_uuid: "dd5ab1666c4c427b8d38ef19cab7b32c" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 44755 } } peers { permanent_uuid: "f5ffd3285c2d4374ab0d8d38c8d2eabe" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 37883 } }
I20260812 01:10:05.077874 4005 raft_consensus.cc:374] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:05.078002 4005 raft_consensus.cc:729] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd5ab1666c4c427b8d38ef19cab7b32c, State: Initialized, Role: FOLLOWER
I20260812 01:10:05.078733 4005 consensus_queue.cc:260] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe4a47c358f405197f017b53d4ca623" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 39859 } } peers { permanent_uuid: "dd5ab1666c4c427b8d38ef19cab7b32c" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 44755 } } peers { permanent_uuid: "f5ffd3285c2d4374ab0d8d38c8d2eabe" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 37883 } }
I20260812 01:10:05.082293 4001 ts_tablet_manager.cc:1428] T e963492b6e974600bcc692a575d6bd63 P cfe4a47c358f405197f017b53d4ca623: Time spent starting tablet: real 0.019s user 0.009s sys 0.010s
I20260812 01:10:05.082726 3760 heartbeater.cc:503] Master 127.4.201.126:45533 was elected leader, sending a full tablet report...
I20260812 01:10:05.083819 4002 ts_tablet_manager.cc:1428] T e963492b6e974600bcc692a575d6bd63 P f5ffd3285c2d4374ab0d8d38c8d2eabe: Time spent starting tablet: real 0.023s user 0.016s sys 0.004s
I20260812 01:10:05.084192 3537 heartbeater.cc:503] Master 127.4.201.126:45533 was elected leader, sending a full tablet report...
I20260812 01:10:05.084256 3974 heartbeater.cc:503] Master 127.4.201.126:45533 was elected leader, sending a full tablet report...
I20260812 01:10:05.084306 4005 ts_tablet_manager.cc:1428] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c: Time spent starting tablet: real 0.017s user 0.011s sys 0.004s
W20260812 01:10:05.211963 3976 tablet.cc:2369] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:10:05.253257 4014 raft_consensus.cc:482] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:10:05.253595 4014 raft_consensus.cc:504] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe4a47c358f405197f017b53d4ca623" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 39859 } } peers { permanent_uuid: "dd5ab1666c4c427b8d38ef19cab7b32c" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 44755 } } peers { permanent_uuid: "f5ffd3285c2d4374ab0d8d38c8d2eabe" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 37883 } }
I20260812 01:10:05.255398 4014 leader_election.cc:288] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfe4a47c358f405197f017b53d4ca623 (127.4.201.66:39859), f5ffd3285c2d4374ab0d8d38c8d2eabe (127.4.201.65:37883)
I20260812 01:10:05.261824 3996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:05.255832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:49735 (local address 127.4.201.66:39859)
0812 01:10:05.256014 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:05.256019 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:05.256037 (+ 18us) server_negotiation.cc:407] Connection header received
0812 01:10:05.256201 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:05.256206 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:05.256285 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:05.256386 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:10:05.256925 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:05.257940 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:05.259955 (+ 2015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:05.261087 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:05.261199 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:05.261284 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:05.261560 (+ 276us) server_negotiation.cc:299] Negotiation successful
0812 01:10:05.261641 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 01:10:05.261965 3977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:05.255737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:39859 (local address 127.4.201.67:49735)
0812 01:10:05.255914 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:05.255933 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:05.256056 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:05.256447 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:05.256453 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:05.256498 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:10:05.256743 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:05.256754 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:05.258077 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:05.258082 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:05.259785 (+ 1703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:05.259799 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:05.261247 (+ 1448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:05.261253 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:05.261418 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:05.261453 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 01:10:05.261547 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 01:10:05.261680 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260812 01:10:05.262866 3998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:05.256312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:48831 (local address 127.4.201.65:37883)
0812 01:10:05.256505 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:05.256511 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:05.257119 (+ 608us) server_negotiation.cc:407] Connection header received
0812 01:10:05.257299 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:05.257303 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:05.257375 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:05.257445 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:10:05.257986 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:05.258981 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:05.260990 (+ 2009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:05.262084 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:05.262226 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:05.262274 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:05.262577 (+ 303us) server_negotiation.cc:299] Negotiation successful
0812 01:10:05.262683 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 01:10:05.262897 4015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:05.256140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:37883 (local address 127.4.201.67:48831)
0812 01:10:05.257004 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:05.257024 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:05.257156 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:05.257483 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:05.257488 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:05.257515 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:10:05.257839 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:05.257851 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:05.259130 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:05.259134 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:05.260793 (+ 1659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:05.260809 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:05.262276 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:05.262283 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:05.262420 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:05.262444 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 01:10:05.262528 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 01:10:05.262623 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":727,"thread_start_us":518,"threads_started":1}
I20260812 01:10:05.263159 3681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e963492b6e974600bcc692a575d6bd63" candidate_uuid: "dd5ab1666c4c427b8d38ef19cab7b32c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe4a47c358f405197f017b53d4ca623" is_pre_election: true
I20260812 01:10:05.263654 3681 raft_consensus.cc:2454] T e963492b6e974600bcc692a575d6bd63 P cfe4a47c358f405197f017b53d4ca623 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd5ab1666c4c427b8d38ef19cab7b32c in term 0.
I20260812 01:10:05.263993 3460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e963492b6e974600bcc692a575d6bd63" candidate_uuid: "dd5ab1666c4c427b8d38ef19cab7b32c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5ffd3285c2d4374ab0d8d38c8d2eabe" is_pre_election: true
I20260812 01:10:05.264271 3785 leader_election.cc:302] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cfe4a47c358f405197f017b53d4ca623, dd5ab1666c4c427b8d38ef19cab7b32c; no voters:
I20260812 01:10:05.264523 3460 raft_consensus.cc:2454] T e963492b6e974600bcc692a575d6bd63 P f5ffd3285c2d4374ab0d8d38c8d2eabe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd5ab1666c4c427b8d38ef19cab7b32c in term 0.
I20260812 01:10:05.264652 4014 raft_consensus.cc:2781] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:10:05.264802 4014 raft_consensus.cc:482] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:10:05.264904 4014 raft_consensus.cc:3037] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:05.267230 4014 raft_consensus.cc:504] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe4a47c358f405197f017b53d4ca623" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 39859 } } peers { permanent_uuid: "dd5ab1666c4c427b8d38ef19cab7b32c" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 44755 } } peers { permanent_uuid: "f5ffd3285c2d4374ab0d8d38c8d2eabe" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 37883 } }
I20260812 01:10:05.267750 4014 leader_election.cc:288] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c [CANDIDATE]: Term 1 election: Requested vote from peers cfe4a47c358f405197f017b53d4ca623 (127.4.201.66:39859), f5ffd3285c2d4374ab0d8d38c8d2eabe (127.4.201.65:37883)
I20260812 01:10:05.268206 3681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e963492b6e974600bcc692a575d6bd63" candidate_uuid: "dd5ab1666c4c427b8d38ef19cab7b32c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe4a47c358f405197f017b53d4ca623"
I20260812 01:10:05.268251 3460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e963492b6e974600bcc692a575d6bd63" candidate_uuid: "dd5ab1666c4c427b8d38ef19cab7b32c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5ffd3285c2d4374ab0d8d38c8d2eabe"
I20260812 01:10:05.268421 3460 raft_consensus.cc:3037] T e963492b6e974600bcc692a575d6bd63 P f5ffd3285c2d4374ab0d8d38c8d2eabe [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:05.268422 3681 raft_consensus.cc:3037] T e963492b6e974600bcc692a575d6bd63 P cfe4a47c358f405197f017b53d4ca623 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:05.271696 3681 raft_consensus.cc:2454] T e963492b6e974600bcc692a575d6bd63 P cfe4a47c358f405197f017b53d4ca623 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd5ab1666c4c427b8d38ef19cab7b32c in term 1.
I20260812 01:10:05.271696 3460 raft_consensus.cc:2454] T e963492b6e974600bcc692a575d6bd63 P f5ffd3285c2d4374ab0d8d38c8d2eabe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd5ab1666c4c427b8d38ef19cab7b32c in term 1.
I20260812 01:10:05.272109 3785 leader_election.cc:302] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cfe4a47c358f405197f017b53d4ca623, dd5ab1666c4c427b8d38ef19cab7b32c; no voters:
I20260812 01:10:05.272389 4014 raft_consensus.cc:2781] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:10:05.272812 4014 raft_consensus.cc:686] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c [term 1 LEADER]: Becoming Leader. State: Replica: dd5ab1666c4c427b8d38ef19cab7b32c, State: Running, Role: LEADER
I20260812 01:10:05.273355 4014 consensus_queue.cc:237] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe4a47c358f405197f017b53d4ca623" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 39859 } } peers { permanent_uuid: "dd5ab1666c4c427b8d38ef19cab7b32c" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 44755 } } peers { permanent_uuid: "f5ffd3285c2d4374ab0d8d38c8d2eabe" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 37883 } }
W20260812 01:10:05.273545 3761 tablet.cc:2369] T e963492b6e974600bcc692a575d6bd63 P cfe4a47c358f405197f017b53d4ca623: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:10:05.277789 3234 catalog_manager.cc:5495] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c reported cstate change: term changed from 0 to 1, leader changed from <none> to dd5ab1666c4c427b8d38ef19cab7b32c (127.4.201.67). New cstate: current_term: 1 leader_uuid: "dd5ab1666c4c427b8d38ef19cab7b32c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe4a47c358f405197f017b53d4ca623" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd5ab1666c4c427b8d38ef19cab7b32c" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 44755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5ffd3285c2d4374ab0d8d38c8d2eabe" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 37883 } health_report { overall_health: UNKNOWN } } }
W20260812 01:10:05.319242 3538 tablet.cc:2369] T e963492b6e974600bcc692a575d6bd63 P f5ffd3285c2d4374ab0d8d38c8d2eabe: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:10:05.323675 3997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:05.318033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49536 (local address 127.4.201.67:44755)
0812 01:10:05.318210 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:05.318214 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:05.318356 (+ 142us) server_negotiation.cc:407] Connection header received
0812 01:10:05.318579 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:05.318583 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:05.318666 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:05.318801 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:10:05.319220 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:05.319996 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:05.321448 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:05.321861 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:05.321973 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:05.322628 (+ 655us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:10:05.323106 (+ 478us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:10:05.323273 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:05.323413 (+ 140us) server_negotiation.cc:299] Negotiation successful
0812 01:10:05.323456 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 01:10:05.331835 3681 raft_consensus.cc:1261] T e963492b6e974600bcc692a575d6bd63 P cfe4a47c358f405197f017b53d4ca623 [term 1 FOLLOWER]: Refusing update from remote peer dd5ab1666c4c427b8d38ef19cab7b32c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:10:05.331843 3460 raft_consensus.cc:1261] T e963492b6e974600bcc692a575d6bd63 P f5ffd3285c2d4374ab0d8d38c8d2eabe [term 1 FOLLOWER]: Refusing update from remote peer dd5ab1666c4c427b8d38ef19cab7b32c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:10:05.332755 4014 consensus_queue.cc:1035] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe4a47c358f405197f017b53d4ca623" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:10:05.333081 4018 consensus_queue.cc:1035] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5ffd3285c2d4374ab0d8d38c8d2eabe" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 37883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:10:05.357797 3234 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40208:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:10:05.358057 3234 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40208:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:10:05.361937 3234 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fdc54907834e4e21b05840f5cebd3ac1: Sending DeleteTablet for 3 replicas of tablet e963492b6e974600bcc692a575d6bd63
I20260812 01:10:05.363309 3869 tablet_service.cc:1514] Processing DeleteTablet for tablet e963492b6e974600bcc692a575d6bd63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:10:05 UTC) from {username='slave'} at 127.0.0.1:49532
I20260812 01:10:05.363312 3429 tablet_service.cc:1514] Processing DeleteTablet for tablet e963492b6e974600bcc692a575d6bd63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:10:05 UTC) from {username='slave'} at 127.0.0.1:32850
I20260812 01:10:05.364876 3653 tablet_service.cc:1514] Processing DeleteTablet for tablet e963492b6e974600bcc692a575d6bd63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:10:05 UTC) from {username='slave'} at 127.0.0.1:45566
I20260812 01:10:05.365690 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 3329
I20260812 01:10:05.381330 4052 tablet_replica.cc:330] T e963492b6e974600bcc692a575d6bd63 P cfe4a47c358f405197f017b53d4ca623: stopping tablet replica
I20260812 01:10:05.382071 4052 raft_consensus.cc:2229] T e963492b6e974600bcc692a575d6bd63 P cfe4a47c358f405197f017b53d4ca623 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:10:05.383121 4052 raft_consensus.cc:2258] T e963492b6e974600bcc692a575d6bd63 P cfe4a47c358f405197f017b53d4ca623 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:10:05.384516 4051 tablet_replica.cc:330] T e963492b6e974600bcc692a575d6bd63 P f5ffd3285c2d4374ab0d8d38c8d2eabe: stopping tablet replica
I20260812 01:10:05.385003 4051 raft_consensus.cc:2229] T e963492b6e974600bcc692a575d6bd63 P f5ffd3285c2d4374ab0d8d38c8d2eabe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:10:05.385800 4052 ts_tablet_manager.cc:1905] T e963492b6e974600bcc692a575d6bd63 P cfe4a47c358f405197f017b53d4ca623: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:10:05.385917 3998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:05.367428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32854 (local address 127.4.201.65:37883)
0812 01:10:05.367616 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:05.367623 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:05.372823 (+ 5200us) server_negotiation.cc:407] Connection header received
0812 01:10:05.373698 (+ 875us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:05.373705 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:05.373872 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:05.373952 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:05.375172 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:05.376439 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:05.380664 (+ 4225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:05.381398 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:05.381517 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:05.384023 (+ 2506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:05.384039 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:05.384060 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:05.384892 (+ 832us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:05.384963 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:05.384994 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:05.385086 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:05.385386 (+ 300us) server_negotiation.cc:299] Negotiation successful
0812 01:10:05.385510 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 01:10:05.385591 4051 raft_consensus.cc:2258] T e963492b6e974600bcc692a575d6bd63 P f5ffd3285c2d4374ab0d8d38c8d2eabe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:10:05.386751 3532 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:10:05.387835 4048 tablet_replica.cc:330] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c: stopping tablet replica
I20260812 01:10:05.388301 4048 raft_consensus.cc:2229] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:10:05.389101 4048 raft_consensus.cc:2258] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:10:05.391319 4048 ts_tablet_manager.cc:1905] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:10:05.394810 4052 ts_tablet_manager.cc:1918] T e963492b6e974600bcc692a575d6bd63 P cfe4a47c358f405197f017b53d4ca623: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:10:05.395046 4052 log.cc:1196] T e963492b6e974600bcc692a575d6bd63 P cfe4a47c358f405197f017b53d4ca623: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-1/wal/wals/e963492b6e974600bcc692a575d6bd63
I20260812 01:10:05.395710 4052 ts_tablet_manager.cc:1939] T e963492b6e974600bcc692a575d6bd63 P cfe4a47c358f405197f017b53d4ca623: Deleting consensus metadata
I20260812 01:10:05.397756 3207 catalog_manager.cc:4841] TS cfe4a47c358f405197f017b53d4ca623 (127.4.201.66:39859): tablet e963492b6e974600bcc692a575d6bd63 (table test-table [id=ec123ed619bb4300a4df4a48754d2edc]) successfully deleted
I20260812 01:10:05.398401 4048 ts_tablet_manager.cc:1918] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:10:05.398594 4048 log.cc:1196] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786496689953932-4901-0/minicluster-data/ts-2/wal/wals/e963492b6e974600bcc692a575d6bd63
I20260812 01:10:05.399210 4048 ts_tablet_manager.cc:1939] T e963492b6e974600bcc692a575d6bd63 P dd5ab1666c4c427b8d38ef19cab7b32c: Deleting consensus metadata
I20260812 01:10:05.401300 3210 catalog_manager.cc:4841] TS dd5ab1666c4c427b8d38ef19cab7b32c (127.4.201.67:44755): tablet e963492b6e974600bcc692a575d6bd63 (table test-table [id=ec123ed619bb4300a4df4a48754d2edc]) successfully deleted
I20260812 01:10:05.485788 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 3329
W20260812 01:10:05.511385 3207 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.201.65:37883 (error 108)
I20260812 01:10:05.512212 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 3542
I20260812 01:10:05.515628 3995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:05.515141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:37883 (local address 127.0.0.1:32868)
0812 01:10:05.515307 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:05.515441 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:37883: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260812 01:10:05.515868 3207 catalog_manager.cc:4584] TS f5ffd3285c2d4374ab0d8d38c8d2eabe (127.4.201.65:37883): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e963492b6e974600bcc692a575d6bd63: Network error: Client connection negotiation failed: client connection to 127.4.201.65:37883: connect: Connection refused (error 111)
I20260812 01:10:05.523381 3996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:05.513529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45568 (local address 127.4.201.66:39859)
0812 01:10:05.513724 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:05.513731 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:05.513753 (+ 22us) server_negotiation.cc:407] Connection header received
0812 01:10:05.513830 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:05.513835 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:05.513970 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:05.514097 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:05.514612 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:05.515753 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:05.517755 (+ 2002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:05.518450 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:05.518590 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:05.521690 (+ 3100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:05.521701 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:05.521718 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:05.522509 (+ 791us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:05.522569 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:05.522595 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:05.522685 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:05.522919 (+ 234us) server_negotiation.cc:299] Negotiation successful
0812 01:10:05.523033 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 01:10:05.524701 3753 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:10:05.569429 3995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:05.568935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:37883 (local address 127.0.0.1:32882)
0812 01:10:05.569137 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:05.569260 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:37883: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260812 01:10:05.570458 3995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:05.570106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:37883 (local address 127.0.0.1:32888)
0812 01:10:05.570256 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:05.570330 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:37883: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260812 01:10:05.630899 3995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:05.630404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:37883 (local address 127.0.0.1:32898)
0812 01:10:05.630631 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:05.630722 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:37883: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260812 01:10:05.632030 3995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:05.631676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:37883 (local address 127.0.0.1:32910)
0812 01:10:05.631834 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:05.631903 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:37883: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260812 01:10:05.673638 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 3542
I20260812 01:10:05.704186 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 3763
I20260812 01:10:05.712041 3997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:05.704988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49546 (local address 127.4.201.67:44755)
0812 01:10:05.705149 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:05.705153 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:05.705274 (+ 121us) server_negotiation.cc:407] Connection header received
0812 01:10:05.705543 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:05.705548 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:05.705641 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:05.705735 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:05.706223 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:05.707021 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:05.708783 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:05.709202 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:05.709468 (+ 266us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:05.710585 (+ 1117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:05.710596 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:05.710616 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:05.711305 (+ 689us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:05.711358 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:05.711380 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:05.711480 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:05.711623 (+ 143us) server_negotiation.cc:299] Negotiation successful
0812 01:10:05.711700 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 01:10:05.712847 3963 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:10:05.713258 3995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:05.712701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:37883 (local address 127.0.0.1:32920)
0812 01:10:05.712933 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:05.713041 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:37883: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260812 01:10:05.714391 3995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:05.713890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:37883 (local address 127.0.0.1:32928)
0812 01:10:05.714128 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:05.714242 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:37883: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
I20260812 01:10:05.832419 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 3763
I20260812 01:10:05.858776 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 3182
I20260812 01:10:05.859915 3285 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:10:05.967053 3995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:05.966252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:37883 (local address 127.0.0.1:32940)
0812 01:10:05.966503 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:05.966629 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:37883: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260812 01:10:05.967459 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 3182
2026-08-12T01:10:05Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (2982 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:10:06 dist-test-slave-bndk krb5kdc[4067](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:10:06 dist-test-slave-bndk krb5kdc[4067](info): set up 2 sockets
Aug 12 01:10:06 dist-test-slave-bndk krb5kdc[4067](info): commencing operation
krb5kdc: starting...
W20260812 01:10:07.220198 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.205s user 0.000s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:10:07 dist-test-slave-bndk krb5kdc[4067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497007, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:10:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:10:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.201.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
I20260812 01:10:07.512406 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:45781
--webserver_interface=127.4.201.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:43379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:45781
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:10:07.859664 4089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:07.859946 4089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:07.860077 4089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:07.867400 4089 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:10:07.867516 4089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:07.867594 4089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:07.867663 4089 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:10:07.867720 4089 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:10:07.877568 4089 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:43379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:45781
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:45781
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:07.878851 4089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:07.880172 4089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:07.891458 4107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:07.891499 4100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:07.891856 4098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:07.892184 4089 server_base.cc:1034] running on GCE node
I20260812 01:10:07.892853 4089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:07.894174 4089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:07.895375 4089 hybrid_clock.cc:648] HybridClock initialized: now 1786497007895335 us; error 24 us; skew 500 ppm
I20260812 01:10:07.895705 4089 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:10:07 dist-test-slave-bndk krb5kdc[4067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497007, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:10:07.898641 4089 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:10:07.900058 4089 webserver.cc:460] Webserver started at http://127.4.201.126:39549/ using document root <none> and password file <none>
I20260812 01:10:07.900671 4089 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:07.900770 4089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:07.901036 4089 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:07.903919 4089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "f12829167ece45de9247e7ef8d4063bf"
format_stamp: "Formatted at 2026-08-12 01:10:07 on dist-test-slave-bndk"
server_key: "043889e44e1480a16f8cd804d8973503"
server_key_iv: "935d743bbfd84a6582945cbc9a23ee41"
server_key_version: "encryptionkey@0"
I20260812 01:10:07.904616 4089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "f12829167ece45de9247e7ef8d4063bf"
format_stamp: "Formatted at 2026-08-12 01:10:07 on dist-test-slave-bndk"
server_key: "043889e44e1480a16f8cd804d8973503"
server_key_iv: "935d743bbfd84a6582945cbc9a23ee41"
server_key_version: "encryptionkey@0"
I20260812 01:10:07.909708 4089 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260812 01:10:07.912904 4118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:07.914170 4089 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 01:10:07.914302 4089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "f12829167ece45de9247e7ef8d4063bf"
format_stamp: "Formatted at 2026-08-12 01:10:07 on dist-test-slave-bndk"
server_key: "043889e44e1480a16f8cd804d8973503"
server_key_iv: "935d743bbfd84a6582945cbc9a23ee41"
server_key_version: "encryptionkey@0"
I20260812 01:10:07.914458 4089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:07.929942 4089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:07.933974 4089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:07.934223 4089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:07.951344 4089 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:45781
I20260812 01:10:07.951387 4204 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:45781 every 8 connection(s)
I20260812 01:10:07.952754 4089 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:10:07.956382 4205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:07.959860 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 4089
I20260812 01:10:07.960079 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:10:07.960613 4901 external_mini_cluster.cc:1428] Setting key 2e12a3ce643eaa8b45a6f22ef2bd1f29
I20260812 01:10:07.968797 4205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f12829167ece45de9247e7ef8d4063bf: Bootstrap starting.
I20260812 01:10:07.972465 4205 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f12829167ece45de9247e7ef8d4063bf: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:07.973789 4205 log.cc:824] T 00000000000000000000000000000000 P f12829167ece45de9247e7ef8d4063bf: Log is configured to *not* fsync() on all Append() calls
Aug 12 01:10:07 dist-test-slave-bndk krb5kdc[4067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497007, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:10:07.976891 4205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f12829167ece45de9247e7ef8d4063bf: No bootstrap required, opened a new log
I20260812 01:10:07.983435 4210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:07.962446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54156 (local address 127.4.201.126:45781)
0812 01:10:07.963193 (+ 747us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:07.963204 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:07.963245 (+ 41us) server_negotiation.cc:407] Connection header received
0812 01:10:07.964878 (+ 1633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:07.964901 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:07.965329 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:07.965658 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:07.967447 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:07.968704 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:07.970509 (+ 1805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:07.971151 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:07.971283 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:07.976159 (+ 4876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:07.976171 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:07.976190 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:07.976233 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:07.979394 (+ 3161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:07.980059 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:07.980066 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:07.980072 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:07.980258 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:07.980647 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:07.980651 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:07.980653 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:07.981269 (+ 616us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:07.981586 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:07.982023 (+ 437us) server_negotiation.cc:299] Negotiation successful
0812 01:10:07.982437 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":542,"thread_start_us":336,"threads_started":1}
I20260812 01:10:07.984853 4205 raft_consensus.cc:348] T 00000000000000000000000000000000 P f12829167ece45de9247e7ef8d4063bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f12829167ece45de9247e7ef8d4063bf" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45781 } }
I20260812 01:10:07.985319 4205 raft_consensus.cc:374] T 00000000000000000000000000000000 P f12829167ece45de9247e7ef8d4063bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:07.985428 4205 raft_consensus.cc:729] T 00000000000000000000000000000000 P f12829167ece45de9247e7ef8d4063bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f12829167ece45de9247e7ef8d4063bf, State: Initialized, Role: FOLLOWER
I20260812 01:10:07.986083 4205 consensus_queue.cc:260] T 00000000000000000000000000000000 P f12829167ece45de9247e7ef8d4063bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f12829167ece45de9247e7ef8d4063bf" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45781 } }
I20260812 01:10:07.986371 4205 raft_consensus.cc:388] T 00000000000000000000000000000000 P f12829167ece45de9247e7ef8d4063bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:10:07.986526 4205 raft_consensus.cc:482] T 00000000000000000000000000000000 P f12829167ece45de9247e7ef8d4063bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:10:07.986660 4205 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f12829167ece45de9247e7ef8d4063bf [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:07.988700 4205 raft_consensus.cc:504] T 00000000000000000000000000000000 P f12829167ece45de9247e7ef8d4063bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f12829167ece45de9247e7ef8d4063bf" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45781 } }
I20260812 01:10:07.989154 4205 leader_election.cc:302] T 00000000000000000000000000000000 P f12829167ece45de9247e7ef8d4063bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f12829167ece45de9247e7ef8d4063bf; no voters:
I20260812 01:10:07.989763 4205 leader_election.cc:288] T 00000000000000000000000000000000 P f12829167ece45de9247e7ef8d4063bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:10:07.989879 4213 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f12829167ece45de9247e7ef8d4063bf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:10:07.990520 4213 raft_consensus.cc:686] T 00000000000000000000000000000000 P f12829167ece45de9247e7ef8d4063bf [term 1 LEADER]: Becoming Leader. State: Replica: f12829167ece45de9247e7ef8d4063bf, State: Running, Role: LEADER
I20260812 01:10:07.991150 4213 consensus_queue.cc:237] T 00000000000000000000000000000000 P f12829167ece45de9247e7ef8d4063bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f12829167ece45de9247e7ef8d4063bf" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45781 } }
I20260812 01:10:07.992017 4205 sys_catalog.cc:564] T 00000000000000000000000000000000 P f12829167ece45de9247e7ef8d4063bf [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:10:07.993932 4215 sys_catalog.cc:455] T 00000000000000000000000000000000 P f12829167ece45de9247e7ef8d4063bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f12829167ece45de9247e7ef8d4063bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f12829167ece45de9247e7ef8d4063bf" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45781 } } }
I20260812 01:10:07.993880 4219 sys_catalog.cc:455] T 00000000000000000000000000000000 P f12829167ece45de9247e7ef8d4063bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader f12829167ece45de9247e7ef8d4063bf. Latest consensus state: current_term: 1 leader_uuid: "f12829167ece45de9247e7ef8d4063bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f12829167ece45de9247e7ef8d4063bf" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 45781 } } }
I20260812 01:10:07.994416 4215 sys_catalog.cc:458] T 00000000000000000000000000000000 P f12829167ece45de9247e7ef8d4063bf [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:07.994448 4219 sys_catalog.cc:458] T 00000000000000000000000000000000 P f12829167ece45de9247e7ef8d4063bf [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:07.995198 4240 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:10:07.999716 4240 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:10:08.008417 4240 catalog_manager.cc:1347] Generated new cluster ID: faef50a6cd91477c8e5e06f4eb187773
I20260812 01:10:08.008533 4240 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:10:08.042862 4240 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:10:08.044358 4240 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:10:08.055490 4240 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f12829167ece45de9247e7ef8d4063bf: Generated new TSK 0
I20260812 01:10:08.056316 4240 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.201.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
Entry for principal kudu/127.4.201.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab.
I20260812 01:10:08.140062 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:0
--local_ip_for_outbound_sockets=127.4.201.65
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:45781
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:43379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:10:08.478820 4257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:08.479075 4257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:08.479209 4257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:08.487203 4257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:08.487316 4257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:08.487478 4257 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:10:08.497478 4257 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:43379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.65.keytab
--principal=kudu/127.4.201.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:45781
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:08.498688 4257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:08.499995 4257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:08.512657 4262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:08.512714 4265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:08.512750 4267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:08.513762 4257 server_base.cc:1034] running on GCE node
I20260812 01:10:08.514371 4257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:08.515290 4257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:08.516495 4257 hybrid_clock.cc:648] HybridClock initialized: now 1786497008516440 us; error 41 us; skew 500 ppm
I20260812 01:10:08.516790 4257 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:10:08 dist-test-slave-bndk krb5kdc[4067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497008, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:10:08.519936 4257 init.cc:377] Logged in from keytab as kudu/127.4.201.65@KRBTEST.COM (short username kudu)
I20260812 01:10:08.521345 4257 webserver.cc:460] Webserver started at http://127.4.201.65:33619/ using document root <none> and password file <none>
I20260812 01:10:08.521984 4257 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:08.522087 4257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:08.522356 4257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:08.525134 4257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-0/data/instance:
uuid: "2c8b845c8cfc42549ded999200fc24d7"
format_stamp: "Formatted at 2026-08-12 01:10:08 on dist-test-slave-bndk"
server_key: "77601528f56c0ca3b5a1e8e082e47dcd"
server_key_iv: "b1fba7b8086a7cee8f680b9fa99d5853"
server_key_version: "encryptionkey@0"
I20260812 01:10:08.525938 4257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance:
uuid: "2c8b845c8cfc42549ded999200fc24d7"
format_stamp: "Formatted at 2026-08-12 01:10:08 on dist-test-slave-bndk"
server_key: "77601528f56c0ca3b5a1e8e082e47dcd"
server_key_iv: "b1fba7b8086a7cee8f680b9fa99d5853"
server_key_version: "encryptionkey@0"
I20260812 01:10:08.530754 4257 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 01:10:08.534072 4279 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:08.535295 4257 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260812 01:10:08.535434 4257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "2c8b845c8cfc42549ded999200fc24d7"
format_stamp: "Formatted at 2026-08-12 01:10:08 on dist-test-slave-bndk"
server_key: "77601528f56c0ca3b5a1e8e082e47dcd"
server_key_iv: "b1fba7b8086a7cee8f680b9fa99d5853"
server_key_version: "encryptionkey@0"
I20260812 01:10:08.535629 4257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:08.552256 4257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:08.556457 4257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:08.556722 4257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:08.557730 4257 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:10:08.559084 4257 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:10:08.559157 4257 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:08.559280 4257 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:10:08.559333 4257 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:08.589663 4257 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:37413
I20260812 01:10:08.589709 4469 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:37413 every 8 connection(s)
I20260812 01:10:08.590950 4257 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:10:08.600680 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 4257
I20260812 01:10:08.600883 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance
I20260812 01:10:08.601419 4901 external_mini_cluster.cc:1428] Setting key 5d4a3f02df4626899f8bc2caa8ce57e7
Aug 12 01:10:08 dist-test-slave-bndk krb5kdc[4067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497008, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.65@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:10:08.612046 4476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:08.593453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:59217 (local address 127.4.201.126:45781)
0812 01:10:08.593889 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:08.593894 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:08.594910 (+ 1016us) server_negotiation.cc:407] Connection header received
0812 01:10:08.596728 (+ 1818us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:08.596734 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:08.596814 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:08.596914 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:08.598460 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:08.599166 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:08.600877 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:08.601411 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:08.601534 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:08.606540 (+ 5006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:08.606545 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:08.606549 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:08.606582 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:08.609052 (+ 2470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:08.609882 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:08.609886 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:08.609888 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:08.610011 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:08.610436 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:08.610439 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:08.610441 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:08.610691 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:08.610801 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:08.611625 (+ 824us) server_negotiation.cc:299] Negotiation successful
0812 01:10:08.611793 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":208,"threads_started":1}
I20260812 01:10:08.613407 4477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:08.594077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45781 (local address 127.4.201.65:59217)
0812 01:10:08.594753 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:08.594797 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:08.596463 (+ 1666us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:08.597165 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:08.597173 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:08.597734 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:10:08.598292 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:08.598309 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:08.599324 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:08.599328 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:08.600737 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:08.600753 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:08.601647 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:08.601654 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:08.601931 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:08.603320 (+ 1389us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:10:08.603358 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:10:08.606298 (+ 2940us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:10:08.609189 (+ 2891us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:08.609198 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:08.609239 (+ 41us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:08.609772 (+ 533us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:08.610109 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:08.610113 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:08.610116 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:08.610346 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:08.610807 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:10:08.610814 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:10:08.611242 (+ 428us) client_negotiation.cc:769] Sending connection context
0812 01:10:08.611554 (+ 312us) client_negotiation.cc:240] Negotiation successful
0812 01:10:08.612057 (+ 503us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":255,"threads_started":1}
I20260812 01:10:08.614854 4471 heartbeater.cc:347] Connected to a master server at 127.4.201.126:45781
I20260812 01:10:08.615151 4471 heartbeater.cc:464] Registering TS with master...
I20260812 01:10:08.615886 4471 heartbeater.cc:511] Master 127.4.201.126:45781 requested a full tablet report, sending...
I20260812 01:10:08.618227 4146 ts_manager.cc:194] Registered new tserver with Master: 2c8b845c8cfc42549ded999200fc24d7 (127.4.201.65:37413)
I20260812 01:10:08.620172 4146 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.65@KRBTEST.COM'} at 127.4.201.65:59217
WARNING: no policy specified for kudu/127.4.201.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
Entry for principal kudu/127.4.201.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab.
I20260812 01:10:08.667976 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:0
--local_ip_for_outbound_sockets=127.4.201.66
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:45781
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:43379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:10:09.003196 4485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:09.003490 4485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:09.003630 4485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:09.010764 4485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:09.010879 4485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:09.011039 4485 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:10:09.020514 4485 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:43379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.66.keytab
--principal=kudu/127.4.201.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:45781
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:09.021780 4485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:09.023042 4485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:09.035748 4492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:09.035708 4493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:09.035719 4497 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:09.036968 4485 server_base.cc:1034] running on GCE node
I20260812 01:10:09.037585 4485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:09.038498 4485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:09.039696 4485 hybrid_clock.cc:648] HybridClock initialized: now 1786497009039647 us; error 41 us; skew 500 ppm
I20260812 01:10:09.039996 4485 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:10:09 dist-test-slave-bndk krb5kdc[4067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497009, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:10:09.043041 4485 init.cc:377] Logged in from keytab as kudu/127.4.201.66@KRBTEST.COM (short username kudu)
I20260812 01:10:09.044438 4485 webserver.cc:460] Webserver started at http://127.4.201.66:40905/ using document root <none> and password file <none>
I20260812 01:10:09.045115 4485 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:09.045259 4485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:09.045640 4485 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:09.048448 4485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-1/data/instance:
uuid: "0ab3078ae0f5496c971d16ab97a00408"
format_stamp: "Formatted at 2026-08-12 01:10:09 on dist-test-slave-bndk"
server_key: "ac85f6ad0953215354a06986ca0b44ec"
server_key_iv: "19955b9c74f2002a94dad03462300acc"
server_key_version: "encryptionkey@0"
I20260812 01:10:09.049201 4485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance:
uuid: "0ab3078ae0f5496c971d16ab97a00408"
format_stamp: "Formatted at 2026-08-12 01:10:09 on dist-test-slave-bndk"
server_key: "ac85f6ad0953215354a06986ca0b44ec"
server_key_iv: "19955b9c74f2002a94dad03462300acc"
server_key_version: "encryptionkey@0"
I20260812 01:10:09.054349 4485 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260812 01:10:09.057793 4511 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:09.059098 4485 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 01:10:09.059257 4485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "0ab3078ae0f5496c971d16ab97a00408"
format_stamp: "Formatted at 2026-08-12 01:10:09 on dist-test-slave-bndk"
server_key: "ac85f6ad0953215354a06986ca0b44ec"
server_key_iv: "19955b9c74f2002a94dad03462300acc"
server_key_version: "encryptionkey@0"
I20260812 01:10:09.059445 4485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:09.075764 4485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:09.079464 4485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:09.079731 4485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:09.080667 4485 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:10:09.082012 4485 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:10:09.082090 4485 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:09.082211 4485 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:10:09.082281 4485 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:09.111639 4485 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:42971
I20260812 01:10:09.111675 4709 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:42971 every 8 connection(s)
I20260812 01:10:09.112937 4485 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:10:09.116354 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 4485
I20260812 01:10:09.116564 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance
I20260812 01:10:09.117100 4901 external_mini_cluster.cc:1428] Setting key 86afdc8723790b797e8a43ace0216ec6
Aug 12 01:10:09 dist-test-slave-bndk krb5kdc[4067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497009, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.66@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:10:09.133883 4716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:09.115404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:43219 (local address 127.4.201.126:45781)
0812 01:10:09.115840 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:09.115845 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:09.116823 (+ 978us) server_negotiation.cc:407] Connection header received
0812 01:10:09.118915 (+ 2092us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:09.118921 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:09.119002 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:09.119113 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:09.121092 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:09.121870 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:09.123919 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:09.124327 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:09.124422 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:09.128130 (+ 3708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:09.128137 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:09.128141 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:09.128179 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:09.131094 (+ 2915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:09.131783 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:09.131788 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:09.131791 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:09.131943 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:09.132315 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:09.132319 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:09.132322 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:09.132641 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:09.132779 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:09.133442 (+ 663us) server_negotiation.cc:299] Negotiation successful
0812 01:10:09.133615 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":225,"threads_started":1}
I20260812 01:10:09.135305 4717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:09.115828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45781 (local address 127.4.201.66:43219)
0812 01:10:09.116661 (+ 833us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:09.116710 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:09.118616 (+ 1906us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:09.119396 (+ 780us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:09.119407 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:09.120146 (+ 739us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:10:09.120880 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:09.120907 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:09.122055 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:09.122060 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:09.123792 (+ 1732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:09.123808 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:09.124535 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:09.124542 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:09.124800 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:09.125500 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:10:09.125527 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:10:09.127896 (+ 2369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:10:09.131223 (+ 3327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:09.131230 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:09.131242 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:09.131670 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:09.132046 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:09.132049 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:09.132051 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:09.132223 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:09.132752 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:10:09.132757 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:10:09.133054 (+ 297us) client_negotiation.cc:769] Sending connection context
0812 01:10:09.133329 (+ 275us) client_negotiation.cc:240] Negotiation successful
0812 01:10:09.133858 (+ 529us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":311,"threads_started":1}
I20260812 01:10:09.136756 4710 heartbeater.cc:347] Connected to a master server at 127.4.201.126:45781
I20260812 01:10:09.137132 4710 heartbeater.cc:464] Registering TS with master...
I20260812 01:10:09.137993 4710 heartbeater.cc:511] Master 127.4.201.126:45781 requested a full tablet report, sending...
I20260812 01:10:09.139761 4146 ts_manager.cc:194] Registered new tserver with Master: 0ab3078ae0f5496c971d16ab97a00408 (127.4.201.66:42971)
I20260812 01:10:09.140568 4146 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.66@KRBTEST.COM'} at 127.4.201.66:43219
WARNING: no policy specified for kudu/127.4.201.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
Entry for principal kudu/127.4.201.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab.
I20260812 01:10:09.186307 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:0
--local_ip_for_outbound_sockets=127.4.201.67
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:45781
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:43379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:10:09.517275 4720 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:09.517547 4720 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:09.517691 4720 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:09.525019 4720 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:09.525112 4720 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:09.525259 4720 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:10:09.534593 4720 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:43379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.67.keytab
--principal=kudu/127.4.201.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:45781
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:09.535738 4720 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:09.536969 4720 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:09.549511 4728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:09.549587 4731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:09.549544 4729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:09.550323 4720 server_base.cc:1034] running on GCE node
I20260812 01:10:09.550877 4720 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:09.551782 4720 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:09.552973 4720 hybrid_clock.cc:648] HybridClock initialized: now 1786497009552936 us; error 27 us; skew 500 ppm
I20260812 01:10:09.553320 4720 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:10:09 dist-test-slave-bndk krb5kdc[4067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497009, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:10:09.556322 4720 init.cc:377] Logged in from keytab as kudu/127.4.201.67@KRBTEST.COM (short username kudu)
I20260812 01:10:09.557731 4720 webserver.cc:460] Webserver started at http://127.4.201.67:41939/ using document root <none> and password file <none>
I20260812 01:10:09.558367 4720 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:09.558466 4720 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:09.558732 4720 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:09.561681 4720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-2/data/instance:
uuid: "764b280684c947bf907324ed41937bd4"
format_stamp: "Formatted at 2026-08-12 01:10:09 on dist-test-slave-bndk"
server_key: "b7e5d6028413eacd2de9c7f7b0083cd7"
server_key_iv: "4cf8204f3106952540b1b2f0dd039b18"
server_key_version: "encryptionkey@0"
I20260812 01:10:09.562479 4720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance:
uuid: "764b280684c947bf907324ed41937bd4"
format_stamp: "Formatted at 2026-08-12 01:10:09 on dist-test-slave-bndk"
server_key: "b7e5d6028413eacd2de9c7f7b0083cd7"
server_key_iv: "4cf8204f3106952540b1b2f0dd039b18"
server_key_version: "encryptionkey@0"
I20260812 01:10:09.567543 4720 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 01:10:09.570808 4745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:09.572129 4720 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 01:10:09.572266 4720 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "764b280684c947bf907324ed41937bd4"
format_stamp: "Formatted at 2026-08-12 01:10:09 on dist-test-slave-bndk"
server_key: "b7e5d6028413eacd2de9c7f7b0083cd7"
server_key_iv: "4cf8204f3106952540b1b2f0dd039b18"
server_key_version: "encryptionkey@0"
I20260812 01:10:09.572434 4720 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:09.589046 4720 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:09.593093 4720 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:09.593390 4720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:09.594269 4720 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:10:09.595525 4720 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:10:09.595598 4720 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:09.595710 4720 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:10:09.595759 4720 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:09.623184 4471 heartbeater.cc:503] Master 127.4.201.126:45781 was elected leader, sending a full tablet report...
I20260812 01:10:09.625746 4720 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:35803
I20260812 01:10:09.625784 4945 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:35803 every 8 connection(s)
I20260812 01:10:09.626988 4720 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:10:09.632539 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 4720
I20260812 01:10:09.632699 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance
I20260812 01:10:09.633183 4901 external_mini_cluster.cc:1428] Setting key 9dcffc28ae39c0e707c3eddd9a2216fd
Aug 12 01:10:09 dist-test-slave-bndk krb5kdc[4067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497009, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.67@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:10:09.645149 4716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:09.629331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:54137 (local address 127.4.201.126:45781)
0812 01:10:09.629506 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:09.629510 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:09.630704 (+ 1194us) server_negotiation.cc:407] Connection header received
0812 01:10:09.632521 (+ 1817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:09.632526 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:09.632630 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:09.632730 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:09.634258 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:09.635002 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:09.636606 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:09.637009 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:09.637115 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:09.640398 (+ 3283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:09.640404 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:09.640407 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:09.640439 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:09.642719 (+ 2280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:09.643367 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:09.643371 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:09.643373 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:09.643479 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:09.643804 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:09.643806 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:09.643808 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:09.644071 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:09.644188 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:09.644744 (+ 556us) server_negotiation.cc:299] Negotiation successful
0812 01:10:09.644908 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 01:10:09.646078 4950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:09.629845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:45781 (local address 127.4.201.67:54137)
0812 01:10:09.630535 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:09.630573 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:09.632260 (+ 1687us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:09.632975 (+ 715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:09.632984 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:09.633552 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:10:09.634092 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:09.634110 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:09.635145 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:09.635149 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:09.636461 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:09.636484 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:09.637258 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:09.637268 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:09.637486 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:09.638046 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:10:09.638073 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:10:09.640221 (+ 2148us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:10:09.642836 (+ 2615us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:09.642843 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:09.642854 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:09.643279 (+ 425us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:09.643553 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:09.643556 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:09.643558 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:09.643726 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:09.644165 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:10:09.644171 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:10:09.644459 (+ 288us) client_negotiation.cc:769] Sending connection context
0812 01:10:09.644668 (+ 209us) client_negotiation.cc:240] Negotiation successful
0812 01:10:09.645027 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":263,"threads_started":1}
I20260812 01:10:09.647217 4946 heartbeater.cc:347] Connected to a master server at 127.4.201.126:45781
I20260812 01:10:09.647519 4946 heartbeater.cc:464] Registering TS with master...
I20260812 01:10:09.648300 4946 heartbeater.cc:511] Master 127.4.201.126:45781 requested a full tablet report, sending...
I20260812 01:10:09.649642 4146 ts_manager.cc:194] Registered new tserver with Master: 764b280684c947bf907324ed41937bd4 (127.4.201.67:35803)
I20260812 01:10:09.650398 4146 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.201.67@KRBTEST.COM'} at 127.4.201.67:54137
I20260812 01:10:09.660022 4901 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:10:09.675446 4716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:09.663981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54164 (local address 127.4.201.126:45781)
0812 01:10:09.664169 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:09.664176 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:09.664605 (+ 429us) server_negotiation.cc:407] Connection header received
0812 01:10:09.664732 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:09.664735 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:09.664803 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:09.664880 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:09.666301 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:09.667000 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:09.668164 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:09.668542 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:09.668628 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:09.670805 (+ 2177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:09.670810 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:09.670813 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:09.670841 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:09.673075 (+ 2234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:09.673753 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:09.673757 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:09.673760 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:09.673907 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:09.674204 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:09.674207 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:09.674209 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:09.674520 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:09.674719 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:09.674980 (+ 261us) server_negotiation.cc:299] Negotiation successful
0812 01:10:09.675143 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 01:10:09.679035 4146 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54164:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:10:09.685747 4146 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:10:09.726717 4973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:09.698946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52774 (local address 127.4.201.65:37413)
0812 01:10:09.718437 (+ 19491us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:09.718446 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:09.718476 (+ 30us) server_negotiation.cc:407] Connection header received
0812 01:10:09.718644 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:09.718652 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:09.718896 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:09.719473 (+ 577us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:10:09.720123 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:09.721619 (+ 1496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:09.724156 (+ 2537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:09.725552 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:09.725690 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:09.725931 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:09.726227 (+ 296us) server_negotiation.cc:299] Negotiation successful
0812 01:10:09.726392 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19294,"thread_start_us":19072,"threads_started":1}
I20260812 01:10:09.727021 4964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:09.698648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:37413 (local address 127.0.0.1:52774)
0812 01:10:09.699521 (+ 873us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:09.699564 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:09.699747 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:09.719460 (+ 19713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:09.719464 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:09.719507 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:10:09.719937 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:09.719951 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:09.721746 (+ 1795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:09.721755 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:09.724000 (+ 2245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:09.724014 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:09.725774 (+ 1760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:09.725781 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:09.725969 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:09.726022 (+ 53us) client_negotiation.cc:769] Sending connection context
0812 01:10:09.726162 (+ 140us) client_negotiation.cc:240] Negotiation successful
0812 01:10:09.726368 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":602,"mutex_wait_us":372,"thread_start_us":452,"threads_started":1}
I20260812 01:10:09.727178 4976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:09.698864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:42971 (local address 127.0.0.1:33596)
0812 01:10:09.714396 (+ 15532us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:09.714417 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:09.714568 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:09.719006 (+ 4438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:09.719014 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:09.719055 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:10:09.719631 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:09.719646 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:09.721625 (+ 1979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:09.721630 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:09.724327 (+ 2697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:09.724344 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:09.726357 (+ 2013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:09.726363 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:09.726561 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:09.726589 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 01:10:09.726668 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 01:10:09.726794 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15384,"mutex_wait_us":41,"thread_start_us":20271,"threads_started":1}
I20260812 01:10:09.727960 4979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:09.701429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60962 (local address 127.4.201.67:35803)
0812 01:10:09.713728 (+ 12299us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:09.713739 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:09.719642 (+ 5903us) server_negotiation.cc:407] Connection header received
0812 01:10:09.719935 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:09.719943 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:09.720168 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:09.720324 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:10:09.720856 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:09.722328 (+ 1472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:09.724711 (+ 2383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:09.725675 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:09.725794 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:09.726035 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:09.727451 (+ 1416us) server_negotiation.cc:299] Negotiation successful
0812 01:10:09.727612 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12077,"thread_start_us":12302,"threads_started":1}
I20260812 01:10:09.728359 4966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:09.701064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:35803 (local address 127.0.0.1:60962)
0812 01:10:09.719509 (+ 18445us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:09.719528 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:09.719748 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:09.720332 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:09.720336 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:09.720358 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:10:09.720696 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:09.720705 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:09.722459 (+ 1754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:09.722464 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:09.724574 (+ 2110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:09.724584 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:09.726109 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:09.726116 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:09.726295 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:09.726327 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 01:10:09.726416 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 01:10:09.726543 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18303,"mutex_wait_us":24,"thread_start_us":13034,"threads_started":1}
I20260812 01:10:09.728387 4974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:09.699381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33596 (local address 127.4.201.66:42971)
0812 01:10:09.717690 (+ 18309us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:09.717700 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:09.717736 (+ 36us) server_negotiation.cc:407] Connection header received
0812 01:10:09.717866 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:09.717875 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:09.718776 (+ 901us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:09.718978 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:10:09.719832 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:09.721459 (+ 1627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:09.724499 (+ 3040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:09.725905 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:09.726033 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:09.726210 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:09.727912 (+ 1702us) server_negotiation.cc:299] Negotiation successful
0812 01:10:09.728082 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18154,"thread_start_us":18019,"threads_started":1}
I20260812 01:10:09.730712 4361 tablet_service.cc:1467] Processing CreateTablet for tablet 198531e31eee46dfaa632c1e7957b752 (DEFAULT_TABLE table=test-table [id=43a589a6533e466aae7fa97ecfd8bffa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:10:09.731208 4826 tablet_service.cc:1467] Processing CreateTablet for tablet 198531e31eee46dfaa632c1e7957b752 (DEFAULT_TABLE table=test-table [id=43a589a6533e466aae7fa97ecfd8bffa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:10:09.732218 4361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 198531e31eee46dfaa632c1e7957b752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:09.732520 4826 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 198531e31eee46dfaa632c1e7957b752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:09.734750 4605 tablet_service.cc:1467] Processing CreateTablet for tablet 198531e31eee46dfaa632c1e7957b752 (DEFAULT_TABLE table=test-table [id=43a589a6533e466aae7fa97ecfd8bffa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:10:09.736100 4605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 198531e31eee46dfaa632c1e7957b752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:09.743494 4980 tablet_bootstrap.cc:492] T 198531e31eee46dfaa632c1e7957b752 P 2c8b845c8cfc42549ded999200fc24d7: Bootstrap starting.
I20260812 01:10:09.746764 4981 tablet_bootstrap.cc:492] T 198531e31eee46dfaa632c1e7957b752 P 764b280684c947bf907324ed41937bd4: Bootstrap starting.
I20260812 01:10:09.746984 4980 tablet_bootstrap.cc:654] T 198531e31eee46dfaa632c1e7957b752 P 2c8b845c8cfc42549ded999200fc24d7: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:09.748255 4980 log.cc:824] T 198531e31eee46dfaa632c1e7957b752 P 2c8b845c8cfc42549ded999200fc24d7: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:09.749790 4984 tablet_bootstrap.cc:492] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408: Bootstrap starting.
I20260812 01:10:09.750241 4981 tablet_bootstrap.cc:654] T 198531e31eee46dfaa632c1e7957b752 P 764b280684c947bf907324ed41937bd4: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:09.751384 4981 log.cc:824] T 198531e31eee46dfaa632c1e7957b752 P 764b280684c947bf907324ed41937bd4: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:09.752990 4980 tablet_bootstrap.cc:492] T 198531e31eee46dfaa632c1e7957b752 P 2c8b845c8cfc42549ded999200fc24d7: No bootstrap required, opened a new log
I20260812 01:10:09.753031 4984 tablet_bootstrap.cc:654] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:09.753285 4980 ts_tablet_manager.cc:1397] T 198531e31eee46dfaa632c1e7957b752 P 2c8b845c8cfc42549ded999200fc24d7: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.007s
I20260812 01:10:09.753985 4984 log.cc:824] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:09.754421 4981 tablet_bootstrap.cc:492] T 198531e31eee46dfaa632c1e7957b752 P 764b280684c947bf907324ed41937bd4: No bootstrap required, opened a new log
I20260812 01:10:09.754839 4981 ts_tablet_manager.cc:1397] T 198531e31eee46dfaa632c1e7957b752 P 764b280684c947bf907324ed41937bd4: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260812 01:10:09.756263 4984 tablet_bootstrap.cc:492] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408: No bootstrap required, opened a new log
I20260812 01:10:09.756496 4984 ts_tablet_manager.cc:1397] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260812 01:10:09.763803 4984 raft_consensus.cc:348] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c8b845c8cfc42549ded999200fc24d7" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 37413 } } peers { permanent_uuid: "0ab3078ae0f5496c971d16ab97a00408" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42971 } } peers { permanent_uuid: "764b280684c947bf907324ed41937bd4" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 35803 } }
I20260812 01:10:09.764186 4984 raft_consensus.cc:374] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:09.764289 4984 raft_consensus.cc:729] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ab3078ae0f5496c971d16ab97a00408, State: Initialized, Role: FOLLOWER
I20260812 01:10:09.764223 4980 raft_consensus.cc:348] T 198531e31eee46dfaa632c1e7957b752 P 2c8b845c8cfc42549ded999200fc24d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c8b845c8cfc42549ded999200fc24d7" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 37413 } } peers { permanent_uuid: "0ab3078ae0f5496c971d16ab97a00408" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42971 } } peers { permanent_uuid: "764b280684c947bf907324ed41937bd4" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 35803 } }
I20260812 01:10:09.764721 4980 raft_consensus.cc:374] T 198531e31eee46dfaa632c1e7957b752 P 2c8b845c8cfc42549ded999200fc24d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:09.764835 4980 raft_consensus.cc:729] T 198531e31eee46dfaa632c1e7957b752 P 2c8b845c8cfc42549ded999200fc24d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c8b845c8cfc42549ded999200fc24d7, State: Initialized, Role: FOLLOWER
I20260812 01:10:09.764873 4984 consensus_queue.cc:260] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c8b845c8cfc42549ded999200fc24d7" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 37413 } } peers { permanent_uuid: "0ab3078ae0f5496c971d16ab97a00408" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42971 } } peers { permanent_uuid: "764b280684c947bf907324ed41937bd4" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 35803 } }
I20260812 01:10:09.764853 4981 raft_consensus.cc:348] T 198531e31eee46dfaa632c1e7957b752 P 764b280684c947bf907324ed41937bd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c8b845c8cfc42549ded999200fc24d7" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 37413 } } peers { permanent_uuid: "0ab3078ae0f5496c971d16ab97a00408" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42971 } } peers { permanent_uuid: "764b280684c947bf907324ed41937bd4" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 35803 } }
I20260812 01:10:09.765398 4981 raft_consensus.cc:374] T 198531e31eee46dfaa632c1e7957b752 P 764b280684c947bf907324ed41937bd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:09.765561 4981 raft_consensus.cc:729] T 198531e31eee46dfaa632c1e7957b752 P 764b280684c947bf907324ed41937bd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764b280684c947bf907324ed41937bd4, State: Initialized, Role: FOLLOWER
I20260812 01:10:09.765448 4980 consensus_queue.cc:260] T 198531e31eee46dfaa632c1e7957b752 P 2c8b845c8cfc42549ded999200fc24d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c8b845c8cfc42549ded999200fc24d7" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 37413 } } peers { permanent_uuid: "0ab3078ae0f5496c971d16ab97a00408" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42971 } } peers { permanent_uuid: "764b280684c947bf907324ed41937bd4" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 35803 } }
I20260812 01:10:09.766099 4710 heartbeater.cc:503] Master 127.4.201.126:45781 was elected leader, sending a full tablet report...
I20260812 01:10:09.766263 4981 consensus_queue.cc:260] T 198531e31eee46dfaa632c1e7957b752 P 764b280684c947bf907324ed41937bd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c8b845c8cfc42549ded999200fc24d7" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 37413 } } peers { permanent_uuid: "0ab3078ae0f5496c971d16ab97a00408" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42971 } } peers { permanent_uuid: "764b280684c947bf907324ed41937bd4" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 35803 } }
I20260812 01:10:09.766733 4984 ts_tablet_manager.cc:1428] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20260812 01:10:09.769799 4946 heartbeater.cc:503] Master 127.4.201.126:45781 was elected leader, sending a full tablet report...
I20260812 01:10:09.770543 4981 ts_tablet_manager.cc:1428] T 198531e31eee46dfaa632c1e7957b752 P 764b280684c947bf907324ed41937bd4: Time spent starting tablet: real 0.016s user 0.014s sys 0.000s
I20260812 01:10:09.774479 4980 ts_tablet_manager.cc:1428] T 198531e31eee46dfaa632c1e7957b752 P 2c8b845c8cfc42549ded999200fc24d7: Time spent starting tablet: real 0.021s user 0.015s sys 0.002s
W20260812 01:10:09.843226 4475 tablet.cc:2369] T 198531e31eee46dfaa632c1e7957b752 P 2c8b845c8cfc42549ded999200fc24d7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 01:10:09.865084 4712 tablet.cc:2369] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:10:09.874392 4994 raft_consensus.cc:482] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:10:09.874683 4994 raft_consensus.cc:504] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c8b845c8cfc42549ded999200fc24d7" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 37413 } } peers { permanent_uuid: "0ab3078ae0f5496c971d16ab97a00408" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42971 } } peers { permanent_uuid: "764b280684c947bf907324ed41937bd4" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 35803 } }
I20260812 01:10:09.876541 4994 leader_election.cc:288] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c8b845c8cfc42549ded999200fc24d7 (127.4.201.65:37413), 764b280684c947bf907324ed41937bd4 (127.4.201.67:35803)
W20260812 01:10:09.878521 4948 tablet.cc:2369] T 198531e31eee46dfaa632c1e7957b752 P 764b280684c947bf907324ed41937bd4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:10:09.883569 4979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:09.877238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:60169 (local address 127.4.201.67:35803)
0812 01:10:09.877449 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:09.877455 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:09.878179 (+ 724us) server_negotiation.cc:407] Connection header received
0812 01:10:09.878351 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:09.878356 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:09.878435 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:09.878535 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:10:09.879215 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:09.879960 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:09.881870 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:09.882625 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:09.882765 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:09.882842 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:09.883210 (+ 368us) server_negotiation.cc:299] Negotiation successful
0812 01:10:09.883334 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 01:10:09.883576 4973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:09.876974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:43437 (local address 127.4.201.65:37413)
0812 01:10:09.877248 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:09.877255 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:09.878054 (+ 799us) server_negotiation.cc:407] Connection header received
0812 01:10:09.878279 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:09.878285 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:09.878355 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:09.878432 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:10:09.879108 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:09.879893 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:09.881896 (+ 2003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:09.882656 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:09.882813 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:09.882888 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:09.883210 (+ 322us) server_negotiation.cc:299] Negotiation successful
0812 01:10:09.883336 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260812 01:10:09.883774 5000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:09.876890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:35803 (local address 127.4.201.66:60169)
0812 01:10:09.878079 (+ 1189us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:09.878093 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:09.878214 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:09.878629 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:09.878633 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:09.878657 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:10:09.879047 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:09.879059 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:09.880094 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:09.880098 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:09.881712 (+ 1614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:09.881728 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:09.882856 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:09.882865 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:09.883034 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:09.883080 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 01:10:09.883163 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 01:10:09.883290 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1088,"mutex_wait_us":53,"thread_start_us":651,"threads_started":1}
I20260812 01:10:09.883790 5001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:09.876777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:37413 (local address 127.4.201.66:43437)
0812 01:10:09.877941 (+ 1164us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:09.877956 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:09.878105 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:09.878462 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:09.878466 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:09.878491 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:10:09.878914 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:09.878927 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:09.880034 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:09.880040 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:09.881739 (+ 1699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:09.881753 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:09.882884 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:09.882890 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:09.883035 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:09.883081 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 01:10:09.883163 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 01:10:09.883293 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1048,"mutex_wait_us":96,"thread_start_us":995,"threads_started":1}
I20260812 01:10:09.884737 4393 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "198531e31eee46dfaa632c1e7957b752" candidate_uuid: "0ab3078ae0f5496c971d16ab97a00408" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c8b845c8cfc42549ded999200fc24d7" is_pre_election: true
I20260812 01:10:09.884855 4855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "198531e31eee46dfaa632c1e7957b752" candidate_uuid: "0ab3078ae0f5496c971d16ab97a00408" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764b280684c947bf907324ed41937bd4" is_pre_election: true
I20260812 01:10:09.885242 4393 raft_consensus.cc:2454] T 198531e31eee46dfaa632c1e7957b752 P 2c8b845c8cfc42549ded999200fc24d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ab3078ae0f5496c971d16ab97a00408 in term 0.
I20260812 01:10:09.885356 4855 raft_consensus.cc:2454] T 198531e31eee46dfaa632c1e7957b752 P 764b280684c947bf907324ed41937bd4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ab3078ae0f5496c971d16ab97a00408 in term 0.
I20260812 01:10:09.885864 4520 leader_election.cc:302] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ab3078ae0f5496c971d16ab97a00408, 2c8b845c8cfc42549ded999200fc24d7; no voters:
I20260812 01:10:09.886226 4994 raft_consensus.cc:2781] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:10:09.886384 4994 raft_consensus.cc:482] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:10:09.886487 4994 raft_consensus.cc:3037] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:09.888577 4994 raft_consensus.cc:504] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c8b845c8cfc42549ded999200fc24d7" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 37413 } } peers { permanent_uuid: "0ab3078ae0f5496c971d16ab97a00408" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42971 } } peers { permanent_uuid: "764b280684c947bf907324ed41937bd4" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 35803 } }
I20260812 01:10:09.889156 4994 leader_election.cc:288] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408 [CANDIDATE]: Term 1 election: Requested vote from peers 2c8b845c8cfc42549ded999200fc24d7 (127.4.201.65:37413), 764b280684c947bf907324ed41937bd4 (127.4.201.67:35803)
I20260812 01:10:09.889537 4393 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "198531e31eee46dfaa632c1e7957b752" candidate_uuid: "0ab3078ae0f5496c971d16ab97a00408" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c8b845c8cfc42549ded999200fc24d7"
I20260812 01:10:09.889662 4855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "198531e31eee46dfaa632c1e7957b752" candidate_uuid: "0ab3078ae0f5496c971d16ab97a00408" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764b280684c947bf907324ed41937bd4"
I20260812 01:10:09.889737 4393 raft_consensus.cc:3037] T 198531e31eee46dfaa632c1e7957b752 P 2c8b845c8cfc42549ded999200fc24d7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:09.889855 4855 raft_consensus.cc:3037] T 198531e31eee46dfaa632c1e7957b752 P 764b280684c947bf907324ed41937bd4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:09.891875 4393 raft_consensus.cc:2454] T 198531e31eee46dfaa632c1e7957b752 P 2c8b845c8cfc42549ded999200fc24d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ab3078ae0f5496c971d16ab97a00408 in term 1.
I20260812 01:10:09.892010 4855 raft_consensus.cc:2454] T 198531e31eee46dfaa632c1e7957b752 P 764b280684c947bf907324ed41937bd4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ab3078ae0f5496c971d16ab97a00408 in term 1.
I20260812 01:10:09.892215 4520 leader_election.cc:302] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ab3078ae0f5496c971d16ab97a00408, 2c8b845c8cfc42549ded999200fc24d7; no voters:
I20260812 01:10:09.892484 4994 raft_consensus.cc:2781] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:10:09.892897 4994 raft_consensus.cc:686] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408 [term 1 LEADER]: Becoming Leader. State: Replica: 0ab3078ae0f5496c971d16ab97a00408, State: Running, Role: LEADER
I20260812 01:10:09.893438 4994 consensus_queue.cc:237] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c8b845c8cfc42549ded999200fc24d7" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 37413 } } peers { permanent_uuid: "0ab3078ae0f5496c971d16ab97a00408" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42971 } } peers { permanent_uuid: "764b280684c947bf907324ed41937bd4" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 35803 } }
I20260812 01:10:09.897730 4142 catalog_manager.cc:5495] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ab3078ae0f5496c971d16ab97a00408 (127.4.201.66). New cstate: current_term: 1 leader_uuid: "0ab3078ae0f5496c971d16ab97a00408" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c8b845c8cfc42549ded999200fc24d7" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 37413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ab3078ae0f5496c971d16ab97a00408" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764b280684c947bf907324ed41937bd4" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 35803 } health_report { overall_health: UNKNOWN } } }
I20260812 01:10:09.956542 4974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:09.951077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33610 (local address 127.4.201.66:42971)
0812 01:10:09.951271 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:09.951277 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:09.951411 (+ 134us) server_negotiation.cc:407] Connection header received
0812 01:10:09.951629 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:09.951633 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:09.951718 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:09.951853 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:10:09.952245 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:09.952963 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:09.954381 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:09.954815 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:09.954934 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:09.955494 (+ 560us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:10:09.956004 (+ 510us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:10:09.956121 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:09.956219 (+ 98us) server_negotiation.cc:299] Negotiation successful
0812 01:10:09.956287 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 01:10:09.965332 4855 raft_consensus.cc:1261] T 198531e31eee46dfaa632c1e7957b752 P 764b280684c947bf907324ed41937bd4 [term 1 FOLLOWER]: Refusing update from remote peer 0ab3078ae0f5496c971d16ab97a00408: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:10:09.965456 4393 raft_consensus.cc:1261] T 198531e31eee46dfaa632c1e7957b752 P 2c8b845c8cfc42549ded999200fc24d7 [term 1 FOLLOWER]: Refusing update from remote peer 0ab3078ae0f5496c971d16ab97a00408: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:10:09.966389 4994 consensus_queue.cc:1035] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764b280684c947bf907324ed41937bd4" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:10:09.966706 5003 consensus_queue.cc:1035] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c8b845c8cfc42549ded999200fc24d7" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 37413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:10:09.979065 5007 mvcc.cc:205] Tried to move back new op lower bound from 7317491752806957056 to 7317491752527282176. Current Snapshot: MvccSnapshot[applied={T|T < 7317491752806957056}]
I20260812 01:10:09.980508 5008 mvcc.cc:205] Tried to move back new op lower bound from 7317491752806957056 to 7317491752527282176. Current Snapshot: MvccSnapshot[applied={T|T < 7317491752806957056}]
I20260812 01:10:09.991138 4142 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54164:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:10:09.991437 4142 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54164:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:10:09.994956 4142 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f12829167ece45de9247e7ef8d4063bf: Sending DeleteTablet for 3 replicas of tablet 198531e31eee46dfaa632c1e7957b752
I20260812 01:10:09.996037 4361 tablet_service.cc:1514] Processing DeleteTablet for tablet 198531e31eee46dfaa632c1e7957b752 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:10:09 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:52774
I20260812 01:10:09.996044 4826 tablet_service.cc:1514] Processing DeleteTablet for tablet 198531e31eee46dfaa632c1e7957b752 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:10:09 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:60962
I20260812 01:10:09.996074 4605 tablet_service.cc:1514] Processing DeleteTablet for tablet 198531e31eee46dfaa632c1e7957b752 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:10:09 UTC) from {username='kudu', principal='kudu/127.4.201.126@KRBTEST.COM'} at 127.0.0.1:33596
I20260812 01:10:09.998189 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 4257
I20260812 01:10:10.010058 5022 tablet_replica.cc:330] T 198531e31eee46dfaa632c1e7957b752 P 2c8b845c8cfc42549ded999200fc24d7: stopping tablet replica
I20260812 01:10:10.010700 5021 tablet_replica.cc:330] T 198531e31eee46dfaa632c1e7957b752 P 764b280684c947bf907324ed41937bd4: stopping tablet replica
I20260812 01:10:10.011445 5021 raft_consensus.cc:2229] T 198531e31eee46dfaa632c1e7957b752 P 764b280684c947bf907324ed41937bd4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:10:10.012106 5022 raft_consensus.cc:2229] T 198531e31eee46dfaa632c1e7957b752 P 2c8b845c8cfc42549ded999200fc24d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:10:10.012756 5022 raft_consensus.cc:2258] T 198531e31eee46dfaa632c1e7957b752 P 2c8b845c8cfc42549ded999200fc24d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:10:10.013306 5021 raft_consensus.cc:2258] T 198531e31eee46dfaa632c1e7957b752 P 764b280684c947bf907324ed41937bd4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:10:10.016614 5021 ts_tablet_manager.cc:1905] T 198531e31eee46dfaa632c1e7957b752 P 764b280684c947bf907324ed41937bd4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:10:10.018049 5022 ts_tablet_manager.cc:1905] T 198531e31eee46dfaa632c1e7957b752 P 2c8b845c8cfc42549ded999200fc24d7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:10:10.021366 5023 tablet_replica.cc:330] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408: stopping tablet replica
I20260812 01:10:10.021763 5023 raft_consensus.cc:2229] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408 [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:10:10.022558 5023 raft_consensus.cc:2258] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:10:10.025650 5021 ts_tablet_manager.cc:1918] T 198531e31eee46dfaa632c1e7957b752 P 764b280684c947bf907324ed41937bd4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:10:10.025864 5021 log.cc:1196] T 198531e31eee46dfaa632c1e7957b752 P 764b280684c947bf907324ed41937bd4: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-2/wal/wals/198531e31eee46dfaa632c1e7957b752
Aug 12 01:10:10 dist-test-slave-bndk krb5kdc[4067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497007, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.65@KRBTEST.COM
I20260812 01:10:10.026484 5021 ts_tablet_manager.cc:1939] T 198531e31eee46dfaa632c1e7957b752 P 764b280684c947bf907324ed41937bd4: Deleting consensus metadata
I20260812 01:10:10.028609 4120 catalog_manager.cc:4841] TS 764b280684c947bf907324ed41937bd4 (127.4.201.67:35803): tablet 198531e31eee46dfaa632c1e7957b752 (table test-table [id=43a589a6533e466aae7fa97ecfd8bffa]) successfully deleted
I20260812 01:10:10.030381 5023 ts_tablet_manager.cc:1905] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:10:10.031911 5022 ts_tablet_manager.cc:1918] T 198531e31eee46dfaa632c1e7957b752 P 2c8b845c8cfc42549ded999200fc24d7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:10:10.032171 5022 log.cc:1196] T 198531e31eee46dfaa632c1e7957b752 P 2c8b845c8cfc42549ded999200fc24d7: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-0/wal/wals/198531e31eee46dfaa632c1e7957b752
I20260812 01:10:10.032742 5022 ts_tablet_manager.cc:1939] T 198531e31eee46dfaa632c1e7957b752 P 2c8b845c8cfc42549ded999200fc24d7: Deleting consensus metadata
I20260812 01:10:10.034683 4127 catalog_manager.cc:4841] TS 2c8b845c8cfc42549ded999200fc24d7 (127.4.201.65:37413): tablet 198531e31eee46dfaa632c1e7957b752 (table test-table [id=43a589a6533e466aae7fa97ecfd8bffa]) successfully deleted
I20260812 01:10:10.035849 4973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:09.999311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52786 (local address 127.4.201.65:37413)
0812 01:10:09.999493 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:09.999500 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:10.014017 (+ 14517us) server_negotiation.cc:407] Connection header received
0812 01:10:10.014542 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:10.014547 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:10.014629 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:10.014703 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:10.016553 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:10.017659 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:10.019441 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:10.020054 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:10.020145 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:10.027597 (+ 7452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:10.027613 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:10.027632 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:10.027679 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:10.032055 (+ 4376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:10.032909 (+ 854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:10.032918 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:10.032922 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:10.033089 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:10.033592 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:10.033597 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:10.033601 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:10.034032 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:10.034290 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:10.035264 (+ 974us) server_negotiation.cc:299] Negotiation successful
0812 01:10:10.035487 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 01:10:10.036525 4462 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:10:10.038139 5023 ts_tablet_manager.cc:1918] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:10:10.038491 5023 log.cc:1196] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786496689953932-4901-0/minicluster-data/ts-1/wal/wals/198531e31eee46dfaa632c1e7957b752
I20260812 01:10:10.039295 5023 ts_tablet_manager.cc:1939] T 198531e31eee46dfaa632c1e7957b752 P 0ab3078ae0f5496c971d16ab97a00408: Deleting consensus metadata
I20260812 01:10:10.041090 4126 catalog_manager.cc:4841] TS 0ab3078ae0f5496c971d16ab97a00408 (127.4.201.66:42971): tablet 198531e31eee46dfaa632c1e7957b752 (table test-table [id=43a589a6533e466aae7fa97ecfd8bffa]) successfully deleted
I20260812 01:10:10.183163 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 4257
I20260812 01:10:10.205703 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 4485
Aug 12 01:10:10 dist-test-slave-bndk krb5kdc[4067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497007, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.66@KRBTEST.COM
I20260812 01:10:10.222914 4974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:10.206469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33616 (local address 127.4.201.66:42971)
0812 01:10:10.206650 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:10.206654 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:10.206673 (+ 19us) server_negotiation.cc:407] Connection header received
0812 01:10:10.206897 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:10.206901 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:10.206986 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:10.207071 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:10.208773 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:10.209664 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:10.211472 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:10.211886 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:10.211984 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:10.216938 (+ 4954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:10.216951 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:10.216969 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:10.217018 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:10.220110 (+ 3092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:10.220766 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:10.220774 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:10.220776 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:10.220928 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:10.221386 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:10.221389 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:10.221392 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:10.221766 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:10.222122 (+ 356us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:10.222353 (+ 231us) server_negotiation.cc:299] Negotiation successful
0812 01:10:10.222573 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 01:10:10.223580 4704 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:10:10.336305 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 4485
I20260812 01:10:10.362905 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 4720
Aug 12 01:10:10 dist-test-slave-bndk krb5kdc[4067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497007, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.67@KRBTEST.COM
I20260812 01:10:10.377774 4979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:10.363690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60968 (local address 127.4.201.67:35803)
0812 01:10:10.363869 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:10.363875 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:10.363896 (+ 21us) server_negotiation.cc:407] Connection header received
0812 01:10:10.364101 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:10.364105 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:10.364169 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:10.364253 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:10.365622 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:10.366363 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:10.367654 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:10.368050 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:10.368161 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:10.372456 (+ 4295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:10.372471 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:10.372491 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:10.372532 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:10.375070 (+ 2538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:10.375730 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:10.375738 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:10.375740 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:10.375892 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:10.376251 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:10.376255 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:10.376257 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:10.376608 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:10.376904 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:10.377204 (+ 300us) server_negotiation.cc:299] Negotiation successful
0812 01:10:10.377450 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 01:10:10.378394 4935 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:10:10.464788 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 4720
I20260812 01:10:10.490422 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 4089
I20260812 01:10:10.491696 4198 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:10:10.599721 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 4089
2026-08-12T01:10:10Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4632 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-12T01:10:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:10:10Z Disabled control of system clock
I20260812 01:10:10.691895 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:46497
--webserver_interface=127.4.201.126
--webserver_port=0
--builtin_ntp_servers=127.4.201.84:40987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:46497
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 01:10:11.023598 5041 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:11.023880 5041 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:11.024009 5041 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:11.031055 5041 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:10:11.031160 5041 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:11.031224 5041 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:11.031319 5041 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:10:11.031380 5041 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:10:11.040232 5041 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:40987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:46497
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:46497
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:11.041491 5041 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:11.043282 5041 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:11.054646 5051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:11.054675 5055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:11.054757 5049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:11.055773 5041 server_base.cc:1034] running on GCE node
I20260812 01:10:11.056557 5041 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:11.057964 5041 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:11.059166 5041 hybrid_clock.cc:648] HybridClock initialized: now 1786497011059118 us; error 35 us; skew 500 ppm
I20260812 01:10:11.059492 5041 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:10:11.061697 5041 webserver.cc:460] Webserver started at http://127.4.201.126:46311/ using document root <none> and password file <none>
I20260812 01:10:11.062341 5041 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:11.062443 5041 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:11.062742 5041 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:11.065587 5041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "67b844d75dfb4595a72245a42c989093"
format_stamp: "Formatted at 2026-08-12 01:10:11 on dist-test-slave-bndk"
server_key: "27552f8e6c7536ccd9c3ee8e33d4b084"
server_key_iv: "6092f9eba09c8509caa9f3fff4091fdb"
server_key_version: "encryptionkey@0"
I20260812 01:10:11.066347 5041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "67b844d75dfb4595a72245a42c989093"
format_stamp: "Formatted at 2026-08-12 01:10:11 on dist-test-slave-bndk"
server_key: "27552f8e6c7536ccd9c3ee8e33d4b084"
server_key_iv: "6092f9eba09c8509caa9f3fff4091fdb"
server_key_version: "encryptionkey@0"
I20260812 01:10:11.071223 5041 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260812 01:10:11.074542 5062 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:11.075771 5041 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 01:10:11.075934 5041 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "67b844d75dfb4595a72245a42c989093"
format_stamp: "Formatted at 2026-08-12 01:10:11 on dist-test-slave-bndk"
server_key: "27552f8e6c7536ccd9c3ee8e33d4b084"
server_key_iv: "6092f9eba09c8509caa9f3fff4091fdb"
server_key_version: "encryptionkey@0"
I20260812 01:10:11.076121 5041 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:11.092677 5041 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:11.093441 5041 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:11.093708 5041 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:11.110944 5041 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:46497
I20260812 01:10:11.110961 5159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:46497 every 8 connection(s)
I20260812 01:10:11.112210 5041 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:10:11.115633 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 5041
I20260812 01:10:11.115833 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:10:11.116182 5161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:11.116403 4901 external_mini_cluster.cc:1428] Setting key 0d7f05a4465f1ce6f3e9c4a419fe9aae
I20260812 01:10:11.129992 5167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:11.118294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36648 (local address 127.4.201.126:46497)
0812 01:10:11.119292 (+ 998us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:11.119302 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:11.119344 (+ 42us) server_negotiation.cc:407] Connection header received
0812 01:10:11.120939 (+ 1595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:11.120960 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:11.121463 (+ 503us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:11.121777 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:11.122399 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:11.123729 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:11.125674 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:11.126309 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:11.126448 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:11.127705 (+ 1257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:11.127717 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:11.127731 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:11.128294 (+ 563us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:11.128372 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:11.128394 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:11.128484 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:11.128700 (+ 216us) server_negotiation.cc:299] Negotiation successful
0812 01:10:11.129030 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":601,"thread_start_us":370,"threads_started":1}
I20260812 01:10:11.130164 5161 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67b844d75dfb4595a72245a42c989093: Bootstrap starting.
I20260812 01:10:11.133607 5161 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 67b844d75dfb4595a72245a42c989093: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:11.134559 5161 log.cc:824] T 00000000000000000000000000000000 P 67b844d75dfb4595a72245a42c989093: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:11.137081 5161 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67b844d75dfb4595a72245a42c989093: No bootstrap required, opened a new log
I20260812 01:10:11.144369 5161 raft_consensus.cc:348] T 00000000000000000000000000000000 P 67b844d75dfb4595a72245a42c989093 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67b844d75dfb4595a72245a42c989093" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 46497 } }
I20260812 01:10:11.144716 5161 raft_consensus.cc:374] T 00000000000000000000000000000000 P 67b844d75dfb4595a72245a42c989093 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:11.144804 5161 raft_consensus.cc:729] T 00000000000000000000000000000000 P 67b844d75dfb4595a72245a42c989093 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67b844d75dfb4595a72245a42c989093, State: Initialized, Role: FOLLOWER
I20260812 01:10:11.145382 5161 consensus_queue.cc:260] T 00000000000000000000000000000000 P 67b844d75dfb4595a72245a42c989093 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67b844d75dfb4595a72245a42c989093" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 46497 } }
I20260812 01:10:11.145607 5161 raft_consensus.cc:388] T 00000000000000000000000000000000 P 67b844d75dfb4595a72245a42c989093 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:10:11.145731 5161 raft_consensus.cc:482] T 00000000000000000000000000000000 P 67b844d75dfb4595a72245a42c989093 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:10:11.145888 5161 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 67b844d75dfb4595a72245a42c989093 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:11.147965 5161 raft_consensus.cc:504] T 00000000000000000000000000000000 P 67b844d75dfb4595a72245a42c989093 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67b844d75dfb4595a72245a42c989093" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 46497 } }
I20260812 01:10:11.148448 5161 leader_election.cc:302] T 00000000000000000000000000000000 P 67b844d75dfb4595a72245a42c989093 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 67b844d75dfb4595a72245a42c989093; no voters:
I20260812 01:10:11.148994 5161 leader_election.cc:288] T 00000000000000000000000000000000 P 67b844d75dfb4595a72245a42c989093 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:10:11.149127 5169 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 67b844d75dfb4595a72245a42c989093 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:10:11.149852 5169 raft_consensus.cc:686] T 00000000000000000000000000000000 P 67b844d75dfb4595a72245a42c989093 [term 1 LEADER]: Becoming Leader. State: Replica: 67b844d75dfb4595a72245a42c989093, State: Running, Role: LEADER
I20260812 01:10:11.150358 5169 consensus_queue.cc:237] T 00000000000000000000000000000000 P 67b844d75dfb4595a72245a42c989093 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67b844d75dfb4595a72245a42c989093" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 46497 } }
I20260812 01:10:11.151088 5161 sys_catalog.cc:564] T 00000000000000000000000000000000 P 67b844d75dfb4595a72245a42c989093 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:10:11.153231 5175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67b844d75dfb4595a72245a42c989093 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 67b844d75dfb4595a72245a42c989093. Latest consensus state: current_term: 1 leader_uuid: "67b844d75dfb4595a72245a42c989093" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67b844d75dfb4595a72245a42c989093" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 46497 } } }
I20260812 01:10:11.153659 5175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67b844d75dfb4595a72245a42c989093 [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:11.153549 5170 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67b844d75dfb4595a72245a42c989093 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "67b844d75dfb4595a72245a42c989093" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67b844d75dfb4595a72245a42c989093" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 46497 } } }
I20260812 01:10:11.153808 5170 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67b844d75dfb4595a72245a42c989093 [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:11.155730 5189 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:10:11.160681 5189 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:10:11.169179 5189 catalog_manager.cc:1347] Generated new cluster ID: ddaea1fe327240cb94c58ecbe9c3f527
I20260812 01:10:11.169317 5189 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:10:11.202582 5189 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:10:11.203929 5189 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:10:11.213119 5189 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 67b844d75dfb4595a72245a42c989093: Generated new TSK 0
I20260812 01:10:11.214149 5189 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:10:11.228123 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.65:0
--local_ip_for_outbound_sockets=127.4.201.65
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:46497
--builtin_ntp_servers=127.4.201.84:40987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 01:10:11.570535 5204 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:11.570803 5204 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:11.570935 5204 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:11.578064 5204 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:11.578155 5204 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:11.578291 5204 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.65
I20260812 01:10:11.587373 5204 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:40987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.201.65
--webserver_port=0
--tserver_master_addrs=127.4.201.126:46497
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.65
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:11.588613 5204 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:11.590342 5204 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:11.602831 5209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:11.602753 5210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:11.602804 5212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:11.603572 5204 server_base.cc:1034] running on GCE node
I20260812 01:10:11.604123 5204 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:11.605015 5204 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:11.606222 5204 hybrid_clock.cc:648] HybridClock initialized: now 1786497011606153 us; error 55 us; skew 500 ppm
I20260812 01:10:11.606544 5204 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:10:11.608721 5204 webserver.cc:460] Webserver started at http://127.4.201.65:46205/ using document root <none> and password file <none>
I20260812 01:10:11.609445 5204 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:11.609551 5204 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:11.609864 5204 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:11.613283 5204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-0/data/instance:
uuid: "b77bf6e54b98423f908d7f8be0b2d1d4"
format_stamp: "Formatted at 2026-08-12 01:10:11 on dist-test-slave-bndk"
server_key: "93a93cc1bfd976fdc5515d7bd8f6dbbf"
server_key_iv: "718dff3fceda6ce56616bd9ccc341544"
server_key_version: "encryptionkey@0"
I20260812 01:10:11.614256 5204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance:
uuid: "b77bf6e54b98423f908d7f8be0b2d1d4"
format_stamp: "Formatted at 2026-08-12 01:10:11 on dist-test-slave-bndk"
server_key: "93a93cc1bfd976fdc5515d7bd8f6dbbf"
server_key_iv: "718dff3fceda6ce56616bd9ccc341544"
server_key_version: "encryptionkey@0"
I20260812 01:10:11.619222 5204 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 01:10:11.622550 5224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:11.623719 5204 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.004s sys 0.000s
I20260812 01:10:11.623878 5204 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-0/wal
uuid: "b77bf6e54b98423f908d7f8be0b2d1d4"
format_stamp: "Formatted at 2026-08-12 01:10:11 on dist-test-slave-bndk"
server_key: "93a93cc1bfd976fdc5515d7bd8f6dbbf"
server_key_iv: "718dff3fceda6ce56616bd9ccc341544"
server_key_version: "encryptionkey@0"
I20260812 01:10:11.624085 5204 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:11.640625 5204 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:11.641506 5204 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:11.641798 5204 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:11.642743 5204 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:10:11.644212 5204 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:10:11.644308 5204 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:11.644415 5204 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:10:11.644491 5204 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:11.675125 5204 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.65:43673
I20260812 01:10:11.675179 5411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.65:43673 every 8 connection(s)
I20260812 01:10:11.676471 5204 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-0/data/info.pb
I20260812 01:10:11.680752 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 5204
I20260812 01:10:11.680914 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-0/wal/instance
I20260812 01:10:11.681386 4901 external_mini_cluster.cc:1428] Setting key b98316eb95f35cd7ef7b7751f2dcf195
I20260812 01:10:11.683988 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.66:0
--local_ip_for_outbound_sockets=127.4.201.66
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:46497
--builtin_ntp_servers=127.4.201.84:40987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 01:10:11.689049 5415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:11.679090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.65:57389 (local address 127.4.201.126:46497)
0812 01:10:11.679532 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:11.679536 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:11.680813 (+ 1277us) server_negotiation.cc:407] Connection header received
0812 01:10:11.682804 (+ 1991us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:11.682810 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:11.682901 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:11.683003 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:11.684064 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:11.684821 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:11.686378 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:11.686791 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:11.686915 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:11.688209 (+ 1294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:11.688215 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:11.688218 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:11.688237 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:11.688280 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:11.688292 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:11.688368 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:11.688586 (+ 218us) server_negotiation.cc:299] Negotiation successful
0812 01:10:11.688687 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":215,"threads_started":1}
I20260812 01:10:11.690241 5417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:11.679671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:46497 (local address 127.4.201.65:57389)
0812 01:10:11.680664 (+ 993us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:11.680706 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:11.682548 (+ 1842us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:11.683246 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:11.683254 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:11.683337 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:10:11.683899 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:11.683917 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:11.684974 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:11.684978 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:11.686235 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:11.686249 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:11.687013 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:11.687021 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:11.687242 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:11.687901 (+ 659us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:10:11.687903 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:10:11.687942 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:10:11.688020 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:10:11.688388 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:10:11.688400 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:10:11.688406 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 01:10:11.688560 (+ 154us) client_negotiation.cc:240] Negotiation successful
0812 01:10:11.688968 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":260,"threads_started":1}
I20260812 01:10:11.692202 5412 heartbeater.cc:347] Connected to a master server at 127.4.201.126:46497
I20260812 01:10:11.692745 5412 heartbeater.cc:464] Registering TS with master...
I20260812 01:10:11.694167 5412 heartbeater.cc:511] Master 127.4.201.126:46497 requested a full tablet report, sending...
I20260812 01:10:11.696700 5101 ts_manager.cc:194] Registered new tserver with Master: b77bf6e54b98423f908d7f8be0b2d1d4 (127.4.201.65:43673)
I20260812 01:10:11.698705 5101 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.201.65:57389
W20260812 01:10:12.019896 5418 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:12.020192 5418 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:12.020319 5418 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:12.027419 5418 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:12.027520 5418 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:12.027663 5418 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.66
I20260812 01:10:12.036463 5418 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:40987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.201.66
--webserver_port=0
--tserver_master_addrs=127.4.201.126:46497
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.66
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:12.037722 5418 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:12.039434 5418 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:12.051908 5426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:12.052037 5428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:12.052039 5432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:12.052920 5418 server_base.cc:1034] running on GCE node
I20260812 01:10:12.053522 5418 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:12.054382 5418 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:12.055575 5418 hybrid_clock.cc:648] HybridClock initialized: now 1786497012055527 us; error 39 us; skew 500 ppm
I20260812 01:10:12.055881 5418 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:10:12.058007 5418 webserver.cc:460] Webserver started at http://127.4.201.66:39119/ using document root <none> and password file <none>
I20260812 01:10:12.058645 5418 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:12.058743 5418 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:12.059067 5418 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:12.061787 5418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-1/data/instance:
uuid: "b99020117b1e47bd9b5778af6d2bab28"
format_stamp: "Formatted at 2026-08-12 01:10:12 on dist-test-slave-bndk"
server_key: "e27a68c7dac4c04cf853521018686b56"
server_key_iv: "b484420b5ee369acaf3066f48cac98d1"
server_key_version: "encryptionkey@0"
I20260812 01:10:12.062515 5418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance:
uuid: "b99020117b1e47bd9b5778af6d2bab28"
format_stamp: "Formatted at 2026-08-12 01:10:12 on dist-test-slave-bndk"
server_key: "e27a68c7dac4c04cf853521018686b56"
server_key_iv: "b484420b5ee369acaf3066f48cac98d1"
server_key_version: "encryptionkey@0"
I20260812 01:10:12.067391 5418 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260812 01:10:12.070734 5440 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:12.071960 5418 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 01:10:12.072121 5418 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-1/wal
uuid: "b99020117b1e47bd9b5778af6d2bab28"
format_stamp: "Formatted at 2026-08-12 01:10:12 on dist-test-slave-bndk"
server_key: "e27a68c7dac4c04cf853521018686b56"
server_key_iv: "b484420b5ee369acaf3066f48cac98d1"
server_key_version: "encryptionkey@0"
I20260812 01:10:12.072319 5418 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:12.093410 5418 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:12.094178 5418 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:12.094452 5418 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:12.095391 5418 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:10:12.096796 5418 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:10:12.096894 5418 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:12.097007 5418 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:10:12.097076 5418 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:12.127399 5418 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.66:39149
I20260812 01:10:12.127454 5631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.66:39149 every 8 connection(s)
I20260812 01:10:12.128888 5418 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-1/data/info.pb
I20260812 01:10:12.136186 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 5418
I20260812 01:10:12.136344 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-1/wal/instance
I20260812 01:10:12.136757 4901 external_mini_cluster.cc:1428] Setting key c85042edf0eeea66d279783a3242417c
I20260812 01:10:12.139580 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.201.67:0
--local_ip_for_outbound_sockets=127.4.201.67
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:46497
--builtin_ntp_servers=127.4.201.84:40987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 01:10:12.141327 5415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:12.131472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:59305 (local address 127.4.201.126:46497)
0812 01:10:12.131639 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:12.131644 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:12.133195 (+ 1551us) server_negotiation.cc:407] Connection header received
0812 01:10:12.134928 (+ 1733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:12.134932 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:12.135004 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:12.135092 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:12.136118 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.136872 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.138782 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.139171 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.139281 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:12.140557 (+ 1276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:12.140563 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:12.140566 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:12.140583 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:12.140614 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:12.140627 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:12.140700 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:12.140908 (+ 208us) server_negotiation.cc:299] Negotiation successful
0812 01:10:12.141006 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 01:10:12.142256 5635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:12.132126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:46497 (local address 127.4.201.66:59305)
0812 01:10:12.133065 (+ 939us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:12.133099 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:12.134700 (+ 1601us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:12.135261 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:12.135269 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:12.135353 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:10:12.135952 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:12.135990 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.137040 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.137046 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:12.138644 (+ 1598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:12.138656 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.139380 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.139388 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:12.139599 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:12.140241 (+ 642us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:10:12.140244 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:10:12.140289 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:10:12.140365 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:10:12.140713 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:10:12.140725 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:10:12.140733 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 01:10:12.140883 (+ 150us) client_negotiation.cc:240] Negotiation successful
0812 01:10:12.141287 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":309,"threads_started":1}
I20260812 01:10:12.143469 5632 heartbeater.cc:347] Connected to a master server at 127.4.201.126:46497
I20260812 01:10:12.143760 5632 heartbeater.cc:464] Registering TS with master...
I20260812 01:10:12.144438 5632 heartbeater.cc:511] Master 127.4.201.126:46497 requested a full tablet report, sending...
I20260812 01:10:12.145815 5101 ts_manager.cc:194] Registered new tserver with Master: b99020117b1e47bd9b5778af6d2bab28 (127.4.201.66:39149)
I20260812 01:10:12.146746 5101 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.201.66:59305
W20260812 01:10:12.476075 5636 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:12.476323 5636 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:12.476457 5636 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:12.483536 5636 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:12.483637 5636 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:12.483778 5636 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.201.67
I20260812 01:10:12.492674 5636 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:40987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.201.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.201.67
--webserver_port=0
--tserver_master_addrs=127.4.201.126:46497
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.201.67
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:12.493930 5636 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:12.495738 5636 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:12.508618 5643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:12.508661 5642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:12.508584 5647 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:12.509266 5636 server_base.cc:1034] running on GCE node
I20260812 01:10:12.509845 5636 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:12.510810 5636 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:12.512012 5636 hybrid_clock.cc:648] HybridClock initialized: now 1786497012511966 us; error 36 us; skew 500 ppm
I20260812 01:10:12.512322 5636 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:10:12.514590 5636 webserver.cc:460] Webserver started at http://127.4.201.67:37393/ using document root <none> and password file <none>
I20260812 01:10:12.515249 5636 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:12.515347 5636 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:12.515667 5636 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:12.518635 5636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-2/data/instance:
uuid: "832faca37be74ebc9cc905a961a9a915"
format_stamp: "Formatted at 2026-08-12 01:10:12 on dist-test-slave-bndk"
server_key: "84cae8e75e24cacc49010602a7e43dec"
server_key_iv: "88dfefd874c0f7030a2db3539236ee98"
server_key_version: "encryptionkey@0"
I20260812 01:10:12.519379 5636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance:
uuid: "832faca37be74ebc9cc905a961a9a915"
format_stamp: "Formatted at 2026-08-12 01:10:12 on dist-test-slave-bndk"
server_key: "84cae8e75e24cacc49010602a7e43dec"
server_key_iv: "88dfefd874c0f7030a2db3539236ee98"
server_key_version: "encryptionkey@0"
I20260812 01:10:12.524194 5636 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260812 01:10:12.527539 5655 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:12.528915 5636 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 01:10:12.529057 5636 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-2/wal
uuid: "832faca37be74ebc9cc905a961a9a915"
format_stamp: "Formatted at 2026-08-12 01:10:12 on dist-test-slave-bndk"
server_key: "84cae8e75e24cacc49010602a7e43dec"
server_key_iv: "88dfefd874c0f7030a2db3539236ee98"
server_key_version: "encryptionkey@0"
I20260812 01:10:12.529250 5636 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:12.563834 5636 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:12.564647 5636 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:12.564905 5636 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:12.566004 5636 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 01:10:12.567466 5636 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:10:12.567553 5636 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:12.567634 5636 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 01:10:12.567687 5636 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:12.597415 5636 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.67:43829
I20260812 01:10:12.597553 5843 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.67:43829 every 8 connection(s)
I20260812 01:10:12.598711 5636 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-2/data/info.pb
I20260812 01:10:12.599301 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 5636
I20260812 01:10:12.599465 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-2/wal/instance
I20260812 01:10:12.600039 4901 external_mini_cluster.cc:1428] Setting key aee0c2cd740ee0e6632b2c288dce17c6
I20260812 01:10:12.610569 5415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:12.601505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.67:44301 (local address 127.4.201.126:46497)
0812 01:10:12.601704 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:12.601710 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:12.603356 (+ 1646us) server_negotiation.cc:407] Connection header received
0812 01:10:12.605037 (+ 1681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:12.605040 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:12.605106 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:12.605187 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:12.606158 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.606877 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.608300 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.608702 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.608790 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:12.609976 (+ 1186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:12.609981 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:12.609984 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:12.610001 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:12.610030 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:12.610042 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:12.610108 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:12.610262 (+ 154us) server_negotiation.cc:299] Negotiation successful
0812 01:10:12.610334 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 01:10:12.611439 5848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:12.602192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:46497 (local address 127.4.201.67:44301)
0812 01:10:12.603201 (+ 1009us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:12.603252 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:12.604824 (+ 1572us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:12.605394 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:12.605402 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:12.605493 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:10:12.606030 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:12.606046 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.606989 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.606993 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:12.608194 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:12.608206 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.608864 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.608868 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:12.609053 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:12.609692 (+ 639us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 01:10:12.609695 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:10:12.609737 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 01:10:12.609834 (+ 97us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:10:12.610112 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:10:12.610118 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:10:12.610123 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 01:10:12.610250 (+ 127us) client_negotiation.cc:240] Negotiation successful
0812 01:10:12.610519 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":322,"threads_started":1}
I20260812 01:10:12.612560 5845 heartbeater.cc:347] Connected to a master server at 127.4.201.126:46497
I20260812 01:10:12.612823 5845 heartbeater.cc:464] Registering TS with master...
I20260812 01:10:12.613665 5845 heartbeater.cc:511] Master 127.4.201.126:46497 requested a full tablet report, sending...
I20260812 01:10:12.615320 5099 ts_manager.cc:194] Registered new tserver with Master: 832faca37be74ebc9cc905a961a9a915 (127.4.201.67:43829)
I20260812 01:10:12.616389 5099 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.201.67:44301
I20260812 01:10:12.628089 4901 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 01:10:12.637486 5415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:12.632134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36664 (local address 127.4.201.126:46497)
0812 01:10:12.632306 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:12.632311 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:12.632765 (+ 454us) server_negotiation.cc:407] Connection header received
0812 01:10:12.632914 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:12.632917 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:12.632992 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:12.633068 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:12.633609 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.634282 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.635512 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.635918 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.636006 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:12.636886 (+ 880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:12.636890 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:12.636893 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:12.636910 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:12.636936 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:12.636947 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:12.637011 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:12.637095 (+ 84us) server_negotiation.cc:299] Negotiation successful
0812 01:10:12.637164 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 01:10:12.641000 5099 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36664:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:10:12.648252 5099 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:10:12.670934 5868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:12.660164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38916 (local address 127.4.201.67:43829)
0812 01:10:12.662801 (+ 2637us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:12.662811 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:12.662849 (+ 38us) server_negotiation.cc:407] Connection header received
0812 01:10:12.662947 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:12.662955 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:12.663208 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:12.663399 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:10:12.664608 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.666238 (+ 1630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.668776 (+ 2538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.669741 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.669865 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:12.670154 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:12.670379 (+ 225us) server_negotiation.cc:299] Negotiation successful
0812 01:10:12.670558 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2478,"thread_start_us":2330,"threads_started":1}
I20260812 01:10:12.670991 5865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:12.659859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:43829 (local address 127.0.0.1:38916)
0812 01:10:12.660633 (+ 774us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:12.660685 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:12.660873 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:12.663707 (+ 2834us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:12.663711 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:12.663729 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:10:12.664365 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:12.664380 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.666374 (+ 1994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.666380 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:12.668581 (+ 2201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:12.668593 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.669920 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.669926 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:12.670136 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:12.670202 (+ 66us) client_negotiation.cc:769] Sending connection context
0812 01:10:12.670330 (+ 128us) client_negotiation.cc:240] Negotiation successful
0812 01:10:12.670605 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"mutex_wait_us":182,"thread_start_us":333,"threads_started":1}
I20260812 01:10:12.671705 5869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:12.660471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.66:39149 (local address 127.0.0.1:51718)
0812 01:10:12.662089 (+ 1618us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:12.662108 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:12.662231 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:12.663661 (+ 1430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:12.663669 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:12.663699 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:10:12.664276 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:12.664291 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.666412 (+ 2121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.666417 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:12.668747 (+ 2330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:12.668763 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.670872 (+ 2109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.670879 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:12.671065 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:12.671095 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 01:10:12.671174 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 01:10:12.671286 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1483,"mutex_wait_us":123,"spinlock_wait_cycles":10624,"thread_start_us":1311,"threads_started":1}
I20260812 01:10:12.672364 5866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:12.660202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51718 (local address 127.4.201.66:39149)
0812 01:10:12.663070 (+ 2868us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:12.663079 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:12.663104 (+ 25us) server_negotiation.cc:407] Connection header received
0812 01:10:12.663196 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:12.663202 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:12.663422 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:12.664491 (+ 1069us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:10:12.664710 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.666260 (+ 1550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.668962 (+ 2702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.670365 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.670505 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:12.670734 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:12.671909 (+ 1175us) server_negotiation.cc:299] Negotiation successful
0812 01:10:12.672074 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2710,"thread_start_us":2620,"threads_started":1}
I20260812 01:10:12.674952 5740 tablet_service.cc:1467] Processing CreateTablet for tablet da0b785d0e2e40d382f69c76385605fc (DEFAULT_TABLE table=test-table [id=4634278d0d4c47538cb3f08dd9623958]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:10:12.675570 5522 tablet_service.cc:1467] Processing CreateTablet for tablet da0b785d0e2e40d382f69c76385605fc (DEFAULT_TABLE table=test-table [id=4634278d0d4c47538cb3f08dd9623958]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:10:12.676566 5740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da0b785d0e2e40d382f69c76385605fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:12.676792 5522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da0b785d0e2e40d382f69c76385605fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:12.687824 5871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:12.661803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:43673 (local address 127.0.0.1:35412)
0812 01:10:12.663366 (+ 1563us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:12.663384 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:12.663505 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:12.667660 (+ 4155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:12.667665 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:12.667692 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:10:12.668128 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:12.668142 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.669994 (+ 1852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.670000 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:12.673376 (+ 3376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:12.673393 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.686969 (+ 13576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.686977 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:12.687166 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:12.687203 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 01:10:12.687306 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 01:10:12.687467 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1444,"mutex_wait_us":2,"thread_start_us":1322,"threads_started":1}
I20260812 01:10:12.687940 5872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:12.662323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35412 (local address 127.4.201.65:43673)
0812 01:10:12.666833 (+ 4510us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:12.666842 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:12.666871 (+ 29us) server_negotiation.cc:407] Connection header received
0812 01:10:12.666965 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:12.666972 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:12.667207 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:12.667403 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:10:12.668327 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.669811 (+ 1484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.685337 (+ 15526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.686729 (+ 1392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.686874 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:12.687159 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:12.687406 (+ 247us) server_negotiation.cc:299] Negotiation successful
0812 01:10:12.687577 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4345,"thread_start_us":4220,"threads_started":1}
I20260812 01:10:12.689131 5873 tablet_bootstrap.cc:492] T da0b785d0e2e40d382f69c76385605fc P 832faca37be74ebc9cc905a961a9a915: Bootstrap starting.
I20260812 01:10:12.692071 5314 tablet_service.cc:1467] Processing CreateTablet for tablet da0b785d0e2e40d382f69c76385605fc (DEFAULT_TABLE table=test-table [id=4634278d0d4c47538cb3f08dd9623958]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:10:12.692843 5873 tablet_bootstrap.cc:654] T da0b785d0e2e40d382f69c76385605fc P 832faca37be74ebc9cc905a961a9a915: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:12.693634 5314 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da0b785d0e2e40d382f69c76385605fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:12.693933 5876 tablet_bootstrap.cc:492] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28: Bootstrap starting.
I20260812 01:10:12.694183 5873 log.cc:824] T da0b785d0e2e40d382f69c76385605fc P 832faca37be74ebc9cc905a961a9a915: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:12.696862 5876 tablet_bootstrap.cc:654] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:12.697430 5873 tablet_bootstrap.cc:492] T da0b785d0e2e40d382f69c76385605fc P 832faca37be74ebc9cc905a961a9a915: No bootstrap required, opened a new log
I20260812 01:10:12.697700 5873 ts_tablet_manager.cc:1397] T da0b785d0e2e40d382f69c76385605fc P 832faca37be74ebc9cc905a961a9a915: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.006s
I20260812 01:10:12.697860 5876 log.cc:824] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:12.700502 5876 tablet_bootstrap.cc:492] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28: No bootstrap required, opened a new log
I20260812 01:10:12.700743 5876 ts_tablet_manager.cc:1397] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260812 01:10:12.701860 5412 heartbeater.cc:503] Master 127.4.201.126:46497 was elected leader, sending a full tablet report...
I20260812 01:10:12.707885 5873 raft_consensus.cc:348] T da0b785d0e2e40d382f69c76385605fc P 832faca37be74ebc9cc905a961a9a915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832faca37be74ebc9cc905a961a9a915" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 43829 } } peers { permanent_uuid: "b99020117b1e47bd9b5778af6d2bab28" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 39149 } } peers { permanent_uuid: "b77bf6e54b98423f908d7f8be0b2d1d4" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 43673 } }
I20260812 01:10:12.708423 5873 raft_consensus.cc:374] T da0b785d0e2e40d382f69c76385605fc P 832faca37be74ebc9cc905a961a9a915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:12.708539 5873 raft_consensus.cc:729] T da0b785d0e2e40d382f69c76385605fc P 832faca37be74ebc9cc905a961a9a915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 832faca37be74ebc9cc905a961a9a915, State: Initialized, Role: FOLLOWER
I20260812 01:10:12.709369 5888 tablet_bootstrap.cc:492] T da0b785d0e2e40d382f69c76385605fc P b77bf6e54b98423f908d7f8be0b2d1d4: Bootstrap starting.
I20260812 01:10:12.709137 5876 raft_consensus.cc:348] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832faca37be74ebc9cc905a961a9a915" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 43829 } } peers { permanent_uuid: "b99020117b1e47bd9b5778af6d2bab28" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 39149 } } peers { permanent_uuid: "b77bf6e54b98423f908d7f8be0b2d1d4" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 43673 } }
I20260812 01:10:12.709369 5873 consensus_queue.cc:260] T da0b785d0e2e40d382f69c76385605fc P 832faca37be74ebc9cc905a961a9a915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832faca37be74ebc9cc905a961a9a915" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 43829 } } peers { permanent_uuid: "b99020117b1e47bd9b5778af6d2bab28" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 39149 } } peers { permanent_uuid: "b77bf6e54b98423f908d7f8be0b2d1d4" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 43673 } }
I20260812 01:10:12.709616 5876 raft_consensus.cc:374] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:12.709733 5876 raft_consensus.cc:729] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b99020117b1e47bd9b5778af6d2bab28, State: Initialized, Role: FOLLOWER
I20260812 01:10:12.710340 5876 consensus_queue.cc:260] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832faca37be74ebc9cc905a961a9a915" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 43829 } } peers { permanent_uuid: "b99020117b1e47bd9b5778af6d2bab28" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 39149 } } peers { permanent_uuid: "b77bf6e54b98423f908d7f8be0b2d1d4" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 43673 } }
I20260812 01:10:12.710855 5845 heartbeater.cc:503] Master 127.4.201.126:46497 was elected leader, sending a full tablet report...
I20260812 01:10:12.711549 5632 heartbeater.cc:503] Master 127.4.201.126:46497 was elected leader, sending a full tablet report...
I20260812 01:10:12.712219 5876 ts_tablet_manager.cc:1428] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
I20260812 01:10:12.713044 5888 tablet_bootstrap.cc:654] T da0b785d0e2e40d382f69c76385605fc P b77bf6e54b98423f908d7f8be0b2d1d4: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:12.713581 5873 ts_tablet_manager.cc:1428] T da0b785d0e2e40d382f69c76385605fc P 832faca37be74ebc9cc905a961a9a915: Time spent starting tablet: real 0.016s user 0.012s sys 0.001s
I20260812 01:10:12.714325 5888 log.cc:824] T da0b785d0e2e40d382f69c76385605fc P b77bf6e54b98423f908d7f8be0b2d1d4: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:12.717713 5888 tablet_bootstrap.cc:492] T da0b785d0e2e40d382f69c76385605fc P b77bf6e54b98423f908d7f8be0b2d1d4: No bootstrap required, opened a new log
I20260812 01:10:12.717940 5888 ts_tablet_manager.cc:1397] T da0b785d0e2e40d382f69c76385605fc P b77bf6e54b98423f908d7f8be0b2d1d4: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.001s
I20260812 01:10:12.724910 5888 raft_consensus.cc:348] T da0b785d0e2e40d382f69c76385605fc P b77bf6e54b98423f908d7f8be0b2d1d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832faca37be74ebc9cc905a961a9a915" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 43829 } } peers { permanent_uuid: "b99020117b1e47bd9b5778af6d2bab28" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 39149 } } peers { permanent_uuid: "b77bf6e54b98423f908d7f8be0b2d1d4" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 43673 } }
I20260812 01:10:12.725272 5888 raft_consensus.cc:374] T da0b785d0e2e40d382f69c76385605fc P b77bf6e54b98423f908d7f8be0b2d1d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:12.725363 5888 raft_consensus.cc:729] T da0b785d0e2e40d382f69c76385605fc P b77bf6e54b98423f908d7f8be0b2d1d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77bf6e54b98423f908d7f8be0b2d1d4, State: Initialized, Role: FOLLOWER
I20260812 01:10:12.725842 5888 consensus_queue.cc:260] T da0b785d0e2e40d382f69c76385605fc P b77bf6e54b98423f908d7f8be0b2d1d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832faca37be74ebc9cc905a961a9a915" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 43829 } } peers { permanent_uuid: "b99020117b1e47bd9b5778af6d2bab28" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 39149 } } peers { permanent_uuid: "b77bf6e54b98423f908d7f8be0b2d1d4" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 43673 } }
I20260812 01:10:12.727197 5888 ts_tablet_manager.cc:1428] T da0b785d0e2e40d382f69c76385605fc P b77bf6e54b98423f908d7f8be0b2d1d4: Time spent starting tablet: real 0.009s user 0.004s sys 0.005s
I20260812 01:10:12.747453 5891 raft_consensus.cc:482] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:10:12.747757 5891 raft_consensus.cc:504] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832faca37be74ebc9cc905a961a9a915" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 43829 } } peers { permanent_uuid: "b99020117b1e47bd9b5778af6d2bab28" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 39149 } } peers { permanent_uuid: "b77bf6e54b98423f908d7f8be0b2d1d4" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 43673 } }
I20260812 01:10:12.749385 5891 leader_election.cc:288] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 832faca37be74ebc9cc905a961a9a915 (127.4.201.67:43829), b77bf6e54b98423f908d7f8be0b2d1d4 (127.4.201.65:43673)
I20260812 01:10:12.756445 5868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:12.749745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:54287 (local address 127.4.201.67:43829)
0812 01:10:12.749925 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:12.749930 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:12.750535 (+ 605us) server_negotiation.cc:407] Connection header received
0812 01:10:12.750901 (+ 366us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:12.750907 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:12.751002 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:12.751103 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:10:12.751723 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.752677 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.754595 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.755478 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.755609 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:12.755672 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:12.756087 (+ 415us) server_negotiation.cc:299] Negotiation successful
0812 01:10:12.756206 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 01:10:12.756448 5872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:12.750622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.201.66:44135 (local address 127.4.201.65:43673)
0812 01:10:12.750793 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:12.750799 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:12.751277 (+ 478us) server_negotiation.cc:407] Connection header received
0812 01:10:12.751500 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:12.751506 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:12.751593 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:12.751685 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 01:10:12.752223 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.752982 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.754768 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.755569 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.755749 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:12.755817 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:12.756102 (+ 285us) server_negotiation.cc:299] Negotiation successful
0812 01:10:12.756223 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 01:10:12.756572 5895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:12.749687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.67:43829 (local address 127.4.201.66:54287)
0812 01:10:12.750434 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:12.750453 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:12.750593 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:12.751136 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:12.751139 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:12.751163 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:10:12.751575 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:12.751590 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.752802 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.752808 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:12.754412 (+ 1604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:12.754425 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.755658 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.755711 (+ 53us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:12.755928 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:12.755953 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 01:10:12.756035 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 01:10:12.756161 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"mutex_wait_us":2,"spinlock_wait_cycles":896,"thread_start_us":387,"threads_started":1}
I20260812 01:10:12.756618 5897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:12.750521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:43673 (local address 127.4.201.66:44135)
0812 01:10:12.751134 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:12.751151 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:12.751359 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:12.751715 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:12.751720 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:12.751744 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 01:10:12.752092 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:12.752104 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.753112 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.753116 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:12.754597 (+ 1481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:12.754612 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.755757 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.755763 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:12.755943 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:12.755968 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 01:10:12.756055 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 01:10:12.756227 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"mutex_wait_us":31,"spinlock_wait_cycles":768,"thread_start_us":295,"threads_started":1}
I20260812 01:10:12.757555 5346 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da0b785d0e2e40d382f69c76385605fc" candidate_uuid: "b99020117b1e47bd9b5778af6d2bab28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77bf6e54b98423f908d7f8be0b2d1d4" is_pre_election: true
I20260812 01:10:12.757650 5778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da0b785d0e2e40d382f69c76385605fc" candidate_uuid: "b99020117b1e47bd9b5778af6d2bab28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "832faca37be74ebc9cc905a961a9a915" is_pre_election: true
I20260812 01:10:12.758049 5346 raft_consensus.cc:2454] T da0b785d0e2e40d382f69c76385605fc P b77bf6e54b98423f908d7f8be0b2d1d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b99020117b1e47bd9b5778af6d2bab28 in term 0.
I20260812 01:10:12.758121 5778 raft_consensus.cc:2454] T da0b785d0e2e40d382f69c76385605fc P 832faca37be74ebc9cc905a961a9a915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b99020117b1e47bd9b5778af6d2bab28 in term 0.
I20260812 01:10:12.758642 5443 leader_election.cc:302] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b77bf6e54b98423f908d7f8be0b2d1d4, b99020117b1e47bd9b5778af6d2bab28; no voters:
I20260812 01:10:12.758989 5891 raft_consensus.cc:2781] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:10:12.759131 5891 raft_consensus.cc:482] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:10:12.759223 5891 raft_consensus.cc:3037] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:12.761497 5891 raft_consensus.cc:504] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832faca37be74ebc9cc905a961a9a915" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 43829 } } peers { permanent_uuid: "b99020117b1e47bd9b5778af6d2bab28" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 39149 } } peers { permanent_uuid: "b77bf6e54b98423f908d7f8be0b2d1d4" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 43673 } }
I20260812 01:10:12.762053 5891 leader_election.cc:288] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28 [CANDIDATE]: Term 1 election: Requested vote from peers 832faca37be74ebc9cc905a961a9a915 (127.4.201.67:43829), b77bf6e54b98423f908d7f8be0b2d1d4 (127.4.201.65:43673)
I20260812 01:10:12.762450 5778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da0b785d0e2e40d382f69c76385605fc" candidate_uuid: "b99020117b1e47bd9b5778af6d2bab28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "832faca37be74ebc9cc905a961a9a915"
I20260812 01:10:12.762507 5346 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da0b785d0e2e40d382f69c76385605fc" candidate_uuid: "b99020117b1e47bd9b5778af6d2bab28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77bf6e54b98423f908d7f8be0b2d1d4"
I20260812 01:10:12.762619 5778 raft_consensus.cc:3037] T da0b785d0e2e40d382f69c76385605fc P 832faca37be74ebc9cc905a961a9a915 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:12.762688 5346 raft_consensus.cc:3037] T da0b785d0e2e40d382f69c76385605fc P b77bf6e54b98423f908d7f8be0b2d1d4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:12.764758 5778 raft_consensus.cc:2454] T da0b785d0e2e40d382f69c76385605fc P 832faca37be74ebc9cc905a961a9a915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b99020117b1e47bd9b5778af6d2bab28 in term 1.
I20260812 01:10:12.764804 5346 raft_consensus.cc:2454] T da0b785d0e2e40d382f69c76385605fc P b77bf6e54b98423f908d7f8be0b2d1d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b99020117b1e47bd9b5778af6d2bab28 in term 1.
I20260812 01:10:12.765113 5443 leader_election.cc:302] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 832faca37be74ebc9cc905a961a9a915, b99020117b1e47bd9b5778af6d2bab28; no voters:
I20260812 01:10:12.765386 5891 raft_consensus.cc:2781] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:10:12.765808 5891 raft_consensus.cc:686] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28 [term 1 LEADER]: Becoming Leader. State: Replica: b99020117b1e47bd9b5778af6d2bab28, State: Running, Role: LEADER
I20260812 01:10:12.766301 5891 consensus_queue.cc:237] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832faca37be74ebc9cc905a961a9a915" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 43829 } } peers { permanent_uuid: "b99020117b1e47bd9b5778af6d2bab28" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 39149 } } peers { permanent_uuid: "b77bf6e54b98423f908d7f8be0b2d1d4" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 43673 } }
I20260812 01:10:12.770735 5101 catalog_manager.cc:5495] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28 reported cstate change: term changed from 0 to 1, leader changed from <none> to b99020117b1e47bd9b5778af6d2bab28 (127.4.201.66). New cstate: current_term: 1 leader_uuid: "b99020117b1e47bd9b5778af6d2bab28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832faca37be74ebc9cc905a961a9a915" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 43829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b99020117b1e47bd9b5778af6d2bab28" member_type: VOTER last_known_addr { host: "127.4.201.66" port: 39149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b77bf6e54b98423f908d7f8be0b2d1d4" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 43673 } health_report { overall_health: UNKNOWN } } }
I20260812 01:10:12.801838 5866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:12.796718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51732 (local address 127.4.201.66:39149)
0812 01:10:12.796923 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:12.796930 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:12.796947 (+ 17us) server_negotiation.cc:407] Connection header received
0812 01:10:12.797037 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:12.797040 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:12.797134 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:12.797285 (+ 151us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:10:12.797659 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.798357 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.799738 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.800159 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.800264 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:12.800737 (+ 473us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:10:12.801267 (+ 530us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:10:12.801398 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:12.801510 (+ 112us) server_negotiation.cc:299] Negotiation successful
0812 01:10:12.801584 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 01:10:12.809446 5346 raft_consensus.cc:1261] T da0b785d0e2e40d382f69c76385605fc P b77bf6e54b98423f908d7f8be0b2d1d4 [term 1 FOLLOWER]: Refusing update from remote peer b99020117b1e47bd9b5778af6d2bab28: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:10:12.809497 5778 raft_consensus.cc:1261] T da0b785d0e2e40d382f69c76385605fc P 832faca37be74ebc9cc905a961a9a915 [term 1 FOLLOWER]: Refusing update from remote peer b99020117b1e47bd9b5778af6d2bab28: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:10:12.810314 5898 consensus_queue.cc:1035] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77bf6e54b98423f908d7f8be0b2d1d4" member_type: VOTER last_known_addr { host: "127.4.201.65" port: 43673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:10:12.810650 5891 consensus_queue.cc:1035] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "832faca37be74ebc9cc905a961a9a915" member_type: VOTER last_known_addr { host: "127.4.201.67" port: 43829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:10:12.821033 5903 mvcc.cc:205] Tried to move back new op lower bound from 7317491764458102784 to 7317491764295036928. Current Snapshot: MvccSnapshot[applied={T|T < 7317491764458102784}]
I20260812 01:10:12.836896 5099 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36664:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:10:12.837157 5099 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36664:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 01:10:12.840577 5099 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 67b844d75dfb4595a72245a42c989093: Sending DeleteTablet for 3 replicas of tablet da0b785d0e2e40d382f69c76385605fc
I20260812 01:10:12.841681 5740 tablet_service.cc:1514] Processing DeleteTablet for tablet da0b785d0e2e40d382f69c76385605fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:10:12 UTC) from {username='slave'} at 127.0.0.1:38916
I20260812 01:10:12.841688 5522 tablet_service.cc:1514] Processing DeleteTablet for tablet da0b785d0e2e40d382f69c76385605fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:10:12 UTC) from {username='slave'} at 127.0.0.1:51718
I20260812 01:10:12.842113 5314 tablet_service.cc:1514] Processing DeleteTablet for tablet da0b785d0e2e40d382f69c76385605fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 01:10:12 UTC) from {username='slave'} at 127.0.0.1:35412
I20260812 01:10:12.843797 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 5204
I20260812 01:10:12.852806 5924 tablet_replica.cc:330] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28: stopping tablet replica
I20260812 01:10:12.853363 5924 raft_consensus.cc:2229] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28 [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:10:12.854285 5924 raft_consensus.cc:2258] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:10:12.856880 5924 ts_tablet_manager.cc:1905] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:10:12.859334 5923 tablet_replica.cc:330] T da0b785d0e2e40d382f69c76385605fc P 832faca37be74ebc9cc905a961a9a915: stopping tablet replica
I20260812 01:10:12.859817 5923 raft_consensus.cc:2229] T da0b785d0e2e40d382f69c76385605fc P 832faca37be74ebc9cc905a961a9a915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:10:12.860438 5923 raft_consensus.cc:2258] T da0b785d0e2e40d382f69c76385605fc P 832faca37be74ebc9cc905a961a9a915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:10:12.866083 5926 tablet_replica.cc:330] T da0b785d0e2e40d382f69c76385605fc P b77bf6e54b98423f908d7f8be0b2d1d4: stopping tablet replica
I20260812 01:10:12.866564 5926 raft_consensus.cc:2229] T da0b785d0e2e40d382f69c76385605fc P b77bf6e54b98423f908d7f8be0b2d1d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:10:12.867101 5926 raft_consensus.cc:2258] T da0b785d0e2e40d382f69c76385605fc P b77bf6e54b98423f908d7f8be0b2d1d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:10:12.868161 5923 ts_tablet_manager.cc:1905] T da0b785d0e2e40d382f69c76385605fc P 832faca37be74ebc9cc905a961a9a915: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:10:12.869652 5926 ts_tablet_manager.cc:1905] T da0b785d0e2e40d382f69c76385605fc P b77bf6e54b98423f908d7f8be0b2d1d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:10:12.869830 5872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:12.845265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35418 (local address 127.4.201.65:43673)
0812 01:10:12.845451 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:12.845457 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:12.859567 (+ 14110us) server_negotiation.cc:407] Connection header received
0812 01:10:12.859876 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:12.859882 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:12.860022 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:12.860265 (+ 243us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:12.860968 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.862199 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.863968 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.864643 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.864743 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:12.867904 (+ 3161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:12.867917 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:12.867936 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:12.868740 (+ 804us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:12.868812 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:12.868840 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:12.868961 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:12.869322 (+ 361us) server_negotiation.cc:299] Negotiation successful
0812 01:10:12.869455 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 01:10:12.871205 5402 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:10:12.875331 5923 ts_tablet_manager.cc:1918] T da0b785d0e2e40d382f69c76385605fc P 832faca37be74ebc9cc905a961a9a915: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:10:12.875350 5924 ts_tablet_manager.cc:1918] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 01:10:12.875563 5924 log.cc:1196] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-1/wal/wals/da0b785d0e2e40d382f69c76385605fc
I20260812 01:10:12.875594 5923 log.cc:1196] T da0b785d0e2e40d382f69c76385605fc P 832faca37be74ebc9cc905a961a9a915: Deleting WAL directory at /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786496689953932-4901-0/minicluster-data/ts-2/wal/wals/da0b785d0e2e40d382f69c76385605fc
I20260812 01:10:12.876155 5923 ts_tablet_manager.cc:1939] T da0b785d0e2e40d382f69c76385605fc P 832faca37be74ebc9cc905a961a9a915: Deleting consensus metadata
I20260812 01:10:12.876161 5924 ts_tablet_manager.cc:1939] T da0b785d0e2e40d382f69c76385605fc P b99020117b1e47bd9b5778af6d2bab28: Deleting consensus metadata
I20260812 01:10:12.878116 5066 catalog_manager.cc:4841] TS 832faca37be74ebc9cc905a961a9a915 (127.4.201.67:43829): tablet da0b785d0e2e40d382f69c76385605fc (table test-table [id=4634278d0d4c47538cb3f08dd9623958]) successfully deleted
I20260812 01:10:12.878667 5067 catalog_manager.cc:4841] TS b99020117b1e47bd9b5778af6d2bab28 (127.4.201.66:39149): tablet da0b785d0e2e40d382f69c76385605fc (table test-table [id=4634278d0d4c47538cb3f08dd9623958]) successfully deleted
I20260812 01:10:12.961333 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 5204
I20260812 01:10:12.987002 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 5418
W20260812 01:10:12.986951 5066 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.201.65:43673 (error 108)
I20260812 01:10:12.989362 5871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:12.988910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:43673 (local address 127.0.0.1:35432)
0812 01:10:12.989074 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:12.989175 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:43673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260812 01:10:12.989637 5066 catalog_manager.cc:4584] TS b77bf6e54b98423f908d7f8be0b2d1d4 (127.4.201.65:43673): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet da0b785d0e2e40d382f69c76385605fc: Network error: Client connection negotiation failed: client connection to 127.4.201.65:43673: connect: Connection refused (error 111)
I20260812 01:10:12.995446 5866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:12.987848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51748 (local address 127.4.201.66:39149)
0812 01:10:12.988487 (+ 639us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:12.988494 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:12.988512 (+ 18us) server_negotiation.cc:407] Connection header received
0812 01:10:12.988583 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:12.988589 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:12.988690 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:12.988787 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:12.989598 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.990507 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.992388 (+ 1881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:12.992829 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:12.992924 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:12.994059 (+ 1135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:12.994068 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:12.994084 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:12.994721 (+ 637us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:12.994770 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:12.994791 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:12.994871 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:12.995021 (+ 150us) server_negotiation.cc:299] Negotiation successful
0812 01:10:12.995104 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":500}
I20260812 01:10:12.996117 5624 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:10:13.043262 5871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:13.042687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:43673 (local address 127.0.0.1:35434)
0812 01:10:13.042937 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:13.043067 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:43673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260812 01:10:13.044310 5871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:13.043920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:43673 (local address 127.0.0.1:35438)
0812 01:10:13.044062 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:13.044150 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:43673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260812 01:10:13.104976 5871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:13.104384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:43673 (local address 127.0.0.1:35446)
0812 01:10:13.104645 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:13.104756 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:43673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260812 01:10:13.106179 5871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:13.105711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:43673 (local address 127.0.0.1:35456)
0812 01:10:13.105946 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:13.106036 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:43673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136}
I20260812 01:10:13.106678 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 5418
I20260812 01:10:13.140540 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 5636
I20260812 01:10:13.147198 5868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:13.141290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38918 (local address 127.4.201.67:43829)
0812 01:10:13.141486 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:13.141493 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:13.141605 (+ 112us) server_negotiation.cc:407] Connection header received
0812 01:10:13.141790 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:13.141794 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:13.141887 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:13.141993 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:13.142418 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:13.143152 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:13.144379 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:13.144768 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:13.144888 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:13.145943 (+ 1055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:13.145953 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:13.145972 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:13.146519 (+ 547us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:13.146566 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:13.146586 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:13.146692 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:13.146814 (+ 122us) server_negotiation.cc:299] Negotiation successful
0812 01:10:13.146929 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 01:10:13.147794 5839 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:10:13.186734 5871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:13.186177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:43673 (local address 127.0.0.1:35460)
0812 01:10:13.186424 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:13.186543 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:43673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260812 01:10:13.187836 5871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:13.187389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:43673 (local address 127.0.0.1:35462)
0812 01:10:13.187612 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:13.187700 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:43673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260812 01:10:13.234387 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 5636
I20260812 01:10:13.258124 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 5041
I20260812 01:10:13.259193 5153 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:10:13.367789 5871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:13.367102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.65:43673 (local address 127.0.0.1:35464)
0812 01:10:13.367312 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:13.367403 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.65:43673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260812 01:10:13.368440 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 5041
2026-08-12T01:10:13Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (2770 ms)
[----------] 6 tests from EncryptionPolicyTest (22548 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:10:13 dist-test-slave-bndk krb5kdc[5946](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:10:13 dist-test-slave-bndk krb5kdc[5946](info): set up 2 sockets
Aug 12 01:10:13 dist-test-slave-bndk krb5kdc[5946](info): commencing operation
krb5kdc: starting...
W20260812 01:10:14.628285 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.209s user 0.004s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:10:14 dist-test-slave-bndk krb5kdc[5946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497014, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:10:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:10:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 01:10:14.916364 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46677
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46677
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:10:15.247442 5964 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:15.247725 5964 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:15.247861 5964 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:15.254877 5964 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:10:15.254992 5964 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:15.255067 5964 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:15.255146 5964 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:10:15.255204 5964 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:10:15.265233 5964 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46677
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46677
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:15.266459 5964 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:15.267730 5964 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:15.279131 5976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:15.279633 5974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:15.280149 5973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:15.280189 5964 server_base.cc:1034] running on GCE node
I20260812 01:10:15.280970 5964 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:15.282393 5964 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:15.283610 5964 hybrid_clock.cc:648] HybridClock initialized: now 1786497015283559 us; error 43 us; skew 500 ppm
I20260812 01:10:15.283948 5964 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:10:15 dist-test-slave-bndk krb5kdc[5946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497015, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:10:15.286983 5964 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 01:10:15.288338 5964 webserver.cc:460] Webserver started at http://127.0.0.1:44575/ using document root <none> and password file <none>
I20260812 01:10:15.288987 5964 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:15.289093 5964 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:15.289399 5964 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:15.292640 5964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "0c10a684da9d4f29a82b60956dd9951b"
format_stamp: "Formatted at 2026-08-12 01:10:15 on dist-test-slave-bndk"
server_key: "670f87087fa4b3b127d238e1825fa649"
server_key_iv: "ad3906425a08ee3087da7cf9f1a09eb1"
server_key_version: "encryptionkey@0"
I20260812 01:10:15.293402 5964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "0c10a684da9d4f29a82b60956dd9951b"
format_stamp: "Formatted at 2026-08-12 01:10:15 on dist-test-slave-bndk"
server_key: "670f87087fa4b3b127d238e1825fa649"
server_key_iv: "ad3906425a08ee3087da7cf9f1a09eb1"
server_key_version: "encryptionkey@0"
I20260812 01:10:15.298317 5964 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260812 01:10:15.301584 5993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:15.302817 5964 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260812 01:10:15.302966 5964 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "0c10a684da9d4f29a82b60956dd9951b"
format_stamp: "Formatted at 2026-08-12 01:10:15 on dist-test-slave-bndk"
server_key: "670f87087fa4b3b127d238e1825fa649"
server_key_iv: "ad3906425a08ee3087da7cf9f1a09eb1"
server_key_version: "encryptionkey@0"
I20260812 01:10:15.303122 5964 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:15.317628 5964 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:15.321365 5964 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:15.321605 5964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:15.339223 5964 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46677
I20260812 01:10:15.339242 6064 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46677 every 8 connection(s)
I20260812 01:10:15.340618 5964 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:10:15.344362 6065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:15.351027 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 5964
I20260812 01:10:15.351248 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:10:15.352114 4901 external_mini_cluster.cc:1428] Setting key 4d25ad22558e999b0df812cba8758c63
I20260812 01:10:15.355762 6065 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c10a684da9d4f29a82b60956dd9951b: Bootstrap starting.
I20260812 01:10:15.359380 6065 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c10a684da9d4f29a82b60956dd9951b: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:15.360427 6065 log.cc:824] T 00000000000000000000000000000000 P 0c10a684da9d4f29a82b60956dd9951b: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:15.363391 6065 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c10a684da9d4f29a82b60956dd9951b: No bootstrap required, opened a new log
Aug 12 01:10:15 dist-test-slave-bndk krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497014, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 01:10:15.371896 6065 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c10a684da9d4f29a82b60956dd9951b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c10a684da9d4f29a82b60956dd9951b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46677 } }
I20260812 01:10:15.372280 6065 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0c10a684da9d4f29a82b60956dd9951b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:15.372381 6065 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c10a684da9d4f29a82b60956dd9951b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c10a684da9d4f29a82b60956dd9951b, State: Initialized, Role: FOLLOWER
I20260812 01:10:15.373018 6065 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c10a684da9d4f29a82b60956dd9951b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c10a684da9d4f29a82b60956dd9951b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46677 } }
I20260812 01:10:15.373303 6065 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0c10a684da9d4f29a82b60956dd9951b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:10:15.373451 6065 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c10a684da9d4f29a82b60956dd9951b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:10:15.373644 6065 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c10a684da9d4f29a82b60956dd9951b [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:15.375201 6071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:15.354092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48503 (local address 127.0.0.1:46677)
0812 01:10:15.354869 (+ 777us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:15.354882 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:15.354923 (+ 41us) server_negotiation.cc:407] Connection header received
0812 01:10:15.356693 (+ 1770us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:15.356719 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:15.357096 (+ 377us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:15.357482 (+ 386us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:15.359277 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:15.360627 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:15.362249 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:15.362918 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:15.363056 (+ 138us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:15.367595 (+ 4539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:15.367605 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:15.367622 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:15.367662 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:15.370843 (+ 3181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:15.371633 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:15.371640 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:15.371647 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:15.371813 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:15.372287 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:15.372291 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:15.372294 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:15.372898 (+ 604us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:15.373268 (+ 370us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:15.373769 (+ 501us) server_negotiation.cc:299] Negotiation successful
0812 01:10:15.374096 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":575,"thread_start_us":364,"threads_started":1}
I20260812 01:10:15.376118 6065 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c10a684da9d4f29a82b60956dd9951b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c10a684da9d4f29a82b60956dd9951b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46677 } }
I20260812 01:10:15.376710 6065 leader_election.cc:302] T 00000000000000000000000000000000 P 0c10a684da9d4f29a82b60956dd9951b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0c10a684da9d4f29a82b60956dd9951b; no voters:
I20260812 01:10:15.377405 6065 leader_election.cc:288] T 00000000000000000000000000000000 P 0c10a684da9d4f29a82b60956dd9951b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:10:15.377504 6073 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c10a684da9d4f29a82b60956dd9951b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:10:15.378647 6073 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0c10a684da9d4f29a82b60956dd9951b [term 1 LEADER]: Becoming Leader. State: Replica: 0c10a684da9d4f29a82b60956dd9951b, State: Running, Role: LEADER
I20260812 01:10:15.379199 6073 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c10a684da9d4f29a82b60956dd9951b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c10a684da9d4f29a82b60956dd9951b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46677 } }
I20260812 01:10:15.379693 6065 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c10a684da9d4f29a82b60956dd9951b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:10:15.380100 4901 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:10:15.382226 6077 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c10a684da9d4f29a82b60956dd9951b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c10a684da9d4f29a82b60956dd9951b. Latest consensus state: current_term: 1 leader_uuid: "0c10a684da9d4f29a82b60956dd9951b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c10a684da9d4f29a82b60956dd9951b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46677 } } }
I20260812 01:10:15.382587 6077 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c10a684da9d4f29a82b60956dd9951b [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:15.385087 6076 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c10a684da9d4f29a82b60956dd9951b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0c10a684da9d4f29a82b60956dd9951b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c10a684da9d4f29a82b60956dd9951b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46677 } } }
I20260812 01:10:15.385419 6076 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c10a684da9d4f29a82b60956dd9951b [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:15.385516 6090 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:10:15.391062 6090 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:10:15.404072 6090 catalog_manager.cc:1347] Generated new cluster ID: 85f9d9f09a31479785f4b39cc9a9e920
I20260812 01:10:15.404191 6090 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:10:15.417507 6071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:15.388885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59237 (local address 127.0.0.1:46677)
0812 01:10:15.389085 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:15.389092 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:15.398635 (+ 9543us) server_negotiation.cc:407] Connection header received
0812 01:10:15.399160 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:15.399167 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:15.399257 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:15.399332 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:15.401562 (+ 2230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:15.402726 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:15.404545 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:15.405337 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:15.405435 (+ 98us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:15.409668 (+ 4233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:15.409676 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:15.409682 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:15.409722 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:15.413603 (+ 3881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:15.414626 (+ 1023us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:15.414636 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:15.414640 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:15.414813 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:15.415412 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:15.415418 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:15.415421 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:15.415843 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:15.416132 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:15.416854 (+ 722us) server_negotiation.cc:299] Negotiation successful
0812 01:10:15.417068 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 01:10:15.424733 6090 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:10:15.426515 6090 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:10:15.441133 6090 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0c10a684da9d4f29a82b60956dd9951b: Generated new TSK 0
I20260812 01:10:15.442087 6090 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:10:15.455884 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 5964
I20260812 01:10:15.457487 6058 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:10:15.548072 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 5964
W20260812 01:10:15.572692 5944 connection.cc:535] client connection to 127.0.0.1:46677 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46677): Connection reset by peer (error 104)
2026-08-12T01:10:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2172 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:10:15 dist-test-slave-bndk krb5kdc[6128](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:10:15 dist-test-slave-bndk krb5kdc[6128](info): set up 2 sockets
Aug 12 01:10:15 dist-test-slave-bndk krb5kdc[6128](info): commencing operation
krb5kdc: starting...
W20260812 01:10:16.783708 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.192s user 0.006s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:10:16 dist-test-slave-bndk krb5kdc[6128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497016, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:10:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:10:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 01:10:17.070516 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46765
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46765
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:10:17.410780 6154 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:17.411055 6154 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:17.411195 6154 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:17.418248 6154 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:10:17.418356 6154 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:17.418437 6154 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:17.418514 6154 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:10:17.418560 6154 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:10:17.428262 6154 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46765
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46765
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:17.429515 6154 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:17.430811 6154 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:17.441877 6160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:17.441948 6164 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:17.442039 6162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:17.443264 6154 server_base.cc:1034] running on GCE node
I20260812 01:10:17.443985 6154 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:17.445312 6154 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:17.446508 6154 hybrid_clock.cc:648] HybridClock initialized: now 1786497017446470 us; error 40 us; skew 500 ppm
I20260812 01:10:17.446820 6154 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:10:17 dist-test-slave-bndk krb5kdc[6128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497017, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:10:17.454133 6154 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 01:10:17.455559 6154 webserver.cc:460] Webserver started at http://127.0.0.1:42953/ using document root <none> and password file <none>
I20260812 01:10:17.456213 6154 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:17.456326 6154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:17.456629 6154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:17.459739 6154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "b38215beeb4443199eb519fef82c6742"
format_stamp: "Formatted at 2026-08-12 01:10:17 on dist-test-slave-bndk"
server_key: "7e860e3986fd7109d6f13a023361a481"
server_key_iv: "abfd5d4052a64676a2bb6d81f7848262"
server_key_version: "encryptionkey@0"
I20260812 01:10:17.460515 6154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "b38215beeb4443199eb519fef82c6742"
format_stamp: "Formatted at 2026-08-12 01:10:17 on dist-test-slave-bndk"
server_key: "7e860e3986fd7109d6f13a023361a481"
server_key_iv: "abfd5d4052a64676a2bb6d81f7848262"
server_key_version: "encryptionkey@0"
I20260812 01:10:17.465618 6154 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260812 01:10:17.469131 6180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:17.470544 6154 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 01:10:17.470700 6154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "b38215beeb4443199eb519fef82c6742"
format_stamp: "Formatted at 2026-08-12 01:10:17 on dist-test-slave-bndk"
server_key: "7e860e3986fd7109d6f13a023361a481"
server_key_iv: "abfd5d4052a64676a2bb6d81f7848262"
server_key_version: "encryptionkey@0"
I20260812 01:10:17.470885 6154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:17.494467 6154 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:17.498418 6154 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:17.498698 6154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:17.516255 6154 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46765
I20260812 01:10:17.516279 6262 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46765 every 8 connection(s)
I20260812 01:10:17.517635 6154 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:10:17.519598 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 6154
I20260812 01:10:17.519795 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:10:17.520332 4901 external_mini_cluster.cc:1428] Setting key 54ac2413acd75b23fcdb1028194b8eab
I20260812 01:10:17.521998 6265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:17.533196 6269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:17.522141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58319 (local address 127.0.0.1:46765)
0812 01:10:17.522895 (+ 754us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:17.522907 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:17.522949 (+ 42us) server_negotiation.cc:407] Connection header received
0812 01:10:17.524569 (+ 1620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:17.524590 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:17.524960 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:17.525336 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:17.525853 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:17.527182 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:17.528956 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:17.529641 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:17.529763 (+ 122us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:17.531020 (+ 1257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:17.531029 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:17.531046 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:17.531576 (+ 530us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:17.531649 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:17.531677 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:17.531795 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:17.532075 (+ 280us) server_negotiation.cc:299] Negotiation successful
0812 01:10:17.532263 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":543,"thread_start_us":331,"threads_started":1}
I20260812 01:10:17.534677 6265 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b38215beeb4443199eb519fef82c6742: Bootstrap starting.
I20260812 01:10:17.536942 4901 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:10:17.537885 6265 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b38215beeb4443199eb519fef82c6742: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:17.538815 6265 log.cc:824] T 00000000000000000000000000000000 P b38215beeb4443199eb519fef82c6742: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:17.541520 6265 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b38215beeb4443199eb519fef82c6742: No bootstrap required, opened a new log
I20260812 01:10:17.547391 6269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:17.541043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35585 (local address 127.0.0.1:46765)
0812 01:10:17.541202 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:17.541208 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:17.541706 (+ 498us) server_negotiation.cc:407] Connection header received
0812 01:10:17.541859 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:17.541864 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:17.541941 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:17.542054 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:17.542493 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:17.543622 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:17.544875 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:17.545584 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:17.545699 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:17.546677 (+ 978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:17.546683 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:17.546688 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:17.546708 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:17.546768 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:17.546792 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:17.546903 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:17.547032 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 01:10:17.547082 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 01:10:17.550369 6265 raft_consensus.cc:348] T 00000000000000000000000000000000 P b38215beeb4443199eb519fef82c6742 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b38215beeb4443199eb519fef82c6742" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46765 } }
I20260812 01:10:17.550699 6265 raft_consensus.cc:374] T 00000000000000000000000000000000 P b38215beeb4443199eb519fef82c6742 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:17.550793 6265 raft_consensus.cc:729] T 00000000000000000000000000000000 P b38215beeb4443199eb519fef82c6742 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b38215beeb4443199eb519fef82c6742, State: Initialized, Role: FOLLOWER
I20260812 01:10:17.551337 6265 consensus_queue.cc:260] T 00000000000000000000000000000000 P b38215beeb4443199eb519fef82c6742 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b38215beeb4443199eb519fef82c6742" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46765 } }
I20260812 01:10:17.551543 6265 raft_consensus.cc:388] T 00000000000000000000000000000000 P b38215beeb4443199eb519fef82c6742 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:10:17.551671 6265 raft_consensus.cc:482] T 00000000000000000000000000000000 P b38215beeb4443199eb519fef82c6742 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:10:17.551820 6265 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b38215beeb4443199eb519fef82c6742 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:17.554109 6265 raft_consensus.cc:504] T 00000000000000000000000000000000 P b38215beeb4443199eb519fef82c6742 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b38215beeb4443199eb519fef82c6742" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46765 } }
I20260812 01:10:17.554574 6265 leader_election.cc:302] T 00000000000000000000000000000000 P b38215beeb4443199eb519fef82c6742 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b38215beeb4443199eb519fef82c6742; no voters:
I20260812 01:10:17.555083 6265 leader_election.cc:288] T 00000000000000000000000000000000 P b38215beeb4443199eb519fef82c6742 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:10:17.555200 6281 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b38215beeb4443199eb519fef82c6742 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:10:17.555922 6281 raft_consensus.cc:686] T 00000000000000000000000000000000 P b38215beeb4443199eb519fef82c6742 [term 1 LEADER]: Becoming Leader. State: Replica: b38215beeb4443199eb519fef82c6742, State: Running, Role: LEADER
I20260812 01:10:17.556449 6281 consensus_queue.cc:237] T 00000000000000000000000000000000 P b38215beeb4443199eb519fef82c6742 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b38215beeb4443199eb519fef82c6742" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46765 } }
I20260812 01:10:17.557039 6265 sys_catalog.cc:564] T 00000000000000000000000000000000 P b38215beeb4443199eb519fef82c6742 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:10:17.559180 6282 sys_catalog.cc:455] T 00000000000000000000000000000000 P b38215beeb4443199eb519fef82c6742 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b38215beeb4443199eb519fef82c6742" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b38215beeb4443199eb519fef82c6742" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46765 } } }
I20260812 01:10:17.559660 6282 sys_catalog.cc:458] T 00000000000000000000000000000000 P b38215beeb4443199eb519fef82c6742 [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:17.559214 6283 sys_catalog.cc:455] T 00000000000000000000000000000000 P b38215beeb4443199eb519fef82c6742 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b38215beeb4443199eb519fef82c6742. Latest consensus state: current_term: 1 leader_uuid: "b38215beeb4443199eb519fef82c6742" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b38215beeb4443199eb519fef82c6742" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46765 } } }
I20260812 01:10:17.561298 6283 sys_catalog.cc:458] T 00000000000000000000000000000000 P b38215beeb4443199eb519fef82c6742 [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:17.562177 6292 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:10:17.567314 6292 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:10:17.575785 6292 catalog_manager.cc:1347] Generated new cluster ID: 3fcf03095ba041748588baf94e05d8e5
I20260812 01:10:17.575896 6292 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:10:17.604038 6292 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:10:17.605350 6292 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:10:17.610731 6292 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b38215beeb4443199eb519fef82c6742: Generated new TSK 0
I20260812 01:10:17.611548 6292 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:10:17.619004 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 6154
W20260812 01:10:17.620163 6256 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:58319
W20260812 01:10:17.620852 4901 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 6154: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 01:10:17.621006 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 6154
W20260812 01:10:17.645265 6125 connection.cc:535] client connection to 127.0.0.1:46765 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46765): Connection reset by peer (error 104)
2026-08-12T01:10:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2072 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:10:17 dist-test-slave-bndk krb5kdc[6323](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:10:17 dist-test-slave-bndk krb5kdc[6323](info): set up 2 sockets
Aug 12 01:10:17 dist-test-slave-bndk krb5kdc[6323](info): commencing operation
krb5kdc: starting...
W20260812 01:10:18.874173 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.210s user 0.002s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:10:19 dist-test-slave-bndk krb5kdc[6323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497019, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:10:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:10:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 01:10:19.162329 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39493
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39493
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:10:19.501047 6348 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:19.501381 6348 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:19.501495 6348 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:19.508636 6348 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:10:19.508749 6348 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:19.508805 6348 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:19.508867 6348 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:10:19.508909 6348 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:10:19.518801 6348 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39493
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39493
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:19.520036 6348 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:19.521373 6348 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:19.532716 6360 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:19.532730 6358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:19.532999 6357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:19.533579 6348 server_base.cc:1034] running on GCE node
I20260812 01:10:19.534261 6348 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:19.535537 6348 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:19.536734 6348 hybrid_clock.cc:648] HybridClock initialized: now 1786497019536697 us; error 31 us; skew 500 ppm
I20260812 01:10:19.537039 6348 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:10:19 dist-test-slave-bndk krb5kdc[6323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497019, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:10:19.540126 6348 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 01:10:19.541496 6348 webserver.cc:460] Webserver started at http://127.0.0.1:33555/ using document root <none> and password file <none>
I20260812 01:10:19.542155 6348 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:19.542265 6348 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:19.542621 6348 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:19.545574 6348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "3ba49413403f40cca21c5295dde39efd"
format_stamp: "Formatted at 2026-08-12 01:10:19 on dist-test-slave-bndk"
server_key: "e36eceb1b768f1b3c92a1889def41bce"
server_key_iv: "4fcfb537a4d9ca568eac6431e5884b69"
server_key_version: "encryptionkey@0"
I20260812 01:10:19.546332 6348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "3ba49413403f40cca21c5295dde39efd"
format_stamp: "Formatted at 2026-08-12 01:10:19 on dist-test-slave-bndk"
server_key: "e36eceb1b768f1b3c92a1889def41bce"
server_key_iv: "4fcfb537a4d9ca568eac6431e5884b69"
server_key_version: "encryptionkey@0"
I20260812 01:10:19.551422 6348 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 01:10:19.554778 6369 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:19.556077 6348 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 01:10:19.556245 6348 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "3ba49413403f40cca21c5295dde39efd"
format_stamp: "Formatted at 2026-08-12 01:10:19 on dist-test-slave-bndk"
server_key: "e36eceb1b768f1b3c92a1889def41bce"
server_key_iv: "4fcfb537a4d9ca568eac6431e5884b69"
server_key_version: "encryptionkey@0"
I20260812 01:10:19.556427 6348 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:19.562171 6348 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:19.566009 6348 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:19.566275 6348 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:19.584188 6348 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39493
I20260812 01:10:19.584234 6453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39493 every 8 connection(s)
I20260812 01:10:19.585642 6348 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:10:19.589342 6454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:19.589970 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 6348
I20260812 01:10:19.590155 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:10:19.590713 4901 external_mini_cluster.cc:1428] Setting key c944e49b9d42db99e30032a3f4de31e4
I20260812 01:10:19.599774 6459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:19.592550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32787 (local address 127.0.0.1:39493)
0812 01:10:19.593398 (+ 848us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:19.593413 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:19.593462 (+ 49us) server_negotiation.cc:407] Connection header received
0812 01:10:19.596139 (+ 2677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:19.596170 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:19.596602 (+ 432us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:19.597038 (+ 436us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:19.597980 (+ 942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:19.597989 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:19.598006 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:19.598022 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:19.598084 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:19.598108 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:19.598317 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:19.598441 (+ 124us) server_negotiation.cc:299] Negotiation successful
0812 01:10:19.598628 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":571,"thread_start_us":302,"threads_started":1}
I20260812 01:10:19.603295 4901 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:10:19.603578 6454 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ba49413403f40cca21c5295dde39efd: Bootstrap starting.
I20260812 01:10:19.607421 6454 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ba49413403f40cca21c5295dde39efd: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:19.608713 6454 log.cc:824] T 00000000000000000000000000000000 P 3ba49413403f40cca21c5295dde39efd: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:19.611099 6459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:19.608507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34881 (local address 127.0.0.1:39493)
0812 01:10:19.608670 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:19.608676 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:19.609269 (+ 593us) server_negotiation.cc:407] Connection header received
0812 01:10:19.609496 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:19.609502 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:19.609565 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:19.609698 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:19.610536 (+ 838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:19.610541 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:19.610544 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:19.610559 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:19.610594 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:19.610608 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:19.610692 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:19.610803 (+ 111us) server_negotiation.cc:299] Negotiation successful
0812 01:10:19.610846 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 01:10:19.612038 6454 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ba49413403f40cca21c5295dde39efd: No bootstrap required, opened a new log
I20260812 01:10:19.619345 6454 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ba49413403f40cca21c5295dde39efd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ba49413403f40cca21c5295dde39efd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39493 } }
I20260812 01:10:19.619696 6454 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3ba49413403f40cca21c5295dde39efd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:19.619786 6454 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ba49413403f40cca21c5295dde39efd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ba49413403f40cca21c5295dde39efd, State: Initialized, Role: FOLLOWER
I20260812 01:10:19.620410 6454 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ba49413403f40cca21c5295dde39efd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ba49413403f40cca21c5295dde39efd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39493 } }
I20260812 01:10:19.620676 6454 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3ba49413403f40cca21c5295dde39efd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:10:19.620806 6454 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ba49413403f40cca21c5295dde39efd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:10:19.620975 6454 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ba49413403f40cca21c5295dde39efd [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:19.623088 6454 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ba49413403f40cca21c5295dde39efd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ba49413403f40cca21c5295dde39efd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39493 } }
I20260812 01:10:19.623548 6454 leader_election.cc:302] T 00000000000000000000000000000000 P 3ba49413403f40cca21c5295dde39efd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ba49413403f40cca21c5295dde39efd; no voters:
I20260812 01:10:19.624159 6454 leader_election.cc:288] T 00000000000000000000000000000000 P 3ba49413403f40cca21c5295dde39efd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:10:19.624264 6474 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ba49413403f40cca21c5295dde39efd [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:10:19.625003 6474 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ba49413403f40cca21c5295dde39efd [term 1 LEADER]: Becoming Leader. State: Replica: 3ba49413403f40cca21c5295dde39efd, State: Running, Role: LEADER
I20260812 01:10:19.625530 6474 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ba49413403f40cca21c5295dde39efd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ba49413403f40cca21c5295dde39efd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39493 } }
I20260812 01:10:19.626101 6454 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ba49413403f40cca21c5295dde39efd [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:10:19.628217 6475 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ba49413403f40cca21c5295dde39efd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3ba49413403f40cca21c5295dde39efd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ba49413403f40cca21c5295dde39efd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39493 } } }
I20260812 01:10:19.628185 6476 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ba49413403f40cca21c5295dde39efd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ba49413403f40cca21c5295dde39efd. Latest consensus state: current_term: 1 leader_uuid: "3ba49413403f40cca21c5295dde39efd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ba49413403f40cca21c5295dde39efd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39493 } } }
I20260812 01:10:19.628733 6476 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ba49413403f40cca21c5295dde39efd [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:19.628754 6475 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ba49413403f40cca21c5295dde39efd [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:19.630609 6480 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:10:19.635259 6480 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:10:19.643975 6480 catalog_manager.cc:1347] Generated new cluster ID: 06128649742f41aca08d2b33eb710b8c
I20260812 01:10:19.644070 6480 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:10:19.652981 6480 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:10:19.653403 6480 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:10:19.662696 6480 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3ba49413403f40cca21c5295dde39efd: Generated new TSK 0
I20260812 01:10:19.663435 6480 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:10:19.672088 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 6348
W20260812 01:10:19.673067 6448 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:32787
W20260812 01:10:19.673746 4901 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 6348: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 01:10:19.673866 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 6348
2026-08-12T01:10:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2051 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:10:19 dist-test-slave-bndk krb5kdc[6504](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:10:19 dist-test-slave-bndk krb5kdc[6504](info): set up 2 sockets
Aug 12 01:10:19 dist-test-slave-bndk krb5kdc[6504](info): commencing operation
krb5kdc: starting...
W20260812 01:10:20.916844 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.201s user 0.003s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:10:21 dist-test-slave-bndk krb5kdc[6504](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497021, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:10:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:10:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 01:10:21.212018 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42557
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42557
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:10:21.546113 6533 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:21.546398 6533 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:21.546536 6533 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:21.553761 6533 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:10:21.553894 6533 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:21.553977 6533 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:21.554064 6533 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:10:21.554128 6533 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:10:21.563727 6533 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42557
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42557
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:21.564975 6533 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:21.566229 6533 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:21.577600 6539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:21.577641 6544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:21.577679 6541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:21.578667 6533 server_base.cc:1034] running on GCE node
I20260812 01:10:21.579355 6533 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:21.580717 6533 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:21.581959 6533 hybrid_clock.cc:648] HybridClock initialized: now 1786497021581859 us; error 87 us; skew 500 ppm
I20260812 01:10:21.582255 6533 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:10:21 dist-test-slave-bndk krb5kdc[6504](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497021, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:10:21.585153 6533 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 01:10:21.586606 6533 webserver.cc:460] Webserver started at http://127.0.0.1:37289/ using document root <none> and password file <none>
I20260812 01:10:21.587218 6533 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:21.587320 6533 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:21.587607 6533 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:21.590442 6533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "02585e9e64924479bc909b052e455d31"
format_stamp: "Formatted at 2026-08-12 01:10:21 on dist-test-slave-bndk"
server_key: "a446c4ce28bb89101a301862f1526cea"
server_key_iv: "e4b49a31162b9ac49a574cda536fb95e"
server_key_version: "encryptionkey@0"
I20260812 01:10:21.591113 6533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "02585e9e64924479bc909b052e455d31"
format_stamp: "Formatted at 2026-08-12 01:10:21 on dist-test-slave-bndk"
server_key: "a446c4ce28bb89101a301862f1526cea"
server_key_iv: "e4b49a31162b9ac49a574cda536fb95e"
server_key_version: "encryptionkey@0"
I20260812 01:10:21.595952 6533 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.005s
I20260812 01:10:21.599401 6551 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:21.600675 6533 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 01:10:21.600843 6533 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "02585e9e64924479bc909b052e455d31"
format_stamp: "Formatted at 2026-08-12 01:10:21 on dist-test-slave-bndk"
server_key: "a446c4ce28bb89101a301862f1526cea"
server_key_iv: "e4b49a31162b9ac49a574cda536fb95e"
server_key_version: "encryptionkey@0"
I20260812 01:10:21.601017 6533 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:21.636094 6533 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:21.640193 6533 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:21.640467 6533 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:21.658958 6533 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42557
I20260812 01:10:21.659015 6628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42557 every 8 connection(s)
I20260812 01:10:21.660351 6533 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:10:21.664103 6631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:21.667372 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 6533
I20260812 01:10:21.667547 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:10:21.668090 4901 external_mini_cluster.cc:1428] Setting key 8e6ceee40291a33a301a3248db7846c0
I20260812 01:10:21.676473 6631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 02585e9e64924479bc909b052e455d31: Bootstrap starting.
I20260812 01:10:21.680253 6631 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 02585e9e64924479bc909b052e455d31: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:21.681576 6631 log.cc:824] T 00000000000000000000000000000000 P 02585e9e64924479bc909b052e455d31: Log is configured to *not* fsync() on all Append() calls
Aug 12 01:10:21 dist-test-slave-bndk krb5kdc[6504](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497021, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 01:10:21.684634 6631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 02585e9e64924479bc909b052e455d31: No bootstrap required, opened a new log
I20260812 01:10:21.691179 6635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:21.669933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38301 (local address 127.0.0.1:42557)
0812 01:10:21.670705 (+ 772us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:21.670716 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:21.670760 (+ 44us) server_negotiation.cc:407] Connection header received
0812 01:10:21.672433 (+ 1673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:21.672457 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:21.672869 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:21.673196 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:21.674944 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:21.676273 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:21.678046 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:21.678732 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:21.678861 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:21.683756 (+ 4895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:21.683763 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:21.683777 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:21.683819 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:21.686772 (+ 2953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:21.687564 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:21.687577 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:21.687592 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:21.687791 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:21.688210 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:21.688213 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:21.688215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:21.688741 (+ 526us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:21.688988 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:21.689430 (+ 442us) server_negotiation.cc:299] Negotiation successful
0812 01:10:21.689811 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":569,"thread_start_us":350,"threads_started":1}
I20260812 01:10:21.695037 6631 raft_consensus.cc:348] T 00000000000000000000000000000000 P 02585e9e64924479bc909b052e455d31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02585e9e64924479bc909b052e455d31" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42557 } }
I20260812 01:10:21.695461 6631 raft_consensus.cc:374] T 00000000000000000000000000000000 P 02585e9e64924479bc909b052e455d31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:21.695575 6631 raft_consensus.cc:729] T 00000000000000000000000000000000 P 02585e9e64924479bc909b052e455d31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02585e9e64924479bc909b052e455d31, State: Initialized, Role: FOLLOWER
I20260812 01:10:21.696219 6631 consensus_queue.cc:260] T 00000000000000000000000000000000 P 02585e9e64924479bc909b052e455d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02585e9e64924479bc909b052e455d31" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42557 } }
I20260812 01:10:21.696521 6631 raft_consensus.cc:388] T 00000000000000000000000000000000 P 02585e9e64924479bc909b052e455d31 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:10:21.696669 6631 raft_consensus.cc:482] T 00000000000000000000000000000000 P 02585e9e64924479bc909b052e455d31 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:10:21.696846 6631 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 02585e9e64924479bc909b052e455d31 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:21.696923 4901 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:10:21.699887 6631 raft_consensus.cc:504] T 00000000000000000000000000000000 P 02585e9e64924479bc909b052e455d31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02585e9e64924479bc909b052e455d31" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42557 } }
I20260812 01:10:21.700507 6631 leader_election.cc:302] T 00000000000000000000000000000000 P 02585e9e64924479bc909b052e455d31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 02585e9e64924479bc909b052e455d31; no voters:
I20260812 01:10:21.701174 6631 leader_election.cc:288] T 00000000000000000000000000000000 P 02585e9e64924479bc909b052e455d31 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:10:21.701274 6643 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 02585e9e64924479bc909b052e455d31 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:10:21.703456 6631 sys_catalog.cc:564] T 00000000000000000000000000000000 P 02585e9e64924479bc909b052e455d31 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:10:21.710206 6643 raft_consensus.cc:686] T 00000000000000000000000000000000 P 02585e9e64924479bc909b052e455d31 [term 1 LEADER]: Becoming Leader. State: Replica: 02585e9e64924479bc909b052e455d31, State: Running, Role: LEADER
I20260812 01:10:21.710837 6643 consensus_queue.cc:237] T 00000000000000000000000000000000 P 02585e9e64924479bc909b052e455d31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02585e9e64924479bc909b052e455d31" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42557 } }
I20260812 01:10:21.713649 6645 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02585e9e64924479bc909b052e455d31 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 02585e9e64924479bc909b052e455d31. Latest consensus state: current_term: 1 leader_uuid: "02585e9e64924479bc909b052e455d31" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02585e9e64924479bc909b052e455d31" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42557 } } }
I20260812 01:10:21.714030 6645 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02585e9e64924479bc909b052e455d31 [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:21.714566 6644 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02585e9e64924479bc909b052e455d31 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "02585e9e64924479bc909b052e455d31" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02585e9e64924479bc909b052e455d31" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42557 } } }
I20260812 01:10:21.714896 6644 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02585e9e64924479bc909b052e455d31 [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:21.718430 6660 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:10:21.723584 6660 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:10:21.727447 6635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:21.702671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54279 (local address 127.0.0.1:42557)
0812 01:10:21.702848 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:21.702854 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:21.709822 (+ 6968us) server_negotiation.cc:407] Connection header received
0812 01:10:21.709989 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:21.709994 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:21.710087 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:21.710206 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:21.712377 (+ 2171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:21.713637 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:21.715634 (+ 1997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:21.716402 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:21.716509 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:21.719747 (+ 3238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:21.719752 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:21.719755 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:21.719785 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:21.723442 (+ 3657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:21.724261 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:21.724267 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:21.724271 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:21.724434 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:21.724916 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:21.724920 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:21.724924 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:21.725438 (+ 514us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:21.726666 (+ 1228us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:21.726826 (+ 160us) server_negotiation.cc:299] Negotiation successful
0812 01:10:21.727067 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 01:10:21.733120 6660 catalog_manager.cc:1347] Generated new cluster ID: 3524ea2cf4a5482f95fecbb18c5aa357
I20260812 01:10:21.733237 6660 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:10:21.755927 6660 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:10:21.757243 6660 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:10:21.766019 6660 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 02585e9e64924479bc909b052e455d31: Generated new TSK 0
I20260812 01:10:21.766826 6660 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:10:21.783560 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 6533
I20260812 01:10:21.784739 6622 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:10:21.875918 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 6533
2026-08-12T01:10:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2206 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:10:21 dist-test-slave-bndk krb5kdc[6678](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:10:21 dist-test-slave-bndk krb5kdc[6678](info): set up 2 sockets
Aug 12 01:10:21 dist-test-slave-bndk krb5kdc[6678](info): commencing operation
krb5kdc: starting...
W20260812 01:10:23.115794 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.194s user 0.003s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:10:23 dist-test-slave-bndk krb5kdc[6678](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:10:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:10:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 01:10:23.415570 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45717
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45717
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:10:23.757761 6708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:23.758023 6708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:23.758152 6708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:23.765156 6708 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:10:23.765283 6708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:23.765400 6708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:23.765465 6708 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:10:23.765524 6708 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:10:23.775072 6708 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45717
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45717
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:23.776278 6708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:23.777588 6708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:23.788861 6716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:23.788817 6717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:23.788784 6720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:23.789673 6708 server_base.cc:1034] running on GCE node
I20260812 01:10:23.790464 6708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:23.791834 6708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:23.793037 6708 hybrid_clock.cc:648] HybridClock initialized: now 1786497023792982 us; error 47 us; skew 500 ppm
I20260812 01:10:23.793427 6708 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:10:23 dist-test-slave-bndk krb5kdc[6678](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497023, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:10:23.801707 6708 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 01:10:23.803140 6708 webserver.cc:460] Webserver started at http://127.0.0.1:33095/ using document root <none> and password file <none>
I20260812 01:10:23.803977 6708 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:23.804116 6708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:23.804469 6708 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:23.808657 6708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "313c15e9753943e595b68e259d19120c"
format_stamp: "Formatted at 2026-08-12 01:10:23 on dist-test-slave-bndk"
server_key: "8eb67aeca04a58e43cdff1c4066b17e8"
server_key_iv: "3e4a941128a49925f0c62711c1870048"
server_key_version: "encryptionkey@0"
I20260812 01:10:23.809696 6708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "313c15e9753943e595b68e259d19120c"
format_stamp: "Formatted at 2026-08-12 01:10:23 on dist-test-slave-bndk"
server_key: "8eb67aeca04a58e43cdff1c4066b17e8"
server_key_iv: "3e4a941128a49925f0c62711c1870048"
server_key_version: "encryptionkey@0"
I20260812 01:10:23.816221 6708 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260812 01:10:23.819586 6735 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:23.820870 6708 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 01:10:23.821018 6708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "313c15e9753943e595b68e259d19120c"
format_stamp: "Formatted at 2026-08-12 01:10:23 on dist-test-slave-bndk"
server_key: "8eb67aeca04a58e43cdff1c4066b17e8"
server_key_iv: "3e4a941128a49925f0c62711c1870048"
server_key_version: "encryptionkey@0"
I20260812 01:10:23.821177 6708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:23.850760 6708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:23.854498 6708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:23.854727 6708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:23.871837 6708 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45717
I20260812 01:10:23.871873 6825 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45717 every 8 connection(s)
I20260812 01:10:23.873144 6708 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:10:23.875133 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 6708
I20260812 01:10:23.875316 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:10:23.875850 4901 external_mini_cluster.cc:1428] Setting key a49c50c68a6072ce16f5dbee2c413dc2
I20260812 01:10:23.877471 6827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:23.888679 6830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:23.877630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34113 (local address 127.0.0.1:45717)
0812 01:10:23.878368 (+ 738us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:23.878379 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:23.878419 (+ 40us) server_negotiation.cc:407] Connection header received
0812 01:10:23.879972 (+ 1553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:23.879995 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:23.880363 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:23.880686 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:23.881307 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:23.882691 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:23.884483 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:23.885114 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:23.885278 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:23.886442 (+ 1164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:23.886450 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:23.886468 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:23.887033 (+ 565us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:23.887116 (+ 83us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:23.887148 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:23.887236 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:23.887490 (+ 254us) server_negotiation.cc:299] Negotiation successful
0812 01:10:23.887746 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":535,"thread_start_us":324,"threads_started":1}
I20260812 01:10:23.889912 6827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 313c15e9753943e595b68e259d19120c: Bootstrap starting.
I20260812 01:10:23.892133 4901 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:10:23.893318 6827 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 313c15e9753943e595b68e259d19120c: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:23.894533 6827 log.cc:824] T 00000000000000000000000000000000 P 313c15e9753943e595b68e259d19120c: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:23.897275 6827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 313c15e9753943e595b68e259d19120c: No bootstrap required, opened a new log
I20260812 01:10:23.903270 6830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:23.897197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56125 (local address 127.0.0.1:45717)
0812 01:10:23.897406 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:23.897411 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:23.897755 (+ 344us) server_negotiation.cc:407] Connection header received
0812 01:10:23.897870 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:23.897875 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:23.897946 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:23.898059 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:23.898519 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:23.899590 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:23.900811 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:23.901507 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:23.901618 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:23.902554 (+ 936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:23.902561 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:23.902566 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:23.902591 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:23.902633 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:23.902654 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:23.902741 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:23.902845 (+ 104us) server_negotiation.cc:299] Negotiation successful
0812 01:10:23.902937 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260812 01:10:23.906313 6827 raft_consensus.cc:348] T 00000000000000000000000000000000 P 313c15e9753943e595b68e259d19120c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "313c15e9753943e595b68e259d19120c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45717 } }
I20260812 01:10:23.906664 6827 raft_consensus.cc:374] T 00000000000000000000000000000000 P 313c15e9753943e595b68e259d19120c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:23.906755 6827 raft_consensus.cc:729] T 00000000000000000000000000000000 P 313c15e9753943e595b68e259d19120c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 313c15e9753943e595b68e259d19120c, State: Initialized, Role: FOLLOWER
I20260812 01:10:23.907295 6827 consensus_queue.cc:260] T 00000000000000000000000000000000 P 313c15e9753943e595b68e259d19120c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "313c15e9753943e595b68e259d19120c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45717 } }
I20260812 01:10:23.907505 6827 raft_consensus.cc:388] T 00000000000000000000000000000000 P 313c15e9753943e595b68e259d19120c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:10:23.907613 6827 raft_consensus.cc:482] T 00000000000000000000000000000000 P 313c15e9753943e595b68e259d19120c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:10:23.907740 6827 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 313c15e9753943e595b68e259d19120c [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:23.910110 6827 raft_consensus.cc:504] T 00000000000000000000000000000000 P 313c15e9753943e595b68e259d19120c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "313c15e9753943e595b68e259d19120c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45717 } }
I20260812 01:10:23.910557 6827 leader_election.cc:302] T 00000000000000000000000000000000 P 313c15e9753943e595b68e259d19120c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 313c15e9753943e595b68e259d19120c; no voters:
I20260812 01:10:23.911068 6827 leader_election.cc:288] T 00000000000000000000000000000000 P 313c15e9753943e595b68e259d19120c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:10:23.911182 6845 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 313c15e9753943e595b68e259d19120c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:10:23.911818 6845 raft_consensus.cc:686] T 00000000000000000000000000000000 P 313c15e9753943e595b68e259d19120c [term 1 LEADER]: Becoming Leader. State: Replica: 313c15e9753943e595b68e259d19120c, State: Running, Role: LEADER
I20260812 01:10:23.912299 6845 consensus_queue.cc:237] T 00000000000000000000000000000000 P 313c15e9753943e595b68e259d19120c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "313c15e9753943e595b68e259d19120c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45717 } }
I20260812 01:10:23.912943 6827 sys_catalog.cc:564] T 00000000000000000000000000000000 P 313c15e9753943e595b68e259d19120c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:10:23.915315 6847 sys_catalog.cc:455] T 00000000000000000000000000000000 P 313c15e9753943e595b68e259d19120c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 313c15e9753943e595b68e259d19120c. Latest consensus state: current_term: 1 leader_uuid: "313c15e9753943e595b68e259d19120c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "313c15e9753943e595b68e259d19120c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45717 } } }
I20260812 01:10:23.915589 6846 sys_catalog.cc:455] T 00000000000000000000000000000000 P 313c15e9753943e595b68e259d19120c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "313c15e9753943e595b68e259d19120c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "313c15e9753943e595b68e259d19120c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45717 } } }
I20260812 01:10:23.915941 6846 sys_catalog.cc:458] T 00000000000000000000000000000000 P 313c15e9753943e595b68e259d19120c [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:23.915946 6847 sys_catalog.cc:458] T 00000000000000000000000000000000 P 313c15e9753943e595b68e259d19120c [sys.catalog]: This master's current role is: LEADER
W20260812 01:10:23.924188 6869 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 313c15e9753943e595b68e259d19120c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 01:10:23.924314 6869 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 01:10:23.924458 6855 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:10:23.926230 6855 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:10:23.934155 6855 catalog_manager.cc:1347] Generated new cluster ID: 78d2eac854144a529463e1f85eb1d91c
I20260812 01:10:23.934259 6855 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:10:23.957326 6855 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:10:23.959096 6855 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:10:23.968325 6855 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 313c15e9753943e595b68e259d19120c: Generated new TSK 0
I20260812 01:10:23.969372 6855 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:10:23.987323 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 6708
W20260812 01:10:23.988415 6818 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:34113
W20260812 01:10:23.989283 4901 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 6708: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 01:10:23.989434 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 6708
2026-08-12T01:10:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2111 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:10:24 dist-test-slave-bndk krb5kdc[6881](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:10:24 dist-test-slave-bndk krb5kdc[6881](info): set up 2 sockets
Aug 12 01:10:24 dist-test-slave-bndk krb5kdc[6881](info): commencing operation
krb5kdc: starting...
W20260812 01:10:25.229414 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.196s user 0.003s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:10:25 dist-test-slave-bndk krb5kdc[6881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497025, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:10:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:10:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 01:10:25.525964 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34687
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34687
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:10:25.862943 6900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:25.863211 6900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:25.863341 6900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:25.870309 6900 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:10:25.870417 6900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:25.870493 6900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:25.870568 6900 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:10:25.870626 6900 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:10:25.880206 6900 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34687
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34687
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:25.881487 6900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:25.882763 6900 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:25.894438 6907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:25.894382 6909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:25.894495 6913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:25.895040 6900 server_base.cc:1034] running on GCE node
I20260812 01:10:25.895824 6900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:25.897246 6900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:25.898469 6900 hybrid_clock.cc:648] HybridClock initialized: now 1786497025898425 us; error 37 us; skew 500 ppm
I20260812 01:10:25.898821 6900 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:10:25 dist-test-slave-bndk krb5kdc[6881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497025, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:10:25.901924 6900 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 01:10:25.903391 6900 webserver.cc:460] Webserver started at http://127.0.0.1:42439/ using document root <none> and password file <none>
I20260812 01:10:25.904086 6900 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:25.904201 6900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:25.904505 6900 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:25.907579 6900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "d934035e1ace4eb4bedb9dec6a67381b"
format_stamp: "Formatted at 2026-08-12 01:10:25 on dist-test-slave-bndk"
server_key: "cd633d465defb11391f493d349a9a731"
server_key_iv: "bc1277994a28c7682eef43860b1e4feb"
server_key_version: "encryptionkey@0"
I20260812 01:10:25.908334 6900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "d934035e1ace4eb4bedb9dec6a67381b"
format_stamp: "Formatted at 2026-08-12 01:10:25 on dist-test-slave-bndk"
server_key: "cd633d465defb11391f493d349a9a731"
server_key_iv: "bc1277994a28c7682eef43860b1e4feb"
server_key_version: "encryptionkey@0"
I20260812 01:10:25.913468 6900 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260812 01:10:25.916821 6922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:25.918079 6900 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:10:25.918239 6900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "d934035e1ace4eb4bedb9dec6a67381b"
format_stamp: "Formatted at 2026-08-12 01:10:25 on dist-test-slave-bndk"
server_key: "cd633d465defb11391f493d349a9a731"
server_key_iv: "bc1277994a28c7682eef43860b1e4feb"
server_key_version: "encryptionkey@0"
I20260812 01:10:25.918423 6900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:25.923921 6900 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:25.927585 6900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:25.927845 6900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:25.944829 6900 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34687
I20260812 01:10:25.944888 7008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34687 every 8 connection(s)
I20260812 01:10:25.946159 6900 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:10:25.949666 7011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:25.954367 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 6900
I20260812 01:10:25.954536 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:10:25.954938 4901 external_mini_cluster.cc:1428] Setting key e749176c77c59b39bbdeb9f963838d1b
I20260812 01:10:25.960201 7011 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d934035e1ace4eb4bedb9dec6a67381b: Bootstrap starting.
I20260812 01:10:25.962375 7014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:25.956656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39691 (local address 127.0.0.1:34687)
0812 01:10:25.957463 (+ 807us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:25.957474 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:25.957517 (+ 43us) server_negotiation.cc:407] Connection header received
0812 01:10:25.959187 (+ 1670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:25.959210 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:25.959511 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:25.959803 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:25.960878 (+ 1075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:25.960885 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:25.960897 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:25.960911 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:25.960967 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:25.960998 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:25.961151 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:25.961307 (+ 156us) server_negotiation.cc:299] Negotiation successful
0812 01:10:25.961474 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":593,"thread_start_us":334,"threads_started":1}
I20260812 01:10:25.963449 7011 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d934035e1ace4eb4bedb9dec6a67381b: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:25.964439 7011 log.cc:824] T 00000000000000000000000000000000 P d934035e1ace4eb4bedb9dec6a67381b: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:25.965950 4901 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:10:25.967715 7011 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d934035e1ace4eb4bedb9dec6a67381b: No bootstrap required, opened a new log
I20260812 01:10:25.973129 7014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:25.970881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53601 (local address 127.0.0.1:34687)
0812 01:10:25.971039 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:25.971045 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:25.971353 (+ 308us) server_negotiation.cc:407] Connection header received
0812 01:10:25.971515 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:25.971521 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:25.971577 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:25.971688 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:25.972498 (+ 810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:25.972508 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:25.972512 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:25.972531 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:25.972581 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:25.972601 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:25.972721 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:25.972765 (+ 44us) server_negotiation.cc:299] Negotiation successful
0812 01:10:25.972817 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 01:10:25.976573 7011 raft_consensus.cc:348] T 00000000000000000000000000000000 P d934035e1ace4eb4bedb9dec6a67381b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d934035e1ace4eb4bedb9dec6a67381b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34687 } }
I20260812 01:10:25.976895 7011 raft_consensus.cc:374] T 00000000000000000000000000000000 P d934035e1ace4eb4bedb9dec6a67381b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:25.976967 7011 raft_consensus.cc:729] T 00000000000000000000000000000000 P d934035e1ace4eb4bedb9dec6a67381b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d934035e1ace4eb4bedb9dec6a67381b, State: Initialized, Role: FOLLOWER
I20260812 01:10:25.977514 7011 consensus_queue.cc:260] T 00000000000000000000000000000000 P d934035e1ace4eb4bedb9dec6a67381b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d934035e1ace4eb4bedb9dec6a67381b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34687 } }
I20260812 01:10:25.977744 7011 raft_consensus.cc:388] T 00000000000000000000000000000000 P d934035e1ace4eb4bedb9dec6a67381b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:10:25.977871 7011 raft_consensus.cc:482] T 00000000000000000000000000000000 P d934035e1ace4eb4bedb9dec6a67381b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:10:25.978035 7011 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d934035e1ace4eb4bedb9dec6a67381b [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:25.980357 7011 raft_consensus.cc:504] T 00000000000000000000000000000000 P d934035e1ace4eb4bedb9dec6a67381b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d934035e1ace4eb4bedb9dec6a67381b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34687 } }
I20260812 01:10:25.980826 7011 leader_election.cc:302] T 00000000000000000000000000000000 P d934035e1ace4eb4bedb9dec6a67381b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d934035e1ace4eb4bedb9dec6a67381b; no voters:
I20260812 01:10:25.981420 7011 leader_election.cc:288] T 00000000000000000000000000000000 P d934035e1ace4eb4bedb9dec6a67381b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:10:25.981542 7027 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d934035e1ace4eb4bedb9dec6a67381b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:10:25.982182 7027 raft_consensus.cc:686] T 00000000000000000000000000000000 P d934035e1ace4eb4bedb9dec6a67381b [term 1 LEADER]: Becoming Leader. State: Replica: d934035e1ace4eb4bedb9dec6a67381b, State: Running, Role: LEADER
I20260812 01:10:25.982681 7027 consensus_queue.cc:237] T 00000000000000000000000000000000 P d934035e1ace4eb4bedb9dec6a67381b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d934035e1ace4eb4bedb9dec6a67381b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34687 } }
I20260812 01:10:25.983312 7011 sys_catalog.cc:564] T 00000000000000000000000000000000 P d934035e1ace4eb4bedb9dec6a67381b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:10:25.985770 7032 sys_catalog.cc:455] T 00000000000000000000000000000000 P d934035e1ace4eb4bedb9dec6a67381b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d934035e1ace4eb4bedb9dec6a67381b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d934035e1ace4eb4bedb9dec6a67381b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34687 } } }
I20260812 01:10:25.986325 7032 sys_catalog.cc:458] T 00000000000000000000000000000000 P d934035e1ace4eb4bedb9dec6a67381b [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:25.986069 7033 sys_catalog.cc:455] T 00000000000000000000000000000000 P d934035e1ace4eb4bedb9dec6a67381b [sys.catalog]: SysCatalogTable state changed. Reason: New leader d934035e1ace4eb4bedb9dec6a67381b. Latest consensus state: current_term: 1 leader_uuid: "d934035e1ace4eb4bedb9dec6a67381b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d934035e1ace4eb4bedb9dec6a67381b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34687 } } }
I20260812 01:10:25.986948 7033 sys_catalog.cc:458] T 00000000000000000000000000000000 P d934035e1ace4eb4bedb9dec6a67381b [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:25.989691 7041 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:10:25.996091 7041 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:10:26.008102 7041 catalog_manager.cc:1347] Generated new cluster ID: c76a240f2b394add9bacc53a51f4c8f1
I20260812 01:10:26.008224 7041 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:10:26.029637 7041 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:10:26.030068 7041 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:10:26.036999 7041 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d934035e1ace4eb4bedb9dec6a67381b: Generated new TSK 0
I20260812 01:10:26.037781 7041 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:10:26.056159 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 6900
W20260812 01:10:26.057242 7002 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:39691
W20260812 01:10:26.057912 4901 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 6900: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 01:10:26.058039 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 6900
2026-08-12T01:10:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2071 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:10:26 dist-test-slave-bndk krb5kdc[7062](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:10:26 dist-test-slave-bndk krb5kdc[7062](info): set up 2 sockets
Aug 12 01:10:26 dist-test-slave-bndk krb5kdc[7062](info): commencing operation
krb5kdc: starting...
W20260812 01:10:27.303229 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.198s user 0.004s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:10:27 dist-test-slave-bndk krb5kdc[7062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497027, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:10:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:10:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 01:10:27.600965 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43249
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43249
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:10:27.939020 7091 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:27.939289 7091 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:27.939399 7091 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:27.946367 7091 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:10:27.946493 7091 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:27.946573 7091 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:27.946638 7091 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:10:27.946682 7091 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:10:27.956096 7091 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43249
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43249
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:27.957365 7091 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:27.958618 7091 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:27.969801 7098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:27.969806 7106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:27.969830 7099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:27.970837 7091 server_base.cc:1034] running on GCE node
I20260812 01:10:27.971635 7091 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:27.972940 7091 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:27.974138 7091 hybrid_clock.cc:648] HybridClock initialized: now 1786497027974099 us; error 25 us; skew 500 ppm
I20260812 01:10:27.974473 7091 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:10:27 dist-test-slave-bndk krb5kdc[7062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497027, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:10:27.977460 7091 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 01:10:27.978816 7091 webserver.cc:460] Webserver started at http://127.0.0.1:43421/ using document root <none> and password file <none>
I20260812 01:10:27.979467 7091 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:27.979573 7091 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:27.979853 7091 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:27.982779 7091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "5edc6fd843d04f3a899f18e8e8bc0b42"
format_stamp: "Formatted at 2026-08-12 01:10:27 on dist-test-slave-bndk"
server_key: "4a8229937c221ddfb2b3a3fd707233a8"
server_key_iv: "594fdda2cd95262f5a6675db5366b9ca"
server_key_version: "encryptionkey@0"
I20260812 01:10:27.983505 7091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "5edc6fd843d04f3a899f18e8e8bc0b42"
format_stamp: "Formatted at 2026-08-12 01:10:27 on dist-test-slave-bndk"
server_key: "4a8229937c221ddfb2b3a3fd707233a8"
server_key_iv: "594fdda2cd95262f5a6675db5366b9ca"
server_key_version: "encryptionkey@0"
I20260812 01:10:27.988432 7091 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 01:10:27.991768 7119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:27.992995 7091 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 01:10:27.993142 7091 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "5edc6fd843d04f3a899f18e8e8bc0b42"
format_stamp: "Formatted at 2026-08-12 01:10:27 on dist-test-slave-bndk"
server_key: "4a8229937c221ddfb2b3a3fd707233a8"
server_key_iv: "594fdda2cd95262f5a6675db5366b9ca"
server_key_version: "encryptionkey@0"
I20260812 01:10:27.993346 7091 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:28.017881 7091 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:28.022063 7091 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:28.022300 7091 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:28.038405 7091 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43249
I20260812 01:10:28.038450 7215 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43249 every 8 connection(s)
I20260812 01:10:28.039693 7091 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:10:28.043229 7216 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:28.048280 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 7091
I20260812 01:10:28.048444 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:10:28.048858 4901 external_mini_cluster.cc:1428] Setting key 60a803b9560837f5989989d75a581982
I20260812 01:10:28.053413 7216 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5edc6fd843d04f3a899f18e8e8bc0b42: Bootstrap starting.
I20260812 01:10:28.056767 7216 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5edc6fd843d04f3a899f18e8e8bc0b42: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:28.057982 7216 log.cc:824] T 00000000000000000000000000000000 P 5edc6fd843d04f3a899f18e8e8bc0b42: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:28.061091 7216 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5edc6fd843d04f3a899f18e8e8bc0b42: No bootstrap required, opened a new log
Aug 12 01:10:28 dist-test-slave-bndk krb5kdc[7062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497027, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 01:10:28.070652 7216 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5edc6fd843d04f3a899f18e8e8bc0b42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5edc6fd843d04f3a899f18e8e8bc0b42" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43249 } }
I20260812 01:10:28.071092 7216 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5edc6fd843d04f3a899f18e8e8bc0b42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:28.071200 7216 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5edc6fd843d04f3a899f18e8e8bc0b42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5edc6fd843d04f3a899f18e8e8bc0b42, State: Initialized, Role: FOLLOWER
I20260812 01:10:28.071902 7216 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5edc6fd843d04f3a899f18e8e8bc0b42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5edc6fd843d04f3a899f18e8e8bc0b42" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43249 } }
I20260812 01:10:28.072194 7216 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5edc6fd843d04f3a899f18e8e8bc0b42 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:10:28.072338 7216 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5edc6fd843d04f3a899f18e8e8bc0b42 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:10:28.072481 7221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:28.050634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:51459 (local address 127.0.0.1:43249)
0812 01:10:28.051491 (+ 857us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:28.051503 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:28.051546 (+ 43us) server_negotiation.cc:407] Connection header received
0812 01:10:28.053155 (+ 1609us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:28.053178 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:28.053615 (+ 437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:28.053923 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:28.055657 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:28.056902 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:28.058622 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:28.059541 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:28.059675 (+ 134us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:28.064247 (+ 4572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:28.064262 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:28.064281 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:28.064326 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:28.068169 (+ 3843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:28.068895 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:28.068907 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:28.068916 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:28.069141 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:28.069567 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:28.069573 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:28.069576 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:28.070225 (+ 649us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:28.070525 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:28.070852 (+ 327us) server_negotiation.cc:299] Negotiation successful
0812 01:10:28.071198 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":633,"thread_start_us":348,"threads_started":1}
I20260812 01:10:28.072539 7216 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5edc6fd843d04f3a899f18e8e8bc0b42 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:28.075323 7216 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5edc6fd843d04f3a899f18e8e8bc0b42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5edc6fd843d04f3a899f18e8e8bc0b42" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43249 } }
I20260812 01:10:28.075817 7216 leader_election.cc:302] T 00000000000000000000000000000000 P 5edc6fd843d04f3a899f18e8e8bc0b42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5edc6fd843d04f3a899f18e8e8bc0b42; no voters:
I20260812 01:10:28.076491 7216 leader_election.cc:288] T 00000000000000000000000000000000 P 5edc6fd843d04f3a899f18e8e8bc0b42 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:10:28.076535 4901 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:10:28.076592 7224 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5edc6fd843d04f3a899f18e8e8bc0b42 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:10:28.078276 7216 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5edc6fd843d04f3a899f18e8e8bc0b42 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:10:28.082158 7224 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5edc6fd843d04f3a899f18e8e8bc0b42 [term 1 LEADER]: Becoming Leader. State: Replica: 5edc6fd843d04f3a899f18e8e8bc0b42, State: Running, Role: LEADER
I20260812 01:10:28.082897 7224 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5edc6fd843d04f3a899f18e8e8bc0b42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5edc6fd843d04f3a899f18e8e8bc0b42" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43249 } }
I20260812 01:10:28.086156 7226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5edc6fd843d04f3a899f18e8e8bc0b42 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5edc6fd843d04f3a899f18e8e8bc0b42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5edc6fd843d04f3a899f18e8e8bc0b42" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43249 } } }
I20260812 01:10:28.086534 7226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5edc6fd843d04f3a899f18e8e8bc0b42 [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:28.087023 7227 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5edc6fd843d04f3a899f18e8e8bc0b42 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5edc6fd843d04f3a899f18e8e8bc0b42. Latest consensus state: current_term: 1 leader_uuid: "5edc6fd843d04f3a899f18e8e8bc0b42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5edc6fd843d04f3a899f18e8e8bc0b42" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43249 } } }
I20260812 01:10:28.087301 7227 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5edc6fd843d04f3a899f18e8e8bc0b42 [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:28.094662 7260 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:10:28.100193 7260 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:10:28.101651 7221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:28.084095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:43755 (local address 127.0.0.1:43249)
0812 01:10:28.084259 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:28.084266 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:28.084616 (+ 350us) server_negotiation.cc:407] Connection header received
0812 01:10:28.084803 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:28.084810 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:28.084895 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:28.085007 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:28.087076 (+ 2069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:28.088350 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:28.090323 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:28.091050 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:28.091162 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:28.094585 (+ 3423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:28.094591 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:28.094595 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:28.094629 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:28.098283 (+ 3654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:28.099265 (+ 982us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:28.099270 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:28.099274 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:28.099419 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:28.099955 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:28.099960 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:28.099964 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:28.100376 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:28.100632 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:28.101107 (+ 475us) server_negotiation.cc:299] Negotiation successful
0812 01:10:28.101302 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 01:10:28.108306 7260 catalog_manager.cc:1347] Generated new cluster ID: 8d030fcb619047ecab4c7831de9a5d9f
I20260812 01:10:28.108407 7260 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:10:28.126257 7260 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:10:28.128129 7260 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:10:28.145869 7260 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5edc6fd843d04f3a899f18e8e8bc0b42: Generated new TSK 0
I20260812 01:10:28.146859 7260 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:10:28.158545 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 7091
I20260812 01:10:28.159617 7202 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:10:28.250581 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 7091
W20260812 01:10:28.272727 7060 connection.cc:535] client connection to 127.0.0.1:43249 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43249): Connection reset by peer (error 104)
2026-08-12T01:10:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2186 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:10:28 dist-test-slave-bndk krb5kdc[7275](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:10:28 dist-test-slave-bndk krb5kdc[7275](info): set up 2 sockets
Aug 12 01:10:28 dist-test-slave-bndk krb5kdc[7275](info): commencing operation
krb5kdc: starting...
W20260812 01:10:29.494314 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.203s user 0.002s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:10:29 dist-test-slave-bndk krb5kdc[7275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497029, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:10:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:10:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 01:10:29.800048 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36825
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36825
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:10:30.132849 7299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:30.133127 7299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:30.133291 7299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:30.140306 7299 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:10:30.140407 7299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:30.140480 7299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:30.140568 7299 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:10:30.140627 7299 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:10:30.150159 7299 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36825
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36825
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:30.151490 7299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:30.152787 7299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:30.164253 7307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:30.164345 7308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:30.164300 7312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:30.165095 7299 server_base.cc:1034] running on GCE node
I20260812 01:10:30.165876 7299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:30.167218 7299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:30.168426 7299 hybrid_clock.cc:648] HybridClock initialized: now 1786497030168373 us; error 40 us; skew 500 ppm
I20260812 01:10:30.168761 7299 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:10:30 dist-test-slave-bndk krb5kdc[7275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497030, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:10:30.178061 7299 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 01:10:30.179508 7299 webserver.cc:460] Webserver started at http://127.0.0.1:46389/ using document root <none> and password file <none>
I20260812 01:10:30.180169 7299 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:30.180266 7299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:30.180521 7299 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:30.183521 7299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "c73055861eb34a76b17edcdfe733b8a9"
format_stamp: "Formatted at 2026-08-12 01:10:30 on dist-test-slave-bndk"
server_key: "812996c896b2285c56ef0192dac4c06b"
server_key_iv: "e10453721a942d49faffdd7fce54d477"
server_key_version: "encryptionkey@0"
I20260812 01:10:30.184228 7299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "c73055861eb34a76b17edcdfe733b8a9"
format_stamp: "Formatted at 2026-08-12 01:10:30 on dist-test-slave-bndk"
server_key: "812996c896b2285c56ef0192dac4c06b"
server_key_iv: "e10453721a942d49faffdd7fce54d477"
server_key_version: "encryptionkey@0"
I20260812 01:10:30.189345 7299 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 01:10:30.192582 7323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:30.193866 7299 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:10:30.194033 7299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "c73055861eb34a76b17edcdfe733b8a9"
format_stamp: "Formatted at 2026-08-12 01:10:30 on dist-test-slave-bndk"
server_key: "812996c896b2285c56ef0192dac4c06b"
server_key_iv: "e10453721a942d49faffdd7fce54d477"
server_key_version: "encryptionkey@0"
I20260812 01:10:30.194198 7299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:30.211767 7299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:30.215415 7299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:30.215662 7299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:30.232614 7299 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36825
I20260812 01:10:30.232651 7404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36825 every 8 connection(s)
I20260812 01:10:30.233862 7299 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:10:30.236951 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 7299
I20260812 01:10:30.237099 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:10:30.237391 7406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:30.237601 4901 external_mini_cluster.cc:1428] Setting key ab03bce2bc9802767cc52bb8f0eeea41
I20260812 01:10:30.251595 7411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:30.239239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:33349 (local address 127.0.0.1:36825)
0812 01:10:30.240051 (+ 812us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:30.240066 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:30.240118 (+ 52us) server_negotiation.cc:407] Connection header received
0812 01:10:30.242077 (+ 1959us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:30.242106 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:30.242579 (+ 473us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:30.242996 (+ 417us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:30.243491 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:30.245435 (+ 1944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:30.246691 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:30.247673 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:30.247876 (+ 203us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:30.248944 (+ 1068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:30.248954 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:30.248975 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:30.249704 (+ 729us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:30.249804 (+ 100us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:30.249836 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:30.249975 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:30.250226 (+ 251us) server_negotiation.cc:299] Negotiation successful
0812 01:10:30.250395 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":574,"thread_start_us":318,"threads_started":1}
I20260812 01:10:30.251897 7406 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c73055861eb34a76b17edcdfe733b8a9: Bootstrap starting.
I20260812 01:10:30.254932 7406 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c73055861eb34a76b17edcdfe733b8a9: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:30.255136 4901 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:10:30.256095 7406 log.cc:824] T 00000000000000000000000000000000 P c73055861eb34a76b17edcdfe733b8a9: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:30.259176 7406 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c73055861eb34a76b17edcdfe733b8a9: No bootstrap required, opened a new log
I20260812 01:10:30.266595 7411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:30.260089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:52639 (local address 127.0.0.1:36825)
0812 01:10:30.260279 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:30.260285 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:30.260685 (+ 400us) server_negotiation.cc:407] Connection header received
0812 01:10:30.260864 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:30.260871 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:30.260933 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:30.261022 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:30.261588 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:30.262390 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:30.264222 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:30.264685 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:30.264779 (+ 94us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:30.265915 (+ 1136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:30.265920 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:30.265923 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:30.265942 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:30.265978 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:30.265992 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:30.266072 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:30.266240 (+ 168us) server_negotiation.cc:299] Negotiation successful
0812 01:10:30.266281 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 01:10:30.268360 7406 raft_consensus.cc:348] T 00000000000000000000000000000000 P c73055861eb34a76b17edcdfe733b8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c73055861eb34a76b17edcdfe733b8a9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36825 } }
I20260812 01:10:30.268680 7406 raft_consensus.cc:374] T 00000000000000000000000000000000 P c73055861eb34a76b17edcdfe733b8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:30.268750 7406 raft_consensus.cc:729] T 00000000000000000000000000000000 P c73055861eb34a76b17edcdfe733b8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c73055861eb34a76b17edcdfe733b8a9, State: Initialized, Role: FOLLOWER
I20260812 01:10:30.269250 7406 consensus_queue.cc:260] T 00000000000000000000000000000000 P c73055861eb34a76b17edcdfe733b8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c73055861eb34a76b17edcdfe733b8a9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36825 } }
I20260812 01:10:30.269465 7406 raft_consensus.cc:388] T 00000000000000000000000000000000 P c73055861eb34a76b17edcdfe733b8a9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:10:30.269562 7406 raft_consensus.cc:482] T 00000000000000000000000000000000 P c73055861eb34a76b17edcdfe733b8a9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:10:30.269677 7406 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c73055861eb34a76b17edcdfe733b8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:30.271744 7406 raft_consensus.cc:504] T 00000000000000000000000000000000 P c73055861eb34a76b17edcdfe733b8a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c73055861eb34a76b17edcdfe733b8a9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36825 } }
I20260812 01:10:30.272264 7406 leader_election.cc:302] T 00000000000000000000000000000000 P c73055861eb34a76b17edcdfe733b8a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c73055861eb34a76b17edcdfe733b8a9; no voters:
I20260812 01:10:30.272782 7406 leader_election.cc:288] T 00000000000000000000000000000000 P c73055861eb34a76b17edcdfe733b8a9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:10:30.272895 7422 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c73055861eb34a76b17edcdfe733b8a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:10:30.273554 7422 raft_consensus.cc:686] T 00000000000000000000000000000000 P c73055861eb34a76b17edcdfe733b8a9 [term 1 LEADER]: Becoming Leader. State: Replica: c73055861eb34a76b17edcdfe733b8a9, State: Running, Role: LEADER
I20260812 01:10:30.274057 7422 consensus_queue.cc:237] T 00000000000000000000000000000000 P c73055861eb34a76b17edcdfe733b8a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c73055861eb34a76b17edcdfe733b8a9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36825 } }
I20260812 01:10:30.274736 7406 sys_catalog.cc:564] T 00000000000000000000000000000000 P c73055861eb34a76b17edcdfe733b8a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:10:30.276917 7423 sys_catalog.cc:455] T 00000000000000000000000000000000 P c73055861eb34a76b17edcdfe733b8a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c73055861eb34a76b17edcdfe733b8a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c73055861eb34a76b17edcdfe733b8a9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36825 } } }
I20260812 01:10:30.277369 7423 sys_catalog.cc:458] T 00000000000000000000000000000000 P c73055861eb34a76b17edcdfe733b8a9 [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:30.277503 7424 sys_catalog.cc:455] T 00000000000000000000000000000000 P c73055861eb34a76b17edcdfe733b8a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c73055861eb34a76b17edcdfe733b8a9. Latest consensus state: current_term: 1 leader_uuid: "c73055861eb34a76b17edcdfe733b8a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c73055861eb34a76b17edcdfe733b8a9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36825 } } }
I20260812 01:10:30.277853 7424 sys_catalog.cc:458] T 00000000000000000000000000000000 P c73055861eb34a76b17edcdfe733b8a9 [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:30.285048 7452 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 01:10:30.285259 7433 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:10:30.289265 7433 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:10:30.297395 7433 catalog_manager.cc:1347] Generated new cluster ID: d08c47b97e764dcbab5a9d3822341dd6
I20260812 01:10:30.297510 7433 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:10:30.337250 7433 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:10:30.338538 7433 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:10:30.352572 7433 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c73055861eb34a76b17edcdfe733b8a9: Generated new TSK 0
I20260812 01:10:30.353487 7433 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:10:30.368738 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 7299
W20260812 01:10:30.370031 7400 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.55:33349
W20260812 01:10:30.370738 4901 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 7299: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 01:10:30.370864 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 7299
W20260812 01:10:30.395001 7273 connection.cc:535] client connection to 127.0.0.1:36825 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36825): Connection reset by peer (error 104)
2026-08-12T01:10:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2122 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:10:30 dist-test-slave-bndk krb5kdc[7458](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:10:30 dist-test-slave-bndk krb5kdc[7458](info): set up 2 sockets
Aug 12 01:10:30 dist-test-slave-bndk krb5kdc[7458](info): commencing operation
krb5kdc: starting...
W20260812 01:10:31.618129 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.204s user 0.006s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:10:31 dist-test-slave-bndk krb5kdc[7458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497031, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:10:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:10:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 01:10:31.928098 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46007
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46007
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:10:32.265508 7483 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:32.265802 7483 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:32.265947 7483 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:32.273106 7483 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:10:32.273239 7483 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:32.273322 7483 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:32.273416 7483 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:10:32.273475 7483 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:10:32.283277 7483 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46007
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46007
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:32.284597 7483 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:32.285948 7483 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:32.297451 7499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:32.297531 7496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:32.297561 7497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:32.298602 7483 server_base.cc:1034] running on GCE node
I20260812 01:10:32.299436 7483 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:32.300884 7483 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:32.302088 7483 hybrid_clock.cc:648] HybridClock initialized: now 1786497032302042 us; error 31 us; skew 500 ppm
I20260812 01:10:32.302435 7483 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:10:32 dist-test-slave-bndk krb5kdc[7458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497032, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:10:32.305595 7483 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 01:10:32.307080 7483 webserver.cc:460] Webserver started at http://127.0.0.1:38907/ using document root <none> and password file <none>
I20260812 01:10:32.307854 7483 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:32.307987 7483 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:32.308276 7483 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:32.311355 7483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "e104e2a8fa9540c0a68d0c8f33a953ff"
format_stamp: "Formatted at 2026-08-12 01:10:32 on dist-test-slave-bndk"
server_key: "76e4634733b4b8bc75ea70efc7ae1b01"
server_key_iv: "1bac063760b643b2b7eec22b836228b0"
server_key_version: "encryptionkey@0"
I20260812 01:10:32.312116 7483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "e104e2a8fa9540c0a68d0c8f33a953ff"
format_stamp: "Formatted at 2026-08-12 01:10:32 on dist-test-slave-bndk"
server_key: "76e4634733b4b8bc75ea70efc7ae1b01"
server_key_iv: "1bac063760b643b2b7eec22b836228b0"
server_key_version: "encryptionkey@0"
I20260812 01:10:32.317433 7483 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 01:10:32.320813 7517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:32.322206 7483 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:10:32.322372 7483 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "e104e2a8fa9540c0a68d0c8f33a953ff"
format_stamp: "Formatted at 2026-08-12 01:10:32 on dist-test-slave-bndk"
server_key: "76e4634733b4b8bc75ea70efc7ae1b01"
server_key_iv: "1bac063760b643b2b7eec22b836228b0"
server_key_version: "encryptionkey@0"
I20260812 01:10:32.322556 7483 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:32.330271 7483 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:32.334573 7483 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:32.334859 7483 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:32.351666 7483 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46007
I20260812 01:10:32.351709 7590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46007 every 8 connection(s)
I20260812 01:10:32.353048 7483 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:10:32.355212 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 7483
I20260812 01:10:32.355384 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:10:32.355839 4901 external_mini_cluster.cc:1428] Setting key 5cce496d199e92965fc05ac5ed84312b
I20260812 01:10:32.357270 7591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:32.364548 7596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:32.357638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:53935 (local address 127.0.0.1:46007)
0812 01:10:32.358456 (+ 818us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:32.358472 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:32.358527 (+ 55us) server_negotiation.cc:407] Connection header received
0812 01:10:32.360528 (+ 2001us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:32.360561 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:32.361051 (+ 490us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:32.361524 (+ 473us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:32.362521 (+ 997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:32.362530 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:32.362549 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:32.362579 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:32.362665 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:32.362692 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:32.362920 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:32.363062 (+ 142us) server_negotiation.cc:299] Negotiation successful
0812 01:10:32.363284 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":561,"thread_start_us":329,"threads_started":1}
I20260812 01:10:32.368678 4901 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:10:32.372558 7591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e104e2a8fa9540c0a68d0c8f33a953ff: Bootstrap starting.
I20260812 01:10:32.376633 7591 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e104e2a8fa9540c0a68d0c8f33a953ff: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:32.376706 7596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:32.374127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:45635 (local address 127.0.0.1:46007)
0812 01:10:32.374319 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:32.374325 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:32.374844 (+ 519us) server_negotiation.cc:407] Connection header received
0812 01:10:32.375027 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:32.375031 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:32.375081 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:32.375155 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:32.376094 (+ 939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:32.376098 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:32.376101 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:32.376117 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:32.376157 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:32.376172 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:32.376256 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:32.376378 (+ 122us) server_negotiation.cc:299] Negotiation successful
0812 01:10:32.376424 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 01:10:32.378023 7591 log.cc:824] T 00000000000000000000000000000000 P e104e2a8fa9540c0a68d0c8f33a953ff: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:32.380800 7591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e104e2a8fa9540c0a68d0c8f33a953ff: No bootstrap required, opened a new log
I20260812 01:10:32.388087 7591 raft_consensus.cc:348] T 00000000000000000000000000000000 P e104e2a8fa9540c0a68d0c8f33a953ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e104e2a8fa9540c0a68d0c8f33a953ff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46007 } }
I20260812 01:10:32.388464 7591 raft_consensus.cc:374] T 00000000000000000000000000000000 P e104e2a8fa9540c0a68d0c8f33a953ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:32.388564 7591 raft_consensus.cc:729] T 00000000000000000000000000000000 P e104e2a8fa9540c0a68d0c8f33a953ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e104e2a8fa9540c0a68d0c8f33a953ff, State: Initialized, Role: FOLLOWER
I20260812 01:10:32.389119 7591 consensus_queue.cc:260] T 00000000000000000000000000000000 P e104e2a8fa9540c0a68d0c8f33a953ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e104e2a8fa9540c0a68d0c8f33a953ff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46007 } }
I20260812 01:10:32.389398 7591 raft_consensus.cc:388] T 00000000000000000000000000000000 P e104e2a8fa9540c0a68d0c8f33a953ff [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:10:32.389539 7591 raft_consensus.cc:482] T 00000000000000000000000000000000 P e104e2a8fa9540c0a68d0c8f33a953ff [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:10:32.389703 7591 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e104e2a8fa9540c0a68d0c8f33a953ff [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:32.392012 7591 raft_consensus.cc:504] T 00000000000000000000000000000000 P e104e2a8fa9540c0a68d0c8f33a953ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e104e2a8fa9540c0a68d0c8f33a953ff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46007 } }
I20260812 01:10:32.392517 7591 leader_election.cc:302] T 00000000000000000000000000000000 P e104e2a8fa9540c0a68d0c8f33a953ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e104e2a8fa9540c0a68d0c8f33a953ff; no voters:
I20260812 01:10:32.393056 7591 leader_election.cc:288] T 00000000000000000000000000000000 P e104e2a8fa9540c0a68d0c8f33a953ff [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:10:32.393181 7603 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e104e2a8fa9540c0a68d0c8f33a953ff [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:10:32.393822 7603 raft_consensus.cc:686] T 00000000000000000000000000000000 P e104e2a8fa9540c0a68d0c8f33a953ff [term 1 LEADER]: Becoming Leader. State: Replica: e104e2a8fa9540c0a68d0c8f33a953ff, State: Running, Role: LEADER
I20260812 01:10:32.394325 7603 consensus_queue.cc:237] T 00000000000000000000000000000000 P e104e2a8fa9540c0a68d0c8f33a953ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e104e2a8fa9540c0a68d0c8f33a953ff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46007 } }
I20260812 01:10:32.395038 7591 sys_catalog.cc:564] T 00000000000000000000000000000000 P e104e2a8fa9540c0a68d0c8f33a953ff [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:10:32.397193 7605 sys_catalog.cc:455] T 00000000000000000000000000000000 P e104e2a8fa9540c0a68d0c8f33a953ff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e104e2a8fa9540c0a68d0c8f33a953ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e104e2a8fa9540c0a68d0c8f33a953ff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46007 } } }
I20260812 01:10:32.397168 7606 sys_catalog.cc:455] T 00000000000000000000000000000000 P e104e2a8fa9540c0a68d0c8f33a953ff [sys.catalog]: SysCatalogTable state changed. Reason: New leader e104e2a8fa9540c0a68d0c8f33a953ff. Latest consensus state: current_term: 1 leader_uuid: "e104e2a8fa9540c0a68d0c8f33a953ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e104e2a8fa9540c0a68d0c8f33a953ff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46007 } } }
I20260812 01:10:32.397643 7606 sys_catalog.cc:458] T 00000000000000000000000000000000 P e104e2a8fa9540c0a68d0c8f33a953ff [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:32.397643 7605 sys_catalog.cc:458] T 00000000000000000000000000000000 P e104e2a8fa9540c0a68d0c8f33a953ff [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:32.399222 7612 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:10:32.404618 7612 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:10:32.413311 7612 catalog_manager.cc:1347] Generated new cluster ID: 8e4715c7333740d3a73c066c7ee899c7
I20260812 01:10:32.413409 7612 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:10:32.422868 7612 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:10:32.423259 7612 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:10:32.437552 7612 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e104e2a8fa9540c0a68d0c8f33a953ff: Generated new TSK 0
I20260812 01:10:32.438282 7612 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:10:32.444959 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 7483
W20260812 01:10:32.446035 7585 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.55:53935
W20260812 01:10:32.446682 4901 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 7483: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 01:10:32.446802 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 7483
2026-08-12T01:10:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2077 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:10:32 dist-test-slave-bndk krb5kdc[7641](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:10:32 dist-test-slave-bndk krb5kdc[7641](info): set up 2 sockets
Aug 12 01:10:32 dist-test-slave-bndk krb5kdc[7641](info): commencing operation
krb5kdc: starting...
W20260812 01:10:33.698607 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.208s user 0.000s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:10:33 dist-test-slave-bndk krb5kdc[7641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:10:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:10:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 01:10:34.000761 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45989
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45989
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:10:34.349171 7667 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:34.349475 7667 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:34.349581 7667 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:34.356797 7667 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:10:34.356925 7667 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:34.356987 7667 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:34.357049 7667 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:10:34.357093 7667 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:10:34.366979 7667 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45989
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45989
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:34.368256 7667 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:34.369594 7667 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:34.380869 7674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:34.380980 7673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:34.380873 7679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:34.381757 7667 server_base.cc:1034] running on GCE node
I20260812 01:10:34.382467 7667 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:34.383837 7667 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:34.385033 7667 hybrid_clock.cc:648] HybridClock initialized: now 1786497034384980 us; error 44 us; skew 500 ppm
I20260812 01:10:34.385380 7667 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:10:34 dist-test-slave-bndk krb5kdc[7641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497034, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:10:34.388362 7667 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 01:10:34.389771 7667 webserver.cc:460] Webserver started at http://127.0.0.1:45551/ using document root <none> and password file <none>
I20260812 01:10:34.390445 7667 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:34.390568 7667 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:34.390859 7667 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:34.393832 7667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "08fa74e92bbb42c9a3cafc2c883860c6"
format_stamp: "Formatted at 2026-08-12 01:10:34 on dist-test-slave-bndk"
server_key: "e09a3bdd8382b4d50c3a70af87a67891"
server_key_iv: "332ce27400cf63d39cbbe28c073d96ad"
server_key_version: "encryptionkey@0"
I20260812 01:10:34.394582 7667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "08fa74e92bbb42c9a3cafc2c883860c6"
format_stamp: "Formatted at 2026-08-12 01:10:34 on dist-test-slave-bndk"
server_key: "e09a3bdd8382b4d50c3a70af87a67891"
server_key_iv: "332ce27400cf63d39cbbe28c073d96ad"
server_key_version: "encryptionkey@0"
I20260812 01:10:34.399530 7667 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260812 01:10:34.402906 7694 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:34.404139 7667 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 01:10:34.404296 7667 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "08fa74e92bbb42c9a3cafc2c883860c6"
format_stamp: "Formatted at 2026-08-12 01:10:34 on dist-test-slave-bndk"
server_key: "e09a3bdd8382b4d50c3a70af87a67891"
server_key_iv: "332ce27400cf63d39cbbe28c073d96ad"
server_key_version: "encryptionkey@0"
I20260812 01:10:34.404479 7667 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:34.440416 7667 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:34.444412 7667 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:34.444669 7667 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:34.461452 7667 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45989
I20260812 01:10:34.461464 7766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45989 every 8 connection(s)
I20260812 01:10:34.462791 7667 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:10:34.465927 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 7667
I20260812 01:10:34.466085 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:10:34.466517 4901 external_mini_cluster.cc:1428] Setting key cab011f7a9a89eff26105a85ad8c52bb
I20260812 01:10:34.466879 7767 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 12 01:10:34 dist-test-slave-bndk krb5kdc[7641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 01:10:34.480908 7767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08fa74e92bbb42c9a3cafc2c883860c6: Bootstrap starting.
I20260812 01:10:34.484031 7767 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 08fa74e92bbb42c9a3cafc2c883860c6: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:34.485074 7767 log.cc:824] T 00000000000000000000000000000000 P 08fa74e92bbb42c9a3cafc2c883860c6: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:34.487957 7767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08fa74e92bbb42c9a3cafc2c883860c6: No bootstrap required, opened a new log
I20260812 01:10:34.488617 7770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:34.468259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:43371 (local address 127.0.0.1:45989)
0812 01:10:34.469029 (+ 770us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:34.469045 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:34.469095 (+ 50us) server_negotiation.cc:407] Connection header received
0812 01:10:34.470725 (+ 1630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:34.470754 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:34.471279 (+ 525us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:34.471722 (+ 443us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:34.473021 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:34.475044 (+ 2023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:34.476258 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:34.477284 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:34.477467 (+ 183us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:34.481481 (+ 4014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:34.481490 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:34.481504 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:34.481545 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:34.484479 (+ 2934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:34.485295 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:34.485301 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:34.485309 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:34.485480 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:34.485944 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:34.485948 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:34.485950 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:34.486484 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:34.486778 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:34.487311 (+ 533us) server_negotiation.cc:299] Negotiation successful
0812 01:10:34.487638 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":530,"thread_start_us":300,"threads_started":1}
I20260812 01:10:34.492563 4901 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:10:34.496140 7767 raft_consensus.cc:348] T 00000000000000000000000000000000 P 08fa74e92bbb42c9a3cafc2c883860c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08fa74e92bbb42c9a3cafc2c883860c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45989 } }
I20260812 01:10:34.496556 7767 raft_consensus.cc:374] T 00000000000000000000000000000000 P 08fa74e92bbb42c9a3cafc2c883860c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:34.496707 7767 raft_consensus.cc:729] T 00000000000000000000000000000000 P 08fa74e92bbb42c9a3cafc2c883860c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08fa74e92bbb42c9a3cafc2c883860c6, State: Initialized, Role: FOLLOWER
I20260812 01:10:34.497395 7767 consensus_queue.cc:260] T 00000000000000000000000000000000 P 08fa74e92bbb42c9a3cafc2c883860c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08fa74e92bbb42c9a3cafc2c883860c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45989 } }
I20260812 01:10:34.497637 7767 raft_consensus.cc:388] T 00000000000000000000000000000000 P 08fa74e92bbb42c9a3cafc2c883860c6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:10:34.497768 7767 raft_consensus.cc:482] T 00000000000000000000000000000000 P 08fa74e92bbb42c9a3cafc2c883860c6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:10:34.497920 7767 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 08fa74e92bbb42c9a3cafc2c883860c6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:34.500499 7767 raft_consensus.cc:504] T 00000000000000000000000000000000 P 08fa74e92bbb42c9a3cafc2c883860c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08fa74e92bbb42c9a3cafc2c883860c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45989 } }
I20260812 01:10:34.501010 7767 leader_election.cc:302] T 00000000000000000000000000000000 P 08fa74e92bbb42c9a3cafc2c883860c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 08fa74e92bbb42c9a3cafc2c883860c6; no voters:
I20260812 01:10:34.501684 7767 leader_election.cc:288] T 00000000000000000000000000000000 P 08fa74e92bbb42c9a3cafc2c883860c6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:10:34.501804 7785 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 08fa74e92bbb42c9a3cafc2c883860c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:10:34.503707 7767 sys_catalog.cc:564] T 00000000000000000000000000000000 P 08fa74e92bbb42c9a3cafc2c883860c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:10:34.508777 7785 raft_consensus.cc:686] T 00000000000000000000000000000000 P 08fa74e92bbb42c9a3cafc2c883860c6 [term 1 LEADER]: Becoming Leader. State: Replica: 08fa74e92bbb42c9a3cafc2c883860c6, State: Running, Role: LEADER
I20260812 01:10:34.509528 7785 consensus_queue.cc:237] T 00000000000000000000000000000000 P 08fa74e92bbb42c9a3cafc2c883860c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08fa74e92bbb42c9a3cafc2c883860c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45989 } }
I20260812 01:10:34.512884 7786 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08fa74e92bbb42c9a3cafc2c883860c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "08fa74e92bbb42c9a3cafc2c883860c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08fa74e92bbb42c9a3cafc2c883860c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45989 } } }
I20260812 01:10:34.513314 7786 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08fa74e92bbb42c9a3cafc2c883860c6 [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:34.513820 7787 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08fa74e92bbb42c9a3cafc2c883860c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 08fa74e92bbb42c9a3cafc2c883860c6. Latest consensus state: current_term: 1 leader_uuid: "08fa74e92bbb42c9a3cafc2c883860c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08fa74e92bbb42c9a3cafc2c883860c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45989 } } }
I20260812 01:10:34.514120 7787 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08fa74e92bbb42c9a3cafc2c883860c6 [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:34.514775 7770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:34.496786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:58299 (local address 127.0.0.1:45989)
0812 01:10:34.496942 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:34.496947 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:34.497415 (+ 468us) server_negotiation.cc:407] Connection header received
0812 01:10:34.497597 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:34.497602 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:34.497679 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:34.497769 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:34.499281 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:34.500414 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:34.501904 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:34.502681 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:34.502810 (+ 129us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:34.506230 (+ 3420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:34.506237 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:34.506243 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:34.506285 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:34.510278 (+ 3993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:34.511454 (+ 1176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:34.511459 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:34.511463 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:34.511642 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:34.512295 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:34.512300 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:34.512303 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:34.512696 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:34.514010 (+ 1314us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:34.514216 (+ 206us) server_negotiation.cc:299] Negotiation successful
0812 01:10:34.514393 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 01:10:34.518154 7815 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 01:10:34.518329 7816 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:10:34.522321 7816 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:10:34.529688 7816 catalog_manager.cc:1347] Generated new cluster ID: 4276a2dd5cf849ab8e973bcd8b12736a
I20260812 01:10:34.529788 7816 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:10:34.545758 7816 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:10:34.547521 7816 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:10:34.556628 7816 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 08fa74e92bbb42c9a3cafc2c883860c6: Generated new TSK 0
I20260812 01:10:34.557610 7816 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:10:34.569679 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 7667
I20260812 01:10:34.571311 7761 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:10:34.661188 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 7667
W20260812 01:10:34.686901 7636 connection.cc:535] client connection to 127.0.0.1:45989 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45989): Connection reset by peer (error 104)
2026-08-12T01:10:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2219 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:10:34 dist-test-slave-bndk krb5kdc[7831](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:10:34 dist-test-slave-bndk krb5kdc[7831](info): set up 2 sockets
Aug 12 01:10:34 dist-test-slave-bndk krb5kdc[7831](info): commencing operation
krb5kdc: starting...
W20260812 01:10:35.934165 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.224s user 0.000s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:10:36 dist-test-slave-bndk krb5kdc[7831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497036, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:10:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:10:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 01:10:36.242355 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42905
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42905
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:10:36.584030 7851 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:36.584342 7851 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:36.584446 7851 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:36.591675 7851 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:10:36.591780 7851 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:36.591833 7851 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:36.591894 7851 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:10:36.591936 7851 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:10:36.601775 7851 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42905
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:36.603072 7851 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:36.604622 7851 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:36.616343 7859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:36.616343 7861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:36.616377 7864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:36.617182 7851 server_base.cc:1034] running on GCE node
I20260812 01:10:36.618016 7851 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:36.619513 7851 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:36.620726 7851 hybrid_clock.cc:648] HybridClock initialized: now 1786497036620684 us; error 40 us; skew 500 ppm
I20260812 01:10:36.621099 7851 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:10:36 dist-test-slave-bndk krb5kdc[7831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497036, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:10:36.627521 7851 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 01:10:36.629027 7851 webserver.cc:460] Webserver started at http://127.0.0.1:43761/ using document root <none> and password file <none>
I20260812 01:10:36.629769 7851 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:36.629894 7851 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:36.630203 7851 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:36.633368 7851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "6076bbffc8824d5cbc4a89b78611ecf1"
format_stamp: "Formatted at 2026-08-12 01:10:36 on dist-test-slave-bndk"
server_key: "813d61e7b3bdbc86bd51c8d43069d7f1"
server_key_iv: "6e58d200f7382b9220e861f6d07b8e4a"
server_key_version: "encryptionkey@0"
I20260812 01:10:36.634174 7851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "6076bbffc8824d5cbc4a89b78611ecf1"
format_stamp: "Formatted at 2026-08-12 01:10:36 on dist-test-slave-bndk"
server_key: "813d61e7b3bdbc86bd51c8d43069d7f1"
server_key_iv: "6e58d200f7382b9220e861f6d07b8e4a"
server_key_version: "encryptionkey@0"
I20260812 01:10:36.639330 7851 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 01:10:36.642830 7878 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:36.644120 7851 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 01:10:36.644279 7851 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "6076bbffc8824d5cbc4a89b78611ecf1"
format_stamp: "Formatted at 2026-08-12 01:10:36 on dist-test-slave-bndk"
server_key: "813d61e7b3bdbc86bd51c8d43069d7f1"
server_key_iv: "6e58d200f7382b9220e861f6d07b8e4a"
server_key_version: "encryptionkey@0"
I20260812 01:10:36.644460 7851 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:36.657521 7851 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:36.661916 7851 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:36.662192 7851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:36.679744 7851 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42905
I20260812 01:10:36.679775 7957 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42905 every 8 connection(s)
I20260812 01:10:36.681150 7851 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:10:36.681572 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 7851
I20260812 01:10:36.681730 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:10:36.682324 4901 external_mini_cluster.cc:1428] Setting key ab174bcd999796ac977be2fe1a43fddb
I20260812 01:10:36.685706 7958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:36.695772 7966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:36.684247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:47815 (local address 127.0.0.1:42905)
0812 01:10:36.685025 (+ 778us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:36.685037 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:36.685078 (+ 41us) server_negotiation.cc:407] Connection header received
0812 01:10:36.686802 (+ 1724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:36.686825 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:36.687188 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:36.687554 (+ 366us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:36.688093 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:36.689455 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:36.690786 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:36.691442 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:36.691630 (+ 188us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:36.692779 (+ 1149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:36.692787 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:36.692799 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:36.693422 (+ 623us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:36.693536 (+ 114us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:36.693577 (+ 41us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:36.693765 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:36.694344 (+ 579us) server_negotiation.cc:299] Negotiation successful
0812 01:10:36.694514 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":554,"thread_start_us":349,"threads_started":1}
I20260812 01:10:36.697412 7958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6076bbffc8824d5cbc4a89b78611ecf1: Bootstrap starting.
I20260812 01:10:36.699636 4901 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:10:36.700656 7958 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6076bbffc8824d5cbc4a89b78611ecf1: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:36.701678 7958 log.cc:824] T 00000000000000000000000000000000 P 6076bbffc8824d5cbc4a89b78611ecf1: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:36.704465 7958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6076bbffc8824d5cbc4a89b78611ecf1: No bootstrap required, opened a new log
I20260812 01:10:36.710613 7966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:36.703767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:36349 (local address 127.0.0.1:42905)
0812 01:10:36.703948 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:36.703955 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:36.704454 (+ 499us) server_negotiation.cc:407] Connection header received
0812 01:10:36.704648 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:36.704652 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:36.704712 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:36.704787 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:36.705423 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:36.706214 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:36.708025 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:36.708541 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:36.708655 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:36.709883 (+ 1228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:36.709888 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:36.709891 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:36.709907 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:36.709949 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:36.709965 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:36.710065 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:36.710252 (+ 187us) server_negotiation.cc:299] Negotiation successful
0812 01:10:36.710296 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 01:10:36.713527 7958 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6076bbffc8824d5cbc4a89b78611ecf1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6076bbffc8824d5cbc4a89b78611ecf1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42905 } }
I20260812 01:10:36.713937 7958 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6076bbffc8824d5cbc4a89b78611ecf1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:36.714030 7958 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6076bbffc8824d5cbc4a89b78611ecf1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6076bbffc8824d5cbc4a89b78611ecf1, State: Initialized, Role: FOLLOWER
I20260812 01:10:36.714569 7958 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6076bbffc8824d5cbc4a89b78611ecf1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6076bbffc8824d5cbc4a89b78611ecf1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42905 } }
I20260812 01:10:36.714797 7958 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6076bbffc8824d5cbc4a89b78611ecf1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:10:36.714936 7958 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6076bbffc8824d5cbc4a89b78611ecf1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:10:36.715126 7958 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6076bbffc8824d5cbc4a89b78611ecf1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:36.717195 7958 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6076bbffc8824d5cbc4a89b78611ecf1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6076bbffc8824d5cbc4a89b78611ecf1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42905 } }
I20260812 01:10:36.717691 7958 leader_election.cc:302] T 00000000000000000000000000000000 P 6076bbffc8824d5cbc4a89b78611ecf1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6076bbffc8824d5cbc4a89b78611ecf1; no voters:
I20260812 01:10:36.718186 7958 leader_election.cc:288] T 00000000000000000000000000000000 P 6076bbffc8824d5cbc4a89b78611ecf1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:10:36.718307 7977 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6076bbffc8824d5cbc4a89b78611ecf1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:10:36.718968 7977 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6076bbffc8824d5cbc4a89b78611ecf1 [term 1 LEADER]: Becoming Leader. State: Replica: 6076bbffc8824d5cbc4a89b78611ecf1, State: Running, Role: LEADER
I20260812 01:10:36.719501 7977 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6076bbffc8824d5cbc4a89b78611ecf1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6076bbffc8824d5cbc4a89b78611ecf1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42905 } }
I20260812 01:10:36.720086 7958 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6076bbffc8824d5cbc4a89b78611ecf1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:10:36.722312 7980 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6076bbffc8824d5cbc4a89b78611ecf1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6076bbffc8824d5cbc4a89b78611ecf1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6076bbffc8824d5cbc4a89b78611ecf1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42905 } } }
I20260812 01:10:36.722697 7980 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6076bbffc8824d5cbc4a89b78611ecf1 [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:36.722678 7982 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6076bbffc8824d5cbc4a89b78611ecf1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6076bbffc8824d5cbc4a89b78611ecf1. Latest consensus state: current_term: 1 leader_uuid: "6076bbffc8824d5cbc4a89b78611ecf1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6076bbffc8824d5cbc4a89b78611ecf1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42905 } } }
I20260812 01:10:36.722992 7982 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6076bbffc8824d5cbc4a89b78611ecf1 [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:36.724699 7987 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:10:36.730276 7987 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:10:36.739037 7987 catalog_manager.cc:1347] Generated new cluster ID: e134e4ccb37b47e2bfcc99c85f86c005
I20260812 01:10:36.739140 7987 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:10:36.753336 7987 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:10:36.755084 7987 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:10:36.768519 7987 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6076bbffc8824d5cbc4a89b78611ecf1: Generated new TSK 0
I20260812 01:10:36.769641 7987 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:10:36.774675 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 7851
W20260812 01:10:36.776176 7950 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.55:47815
W20260812 01:10:36.776921 4901 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 7851: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 01:10:36.777081 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 7851
W20260812 01:10:36.802158 7829 connection.cc:535] client connection to 127.0.0.1:42905 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42905): Connection reset by peer (error 104)
2026-08-12T01:10:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2110 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:10:36 dist-test-slave-bndk krb5kdc[8015](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:10:36 dist-test-slave-bndk krb5kdc[8015](info): set up 2 sockets
Aug 12 01:10:36 dist-test-slave-bndk krb5kdc[8015](info): commencing operation
krb5kdc: starting...
W20260812 01:10:38.027077 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.206s user 0.001s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:10:38 dist-test-slave-bndk krb5kdc[8015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497038, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:10:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:10:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 01:10:38.321820 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41139
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41139
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:10:38.658579 8034 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:38.658886 8034 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:38.659032 8034 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:38.666115 8034 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:10:38.666240 8034 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:38.666322 8034 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:38.666409 8034 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:10:38.666471 8034 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:10:38.676400 8034 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41139
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786496689953932-4901-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41139
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:38.677767 8034 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:38.679088 8034 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:38.690394 8044 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:38.690435 8043 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:38.690459 8050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:38.691349 8034 server_base.cc:1034] running on GCE node
I20260812 01:10:38.692070 8034 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:38.693437 8034 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:38.694643 8034 hybrid_clock.cc:648] HybridClock initialized: now 1786497038694604 us; error 29 us; skew 500 ppm
I20260812 01:10:38.694978 8034 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:10:38 dist-test-slave-bndk krb5kdc[8015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497038, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:10:38.697956 8034 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 01:10:38.699556 8034 webserver.cc:460] Webserver started at http://127.0.0.1:32923/ using document root <none> and password file <none>
I20260812 01:10:38.700340 8034 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:38.700482 8034 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:38.700856 8034 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:38.704049 8034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "724956e4a39342ea8e92ad1d15f7f98d"
format_stamp: "Formatted at 2026-08-12 01:10:38 on dist-test-slave-bndk"
server_key: "60b0d4db5e1c17b1b990d112f2333fd3"
server_key_iv: "bd4f91ae6d1cfab7a60a90a6cd122ec6"
server_key_version: "encryptionkey@0"
I20260812 01:10:38.704810 8034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "724956e4a39342ea8e92ad1d15f7f98d"
format_stamp: "Formatted at 2026-08-12 01:10:38 on dist-test-slave-bndk"
server_key: "60b0d4db5e1c17b1b990d112f2333fd3"
server_key_iv: "bd4f91ae6d1cfab7a60a90a6cd122ec6"
server_key_version: "encryptionkey@0"
I20260812 01:10:38.710045 8034 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260812 01:10:38.713496 8058 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:38.714747 8034 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 01:10:38.714929 8034 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "724956e4a39342ea8e92ad1d15f7f98d"
format_stamp: "Formatted at 2026-08-12 01:10:38 on dist-test-slave-bndk"
server_key: "60b0d4db5e1c17b1b990d112f2333fd3"
server_key_iv: "bd4f91ae6d1cfab7a60a90a6cd122ec6"
server_key_version: "encryptionkey@0"
I20260812 01:10:38.715109 8034 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:38.720753 8034 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:38.724623 8034 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:38.724893 8034 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:38.741765 8034 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41139
I20260812 01:10:38.741818 8139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41139 every 8 connection(s)
I20260812 01:10:38.743088 8034 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:10:38.746703 8140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:38.750665 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 8034
I20260812 01:10:38.750860 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:10:38.751421 4901 external_mini_cluster.cc:1428] Setting key 4a9afef174363d9b93bafb38d81915f9
I20260812 01:10:38.758693 8145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:38.753235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:56129 (local address 127.0.0.1:41139)
0812 01:10:38.753940 (+ 705us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:38.753951 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:38.753994 (+ 43us) server_negotiation.cc:407] Connection header received
0812 01:10:38.755549 (+ 1555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:38.755571 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:38.755892 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:38.756234 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:38.757186 (+ 952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:38.757192 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:38.757204 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:38.757236 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:38.757311 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:38.757337 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:38.757552 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:38.757682 (+ 130us) server_negotiation.cc:299] Negotiation successful
0812 01:10:38.757854 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":505,"thread_start_us":282,"threads_started":1}
I20260812 01:10:38.759027 8140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 724956e4a39342ea8e92ad1d15f7f98d: Bootstrap starting.
I20260812 01:10:38.762328 4901 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:10:38.762622 8140 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 724956e4a39342ea8e92ad1d15f7f98d: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:38.763592 8140 log.cc:824] T 00000000000000000000000000000000 P 724956e4a39342ea8e92ad1d15f7f98d: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:38.766702 8140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 724956e4a39342ea8e92ad1d15f7f98d: No bootstrap required, opened a new log
I20260812 01:10:38.768718 8145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:38.766478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:34685 (local address 127.0.0.1:41139)
0812 01:10:38.766628 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:38.766634 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:38.767015 (+ 381us) server_negotiation.cc:407] Connection header received
0812 01:10:38.767151 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:38.767156 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:38.767210 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:38.767318 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:38.768100 (+ 782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:38.768106 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:38.768111 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:38.768128 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:38.768172 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:38.768191 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:38.768312 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:38.768357 (+ 45us) server_negotiation.cc:299] Negotiation successful
0812 01:10:38.768414 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 01:10:38.774310 8140 raft_consensus.cc:348] T 00000000000000000000000000000000 P 724956e4a39342ea8e92ad1d15f7f98d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "724956e4a39342ea8e92ad1d15f7f98d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41139 } }
I20260812 01:10:38.774638 8140 raft_consensus.cc:374] T 00000000000000000000000000000000 P 724956e4a39342ea8e92ad1d15f7f98d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:38.774742 8140 raft_consensus.cc:729] T 00000000000000000000000000000000 P 724956e4a39342ea8e92ad1d15f7f98d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 724956e4a39342ea8e92ad1d15f7f98d, State: Initialized, Role: FOLLOWER
I20260812 01:10:38.775278 8140 consensus_queue.cc:260] T 00000000000000000000000000000000 P 724956e4a39342ea8e92ad1d15f7f98d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "724956e4a39342ea8e92ad1d15f7f98d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41139 } }
I20260812 01:10:38.775499 8140 raft_consensus.cc:388] T 00000000000000000000000000000000 P 724956e4a39342ea8e92ad1d15f7f98d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:10:38.775633 8140 raft_consensus.cc:482] T 00000000000000000000000000000000 P 724956e4a39342ea8e92ad1d15f7f98d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:10:38.775790 8140 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 724956e4a39342ea8e92ad1d15f7f98d [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:38.777927 8140 raft_consensus.cc:504] T 00000000000000000000000000000000 P 724956e4a39342ea8e92ad1d15f7f98d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "724956e4a39342ea8e92ad1d15f7f98d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41139 } }
I20260812 01:10:38.778410 8140 leader_election.cc:302] T 00000000000000000000000000000000 P 724956e4a39342ea8e92ad1d15f7f98d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 724956e4a39342ea8e92ad1d15f7f98d; no voters:
I20260812 01:10:38.779038 8140 leader_election.cc:288] T 00000000000000000000000000000000 P 724956e4a39342ea8e92ad1d15f7f98d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:10:38.779132 8160 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 724956e4a39342ea8e92ad1d15f7f98d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:10:38.779804 8160 raft_consensus.cc:686] T 00000000000000000000000000000000 P 724956e4a39342ea8e92ad1d15f7f98d [term 1 LEADER]: Becoming Leader. State: Replica: 724956e4a39342ea8e92ad1d15f7f98d, State: Running, Role: LEADER
I20260812 01:10:38.780308 8160 consensus_queue.cc:237] T 00000000000000000000000000000000 P 724956e4a39342ea8e92ad1d15f7f98d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "724956e4a39342ea8e92ad1d15f7f98d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41139 } }
I20260812 01:10:38.781039 8140 sys_catalog.cc:564] T 00000000000000000000000000000000 P 724956e4a39342ea8e92ad1d15f7f98d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:10:38.783183 8163 sys_catalog.cc:455] T 00000000000000000000000000000000 P 724956e4a39342ea8e92ad1d15f7f98d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "724956e4a39342ea8e92ad1d15f7f98d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "724956e4a39342ea8e92ad1d15f7f98d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41139 } } }
I20260812 01:10:38.783654 8163 sys_catalog.cc:458] T 00000000000000000000000000000000 P 724956e4a39342ea8e92ad1d15f7f98d [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:38.784039 8165 sys_catalog.cc:455] T 00000000000000000000000000000000 P 724956e4a39342ea8e92ad1d15f7f98d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 724956e4a39342ea8e92ad1d15f7f98d. Latest consensus state: current_term: 1 leader_uuid: "724956e4a39342ea8e92ad1d15f7f98d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "724956e4a39342ea8e92ad1d15f7f98d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41139 } } }
I20260812 01:10:38.784437 8165 sys_catalog.cc:458] T 00000000000000000000000000000000 P 724956e4a39342ea8e92ad1d15f7f98d [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:38.785352 8175 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:10:38.790723 8175 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:10:38.799014 8175 catalog_manager.cc:1347] Generated new cluster ID: 9f8d339eaf1b4db68da0cb540efa3842
I20260812 01:10:38.799126 8175 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:10:38.820672 8175 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:10:38.821152 8175 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:10:38.829929 8175 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 724956e4a39342ea8e92ad1d15f7f98d: Generated new TSK 0
I20260812 01:10:38.830890 8175 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:10:38.843854 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 8034
W20260812 01:10:38.847920 8132 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.55:56129
W20260812 01:10:38.849152 4901 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 8034: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 01:10:38.849318 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 8034
2026-08-12T01:10:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2072 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:10:38 dist-test-slave-bndk krb5kdc[8198](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:10:38 dist-test-slave-bndk krb5kdc[8198](info): set up 2 sockets
Aug 12 01:10:38 dist-test-slave-bndk krb5kdc[8198](info): commencing operation
krb5kdc: starting...
W20260812 01:10:40.088927 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.195s user 0.000s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:10:40 dist-test-slave-bndk krb5kdc[8198](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:10:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:10:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.201.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
I20260812 01:10:40.386714 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:44785
--webserver_interface=127.4.201.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:36559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:44785
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:10:40.724786 8215 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:40.725066 8215 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:40.725205 8215 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:40.732393 8215 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:10:40.732509 8215 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:40.732589 8215 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:40.732668 8215 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:10:40.732730 8215 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:10:40.742475 8215 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:36559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:44785
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:44785
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:40.743686 8215 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:40.744966 8215 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:40.756043 8227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:40.756080 8229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:40.756120 8231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:40.756912 8215 server_base.cc:1034] running on GCE node
I20260812 01:10:40.757660 8215 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:40.758939 8215 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:40.760140 8215 hybrid_clock.cc:648] HybridClock initialized: now 1786497040760094 us; error 39 us; skew 500 ppm
I20260812 01:10:40.760462 8215 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:10:40 dist-test-slave-bndk krb5kdc[8198](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497040, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:10:40.763471 8215 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:10:40.764961 8215 webserver.cc:460] Webserver started at http://127.4.201.126:38295/ using document root <none> and password file <none>
I20260812 01:10:40.765671 8215 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:40.765797 8215 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:40.766098 8215 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:40.769016 8215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "ce5981efeb244436bd554bf006e84638"
format_stamp: "Formatted at 2026-08-12 01:10:40 on dist-test-slave-bndk"
server_key: "414e821c214985923bb98b173a1a9d3f"
server_key_iv: "39ab98c37803160287b9b590ada8e841"
server_key_version: "encryptionkey@0"
I20260812 01:10:40.769824 8215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "ce5981efeb244436bd554bf006e84638"
format_stamp: "Formatted at 2026-08-12 01:10:40 on dist-test-slave-bndk"
server_key: "414e821c214985923bb98b173a1a9d3f"
server_key_iv: "39ab98c37803160287b9b590ada8e841"
server_key_version: "encryptionkey@0"
I20260812 01:10:40.774755 8215 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 01:10:40.778097 8239 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:40.779320 8215 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 01:10:40.779491 8215 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "ce5981efeb244436bd554bf006e84638"
format_stamp: "Formatted at 2026-08-12 01:10:40 on dist-test-slave-bndk"
server_key: "414e821c214985923bb98b173a1a9d3f"
server_key_iv: "39ab98c37803160287b9b590ada8e841"
server_key_version: "encryptionkey@0"
I20260812 01:10:40.779665 8215 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:40.811115 8215 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:40.815033 8215 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:40.815294 8215 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:40.832764 8215 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:44785
I20260812 01:10:40.832784 8333 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:44785 every 8 connection(s)
I20260812 01:10:40.834107 8215 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:10:40.836223 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 8215
I20260812 01:10:40.836383 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:10:40.836835 4901 external_mini_cluster.cc:1428] Setting key 6b64a8360b63afb81193a13d1030b715
I20260812 01:10:40.838106 8334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 12 01:10:40 dist-test-slave-bndk krb5kdc[8198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:10:40.851672 8334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce5981efeb244436bd554bf006e84638: Bootstrap starting.
I20260812 01:10:40.855605 8334 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce5981efeb244436bd554bf006e84638: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:40.856822 8334 log.cc:824] T 00000000000000000000000000000000 P ce5981efeb244436bd554bf006e84638: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:40.860147 8334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce5981efeb244436bd554bf006e84638: No bootstrap required, opened a new log
I20260812 01:10:40.860610 8337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:40.838597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55053 (local address 127.4.201.126:44785)
0812 01:10:40.839432 (+ 835us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:40.839447 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:40.839508 (+ 61us) server_negotiation.cc:407] Connection header received
0812 01:10:40.841419 (+ 1911us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:40.841448 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:40.841958 (+ 510us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:40.842388 (+ 430us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:40.843667 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:40.845727 (+ 2060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:40.846927 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:40.847929 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:40.848110 (+ 181us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:40.852335 (+ 4225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:40.852346 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:40.852364 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:40.852408 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:40.856234 (+ 3826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:40.856967 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:40.856975 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:40.856984 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:40.857183 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:40.857694 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:40.857697 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:40.857699 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:40.858268 (+ 569us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:40.858575 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:40.858984 (+ 409us) server_negotiation.cc:299] Negotiation successful
0812 01:10:40.859303 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":594,"thread_start_us":342,"threads_started":1}
I20260812 01:10:40.864332 4901 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:10:40.867956 8334 raft_consensus.cc:348] T 00000000000000000000000000000000 P ce5981efeb244436bd554bf006e84638 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5981efeb244436bd554bf006e84638" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44785 } }
I20260812 01:10:40.868309 8334 raft_consensus.cc:374] T 00000000000000000000000000000000 P ce5981efeb244436bd554bf006e84638 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:40.868427 8334 raft_consensus.cc:729] T 00000000000000000000000000000000 P ce5981efeb244436bd554bf006e84638 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce5981efeb244436bd554bf006e84638, State: Initialized, Role: FOLLOWER
I20260812 01:10:40.869076 8334 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce5981efeb244436bd554bf006e84638 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5981efeb244436bd554bf006e84638" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44785 } }
I20260812 01:10:40.869385 8334 raft_consensus.cc:388] T 00000000000000000000000000000000 P ce5981efeb244436bd554bf006e84638 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:10:40.869534 8334 raft_consensus.cc:482] T 00000000000000000000000000000000 P ce5981efeb244436bd554bf006e84638 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:10:40.869720 8334 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ce5981efeb244436bd554bf006e84638 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:40.872440 8334 raft_consensus.cc:504] T 00000000000000000000000000000000 P ce5981efeb244436bd554bf006e84638 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5981efeb244436bd554bf006e84638" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44785 } }
I20260812 01:10:40.873000 8334 leader_election.cc:302] T 00000000000000000000000000000000 P ce5981efeb244436bd554bf006e84638 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ce5981efeb244436bd554bf006e84638; no voters:
I20260812 01:10:40.873649 8334 leader_election.cc:288] T 00000000000000000000000000000000 P ce5981efeb244436bd554bf006e84638 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:10:40.873737 8347 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ce5981efeb244436bd554bf006e84638 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:10:40.875635 8334 sys_catalog.cc:564] T 00000000000000000000000000000000 P ce5981efeb244436bd554bf006e84638 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:10:40.880626 8347 raft_consensus.cc:686] T 00000000000000000000000000000000 P ce5981efeb244436bd554bf006e84638 [term 1 LEADER]: Becoming Leader. State: Replica: ce5981efeb244436bd554bf006e84638, State: Running, Role: LEADER
I20260812 01:10:40.881196 8347 consensus_queue.cc:237] T 00000000000000000000000000000000 P ce5981efeb244436bd554bf006e84638 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5981efeb244436bd554bf006e84638" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44785 } }
I20260812 01:10:40.884284 8349 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce5981efeb244436bd554bf006e84638 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ce5981efeb244436bd554bf006e84638" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5981efeb244436bd554bf006e84638" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44785 } } }
I20260812 01:10:40.884752 8349 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce5981efeb244436bd554bf006e84638 [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:40.884670 8351 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce5981efeb244436bd554bf006e84638 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce5981efeb244436bd554bf006e84638. Latest consensus state: current_term: 1 leader_uuid: "ce5981efeb244436bd554bf006e84638" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5981efeb244436bd554bf006e84638" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44785 } } }
I20260812 01:10:40.884961 8351 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce5981efeb244436bd554bf006e84638 [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:40.886435 8337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:40.868512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45173 (local address 127.4.201.126:44785)
0812 01:10:40.868681 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:40.868686 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:40.869063 (+ 377us) server_negotiation.cc:407] Connection header received
0812 01:10:40.869178 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:40.869183 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:40.869280 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:40.869384 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:40.871387 (+ 2003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:40.872158 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:40.873886 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:40.874595 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:40.874738 (+ 143us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:40.878187 (+ 3449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:40.878195 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:40.878200 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:40.878240 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:40.882059 (+ 3819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:40.882957 (+ 898us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:40.882963 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:40.882967 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:40.883245 (+ 278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:40.883851 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:40.883856 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:40.883860 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:40.884275 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:40.884598 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:40.885929 (+ 1331us) server_negotiation.cc:299] Negotiation successful
0812 01:10:40.886106 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 01:10:40.891306 8368 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:10:40.895718 8368 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:10:40.903878 8368 catalog_manager.cc:1347] Generated new cluster ID: 95a09434778b4458a82f2832f3853bb1
I20260812 01:10:40.903990 8368 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:10:40.911710 8368 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:10:40.913411 8368 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:10:40.925122 8368 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ce5981efeb244436bd554bf006e84638: Generated new TSK 0
I20260812 01:10:40.926079 8368 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:10:40.935209 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 8215
I20260812 01:10:40.936347 8323 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:10:41.025144 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 8215
W20260812 01:10:41.049917 8194 connection.cc:535] client connection to 127.4.201.126:44785 recv error: Network error: failed to read from TLS socket (remote: 127.4.201.126:44785): Connection reset by peer (error 104)
2026-08-12T01:10:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2174 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:10:41 dist-test-slave-bndk krb5kdc[8384](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:10:41 dist-test-slave-bndk krb5kdc[8384](info): set up 2 sockets
Aug 12 01:10:41 dist-test-slave-bndk krb5kdc[8384](info): commencing operation
krb5kdc: starting...
W20260812 01:10:42.271507 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.203s user 0.000s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:10:42 dist-test-slave-bndk krb5kdc[8384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:10:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:10:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.201.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
I20260812 01:10:42.580761 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:44191
--webserver_interface=127.4.201.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:38321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:44191
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:10:42.917665 8405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:42.917944 8405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:42.918094 8405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:42.925295 8405 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:10:42.925416 8405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:42.925495 8405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:42.925590 8405 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:10:42.925647 8405 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:10:42.935328 8405 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:38321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:44191
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:44191
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:42.936589 8405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:42.937922 8405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:42.949409 8412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:42.949373 8420 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:42.949451 8414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:42.949994 8405 server_base.cc:1034] running on GCE node
I20260812 01:10:42.950810 8405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:42.952167 8405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:42.953361 8405 hybrid_clock.cc:648] HybridClock initialized: now 1786497042953317 us; error 34 us; skew 500 ppm
I20260812 01:10:42.953717 8405 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:10:42 dist-test-slave-bndk krb5kdc[8384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497042, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:10:42.960391 8405 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:10:42.961822 8405 webserver.cc:460] Webserver started at http://127.4.201.126:37605/ using document root <none> and password file <none>
I20260812 01:10:42.962453 8405 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:42.962582 8405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:42.962868 8405 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:42.965845 8405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "49a58e0be4a54f3a83a8bb529b680003"
format_stamp: "Formatted at 2026-08-12 01:10:42 on dist-test-slave-bndk"
server_key: "6ee42ea238c1ce61702a8510f891d594"
server_key_iv: "55ffd56befc960ab4cfef404d8e2bd73"
server_key_version: "encryptionkey@0"
I20260812 01:10:42.966609 8405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "49a58e0be4a54f3a83a8bb529b680003"
format_stamp: "Formatted at 2026-08-12 01:10:42 on dist-test-slave-bndk"
server_key: "6ee42ea238c1ce61702a8510f891d594"
server_key_iv: "55ffd56befc960ab4cfef404d8e2bd73"
server_key_version: "encryptionkey@0"
I20260812 01:10:42.971746 8405 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 01:10:42.975119 8432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:42.976344 8405 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260812 01:10:42.976512 8405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "49a58e0be4a54f3a83a8bb529b680003"
format_stamp: "Formatted at 2026-08-12 01:10:42 on dist-test-slave-bndk"
server_key: "6ee42ea238c1ce61702a8510f891d594"
server_key_iv: "55ffd56befc960ab4cfef404d8e2bd73"
server_key_version: "encryptionkey@0"
I20260812 01:10:42.976689 8405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:42.994180 8405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:42.998457 8405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:42.998726 8405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:43.016098 8405 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:44191
I20260812 01:10:43.016117 8517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:44191 every 8 connection(s)
I20260812 01:10:43.017514 8405 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:10:43.018935 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 8405
I20260812 01:10:43.019104 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:10:43.019547 4901 external_mini_cluster.cc:1428] Setting key 44ce048812ebe44b5a00af3ad2bbffbe
I20260812 01:10:43.021641 8519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:43.034189 8523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:43.021379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44649 (local address 127.4.201.126:44191)
0812 01:10:43.022180 (+ 801us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:43.022195 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:43.022245 (+ 50us) server_negotiation.cc:407] Connection header received
0812 01:10:43.024470 (+ 2225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:43.024500 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:43.025003 (+ 503us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:43.025444 (+ 441us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:43.025927 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:43.027882 (+ 1955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:43.029118 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:43.030136 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:43.030311 (+ 175us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:43.031424 (+ 1113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:43.031435 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:43.031452 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:43.032268 (+ 816us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:43.032356 (+ 88us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:43.032387 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:43.032556 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:43.032767 (+ 211us) server_negotiation.cc:299] Negotiation successful
0812 01:10:43.032938 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":578,"thread_start_us":335,"threads_started":1}
I20260812 01:10:43.035549 8519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49a58e0be4a54f3a83a8bb529b680003: Bootstrap starting.
I20260812 01:10:43.037858 4901 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:10:43.038766 8519 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 49a58e0be4a54f3a83a8bb529b680003: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:43.039932 8519 log.cc:824] T 00000000000000000000000000000000 P 49a58e0be4a54f3a83a8bb529b680003: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:43.043130 8519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49a58e0be4a54f3a83a8bb529b680003: No bootstrap required, opened a new log
I20260812 01:10:43.049306 8523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:43.043017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41451 (local address 127.4.201.126:44191)
0812 01:10:43.043179 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:43.043184 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:43.043543 (+ 359us) server_negotiation.cc:407] Connection header received
0812 01:10:43.043684 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:43.043689 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:43.043762 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:43.043863 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:43.044368 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:43.045518 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:43.046840 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:43.047472 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:43.047608 (+ 136us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:43.048552 (+ 944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:43.048559 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:43.048563 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:43.048583 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:43.048634 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:43.048658 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:43.048778 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:43.048916 (+ 138us) server_negotiation.cc:299] Negotiation successful
0812 01:10:43.048977 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 01:10:43.051949 8519 raft_consensus.cc:348] T 00000000000000000000000000000000 P 49a58e0be4a54f3a83a8bb529b680003 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49a58e0be4a54f3a83a8bb529b680003" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44191 } }
I20260812 01:10:43.052268 8519 raft_consensus.cc:374] T 00000000000000000000000000000000 P 49a58e0be4a54f3a83a8bb529b680003 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:43.052340 8519 raft_consensus.cc:729] T 00000000000000000000000000000000 P 49a58e0be4a54f3a83a8bb529b680003 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49a58e0be4a54f3a83a8bb529b680003, State: Initialized, Role: FOLLOWER
I20260812 01:10:43.052816 8519 consensus_queue.cc:260] T 00000000000000000000000000000000 P 49a58e0be4a54f3a83a8bb529b680003 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49a58e0be4a54f3a83a8bb529b680003" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44191 } }
I20260812 01:10:43.053012 8519 raft_consensus.cc:388] T 00000000000000000000000000000000 P 49a58e0be4a54f3a83a8bb529b680003 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:10:43.053107 8519 raft_consensus.cc:482] T 00000000000000000000000000000000 P 49a58e0be4a54f3a83a8bb529b680003 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:10:43.053290 8519 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 49a58e0be4a54f3a83a8bb529b680003 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:43.055322 8519 raft_consensus.cc:504] T 00000000000000000000000000000000 P 49a58e0be4a54f3a83a8bb529b680003 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49a58e0be4a54f3a83a8bb529b680003" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44191 } }
I20260812 01:10:43.055868 8519 leader_election.cc:302] T 00000000000000000000000000000000 P 49a58e0be4a54f3a83a8bb529b680003 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 49a58e0be4a54f3a83a8bb529b680003; no voters:
I20260812 01:10:43.056423 8519 leader_election.cc:288] T 00000000000000000000000000000000 P 49a58e0be4a54f3a83a8bb529b680003 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:10:43.056563 8535 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 49a58e0be4a54f3a83a8bb529b680003 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:10:43.057257 8535 raft_consensus.cc:686] T 00000000000000000000000000000000 P 49a58e0be4a54f3a83a8bb529b680003 [term 1 LEADER]: Becoming Leader. State: Replica: 49a58e0be4a54f3a83a8bb529b680003, State: Running, Role: LEADER
I20260812 01:10:43.057783 8535 consensus_queue.cc:237] T 00000000000000000000000000000000 P 49a58e0be4a54f3a83a8bb529b680003 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49a58e0be4a54f3a83a8bb529b680003" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44191 } }
I20260812 01:10:43.058382 8519 sys_catalog.cc:564] T 00000000000000000000000000000000 P 49a58e0be4a54f3a83a8bb529b680003 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:10:43.060672 8538 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49a58e0be4a54f3a83a8bb529b680003 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 49a58e0be4a54f3a83a8bb529b680003. Latest consensus state: current_term: 1 leader_uuid: "49a58e0be4a54f3a83a8bb529b680003" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49a58e0be4a54f3a83a8bb529b680003" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44191 } } }
I20260812 01:10:43.060642 8537 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49a58e0be4a54f3a83a8bb529b680003 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "49a58e0be4a54f3a83a8bb529b680003" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49a58e0be4a54f3a83a8bb529b680003" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 44191 } } }
I20260812 01:10:43.061048 8538 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49a58e0be4a54f3a83a8bb529b680003 [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:43.061053 8537 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49a58e0be4a54f3a83a8bb529b680003 [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:43.066284 8551 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:10:43.070333 8551 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:10:43.077790 8551 catalog_manager.cc:1347] Generated new cluster ID: 85e84d7f21374460a47fe7a7bc367580
I20260812 01:10:43.077909 8551 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:10:43.109246 8551 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:10:43.110507 8551 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:10:43.123027 8551 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 49a58e0be4a54f3a83a8bb529b680003: Generated new TSK 0
I20260812 01:10:43.123807 8551 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:10:43.137255 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 8405
W20260812 01:10:43.138411 8507 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:44649
W20260812 01:10:43.139092 4901 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 8405: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 01:10:43.139243 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 8405
W20260812 01:10:43.163226 8382 connection.cc:535] client connection to 127.4.201.126:44191 recv error: Network error: failed to read from TLS socket (remote: 127.4.201.126:44191): Connection reset by peer (error 104)
2026-08-12T01:10:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2113 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:10:43 dist-test-slave-bndk krb5kdc[8572](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:10:43 dist-test-slave-bndk krb5kdc[8572](info): set up 2 sockets
Aug 12 01:10:43 dist-test-slave-bndk krb5kdc[8572](info): commencing operation
krb5kdc: starting...
W20260812 01:10:44.396461 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.215s user 0.003s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:10:44 dist-test-slave-bndk krb5kdc[8572](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497044, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:10:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:10:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.201.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
I20260812 01:10:44.692046 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:40399
--webserver_interface=127.4.201.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:39013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:40399
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:10:45.025079 8594 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:45.025405 8594 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:45.025559 8594 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:45.032603 8594 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:10:45.032716 8594 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:45.032795 8594 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:45.032879 8594 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:10:45.032939 8594 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:10:45.042507 8594 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:39013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:40399
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:40399
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:45.043756 8594 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:45.045038 8594 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:45.056370 8605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:45.056449 8600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:45.056646 8599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:45.057035 8594 server_base.cc:1034] running on GCE node
I20260812 01:10:45.057822 8594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:45.059163 8594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:45.060360 8594 hybrid_clock.cc:648] HybridClock initialized: now 1786497045060315 us; error 39 us; skew 500 ppm
I20260812 01:10:45.060678 8594 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:10:45 dist-test-slave-bndk krb5kdc[8572](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497045, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:10:45.063666 8594 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:10:45.065037 8594 webserver.cc:460] Webserver started at http://127.4.201.126:38801/ using document root <none> and password file <none>
I20260812 01:10:45.065704 8594 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:45.065826 8594 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:45.066119 8594 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:45.068984 8594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "0fdb7aaf4c254ac1ab792dbe3a5334df"
format_stamp: "Formatted at 2026-08-12 01:10:45 on dist-test-slave-bndk"
server_key: "886b83b8db5ff1b9c6e52f526cab5a0d"
server_key_iv: "c00c088935fdf5007d7c3507eefd967b"
server_key_version: "encryptionkey@0"
I20260812 01:10:45.069769 8594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "0fdb7aaf4c254ac1ab792dbe3a5334df"
format_stamp: "Formatted at 2026-08-12 01:10:45 on dist-test-slave-bndk"
server_key: "886b83b8db5ff1b9c6e52f526cab5a0d"
server_key_iv: "c00c088935fdf5007d7c3507eefd967b"
server_key_version: "encryptionkey@0"
I20260812 01:10:45.074762 8594 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 01:10:45.078023 8618 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:45.079267 8594 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 01:10:45.079418 8594 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "0fdb7aaf4c254ac1ab792dbe3a5334df"
format_stamp: "Formatted at 2026-08-12 01:10:45 on dist-test-slave-bndk"
server_key: "886b83b8db5ff1b9c6e52f526cab5a0d"
server_key_iv: "c00c088935fdf5007d7c3507eefd967b"
server_key_version: "encryptionkey@0"
I20260812 01:10:45.079602 8594 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:45.085325 8594 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:45.089269 8594 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:45.089540 8594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:45.106652 8594 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:40399
I20260812 01:10:45.106683 8704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:40399 every 8 connection(s)
I20260812 01:10:45.108059 8594 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:10:45.109334 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 8594
I20260812 01:10:45.109532 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:10:45.110103 4901 external_mini_cluster.cc:1428] Setting key a241a992f175db93eccf057846817027
I20260812 01:10:45.112635 8706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:45.117784 8709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:45.111938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48521 (local address 127.4.201.126:40399)
0812 01:10:45.112736 (+ 798us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:45.112752 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:45.112807 (+ 55us) server_negotiation.cc:407] Connection header received
0812 01:10:45.114464 (+ 1657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:45.114486 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:45.114813 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:45.115178 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:45.116191 (+ 1013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:45.116199 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:45.116212 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:45.116239 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:45.116317 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:45.116339 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:45.116562 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:45.116705 (+ 143us) server_negotiation.cc:299] Negotiation successful
0812 01:10:45.116882 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":558,"thread_start_us":334,"threads_started":1}
I20260812 01:10:45.121331 4901 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:10:45.123510 8706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fdb7aaf4c254ac1ab792dbe3a5334df: Bootstrap starting.
I20260812 01:10:45.126929 8706 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0fdb7aaf4c254ac1ab792dbe3a5334df: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:45.128015 8709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:45.125612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58993 (local address 127.4.201.126:40399)
0812 01:10:45.125772 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:45.125779 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:45.126174 (+ 395us) server_negotiation.cc:407] Connection header received
0812 01:10:45.126328 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:45.126334 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:45.126387 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:45.126468 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:45.127381 (+ 913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:45.127387 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:45.127392 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:45.127412 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:45.127451 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:45.127465 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:45.127569 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:45.127682 (+ 113us) server_negotiation.cc:299] Negotiation successful
0812 01:10:45.127744 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 01:10:45.128093 8706 log.cc:824] T 00000000000000000000000000000000 P 0fdb7aaf4c254ac1ab792dbe3a5334df: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:45.131040 8706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fdb7aaf4c254ac1ab792dbe3a5334df: No bootstrap required, opened a new log
I20260812 01:10:45.138213 8706 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0fdb7aaf4c254ac1ab792dbe3a5334df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fdb7aaf4c254ac1ab792dbe3a5334df" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 40399 } }
I20260812 01:10:45.138537 8706 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0fdb7aaf4c254ac1ab792dbe3a5334df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:45.138610 8706 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0fdb7aaf4c254ac1ab792dbe3a5334df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fdb7aaf4c254ac1ab792dbe3a5334df, State: Initialized, Role: FOLLOWER
I20260812 01:10:45.139099 8706 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0fdb7aaf4c254ac1ab792dbe3a5334df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fdb7aaf4c254ac1ab792dbe3a5334df" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 40399 } }
I20260812 01:10:45.139372 8706 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0fdb7aaf4c254ac1ab792dbe3a5334df [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:10:45.139513 8706 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0fdb7aaf4c254ac1ab792dbe3a5334df [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:10:45.139698 8706 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0fdb7aaf4c254ac1ab792dbe3a5334df [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:45.141911 8706 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0fdb7aaf4c254ac1ab792dbe3a5334df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fdb7aaf4c254ac1ab792dbe3a5334df" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 40399 } }
I20260812 01:10:45.142345 8706 leader_election.cc:302] T 00000000000000000000000000000000 P 0fdb7aaf4c254ac1ab792dbe3a5334df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0fdb7aaf4c254ac1ab792dbe3a5334df; no voters:
I20260812 01:10:45.142844 8706 leader_election.cc:288] T 00000000000000000000000000000000 P 0fdb7aaf4c254ac1ab792dbe3a5334df [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:10:45.142966 8727 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0fdb7aaf4c254ac1ab792dbe3a5334df [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:10:45.143599 8727 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0fdb7aaf4c254ac1ab792dbe3a5334df [term 1 LEADER]: Becoming Leader. State: Replica: 0fdb7aaf4c254ac1ab792dbe3a5334df, State: Running, Role: LEADER
I20260812 01:10:45.144119 8727 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0fdb7aaf4c254ac1ab792dbe3a5334df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fdb7aaf4c254ac1ab792dbe3a5334df" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 40399 } }
I20260812 01:10:45.144779 8706 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0fdb7aaf4c254ac1ab792dbe3a5334df [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:10:45.146919 8728 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fdb7aaf4c254ac1ab792dbe3a5334df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0fdb7aaf4c254ac1ab792dbe3a5334df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fdb7aaf4c254ac1ab792dbe3a5334df" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 40399 } } }
I20260812 01:10:45.147372 8728 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fdb7aaf4c254ac1ab792dbe3a5334df [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:45.148445 8729 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fdb7aaf4c254ac1ab792dbe3a5334df [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0fdb7aaf4c254ac1ab792dbe3a5334df. Latest consensus state: current_term: 1 leader_uuid: "0fdb7aaf4c254ac1ab792dbe3a5334df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fdb7aaf4c254ac1ab792dbe3a5334df" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 40399 } } }
I20260812 01:10:45.148828 8729 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fdb7aaf4c254ac1ab792dbe3a5334df [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:45.152606 8736 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:10:45.156800 8736 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:10:45.164386 8736 catalog_manager.cc:1347] Generated new cluster ID: eafde3453e9b408a8200ec1ff7938990
I20260812 01:10:45.164494 8736 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:10:45.183236 8736 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:10:45.183755 8736 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:10:45.199630 8736 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0fdb7aaf4c254ac1ab792dbe3a5334df: Generated new TSK 0
I20260812 01:10:45.200608 8736 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:10:45.216465 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 8594
W20260812 01:10:45.217437 8698 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:48521
W20260812 01:10:45.218091 4901 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 8594: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 01:10:45.218222 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 8594
2026-08-12T01:10:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2079 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:10:45 dist-test-slave-bndk krb5kdc[8764](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:10:45 dist-test-slave-bndk krb5kdc[8764](info): set up 2 sockets
Aug 12 01:10:45 dist-test-slave-bndk krb5kdc[8764](info): commencing operation
krb5kdc: starting...
W20260812 01:10:46.467509 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.207s user 0.004s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:10:46 dist-test-slave-bndk krb5kdc[8764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:10:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:10:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.201.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
I20260812 01:10:46.763685 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:42585
--webserver_interface=127.4.201.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:35755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:42585
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:10:47.096490 8787 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:47.096778 8787 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:47.096917 8787 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:47.104060 8787 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:10:47.104182 8787 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:47.104257 8787 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:47.104346 8787 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:10:47.104404 8787 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:10:47.114027 8787 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:35755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:42585
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:42585
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:47.115231 8787 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:47.116523 8787 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:47.127970 8795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:47.128065 8798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:47.128034 8794 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:47.128829 8787 server_base.cc:1034] running on GCE node
I20260812 01:10:47.129570 8787 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:47.130877 8787 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:47.132071 8787 hybrid_clock.cc:648] HybridClock initialized: now 1786497047132034 us; error 25 us; skew 500 ppm
I20260812 01:10:47.132380 8787 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:10:47 dist-test-slave-bndk krb5kdc[8764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497047, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:10:47.135342 8787 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:10:47.136724 8787 webserver.cc:460] Webserver started at http://127.4.201.126:39551/ using document root <none> and password file <none>
I20260812 01:10:47.137398 8787 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:47.137526 8787 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:47.137813 8787 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:47.140667 8787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "932fd752cde74e82b551824607013d62"
format_stamp: "Formatted at 2026-08-12 01:10:47 on dist-test-slave-bndk"
server_key: "392cf3819bacd1a298bd92cc42f3d240"
server_key_iv: "061f20cdc351b945061c251bd9854c20"
server_key_version: "encryptionkey@0"
I20260812 01:10:47.141443 8787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "932fd752cde74e82b551824607013d62"
format_stamp: "Formatted at 2026-08-12 01:10:47 on dist-test-slave-bndk"
server_key: "392cf3819bacd1a298bd92cc42f3d240"
server_key_iv: "061f20cdc351b945061c251bd9854c20"
server_key_version: "encryptionkey@0"
I20260812 01:10:47.146273 8787 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 01:10:47.149511 8811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:47.150758 8787 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 01:10:47.150923 8787 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "932fd752cde74e82b551824607013d62"
format_stamp: "Formatted at 2026-08-12 01:10:47 on dist-test-slave-bndk"
server_key: "392cf3819bacd1a298bd92cc42f3d240"
server_key_iv: "061f20cdc351b945061c251bd9854c20"
server_key_version: "encryptionkey@0"
I20260812 01:10:47.151093 8787 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:47.168833 8787 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:47.172605 8787 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:47.172873 8787 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:47.190155 8787 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:42585
I20260812 01:10:47.190163 8889 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:42585 every 8 connection(s)
I20260812 01:10:47.191509 8787 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:10:47.195241 8890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:47.199404 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 8787
I20260812 01:10:47.199589 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:10:47.200143 4901 external_mini_cluster.cc:1428] Setting key 1306d9abb186fb88b297b8e668d9f86a
I20260812 01:10:47.207718 8890 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 932fd752cde74e82b551824607013d62: Bootstrap starting.
I20260812 01:10:47.210836 8890 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 932fd752cde74e82b551824607013d62: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:47.211854 8890 log.cc:824] T 00000000000000000000000000000000 P 932fd752cde74e82b551824607013d62: Log is configured to *not* fsync() on all Append() calls
Aug 12 01:10:47 dist-test-slave-bndk krb5kdc[8764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:10:47.214892 8890 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 932fd752cde74e82b551824607013d62: No bootstrap required, opened a new log
I20260812 01:10:47.222620 8901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:47.202009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53299 (local address 127.4.201.126:42585)
0812 01:10:47.202781 (+ 772us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:47.202793 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:47.202834 (+ 41us) server_negotiation.cc:407] Connection header received
0812 01:10:47.204393 (+ 1559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:47.204415 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:47.204801 (+ 386us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:47.205190 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:47.206700 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:47.208050 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:47.209299 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:47.209948 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:47.210123 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:47.214249 (+ 4126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:47.214265 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:47.214285 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:47.214329 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:47.218242 (+ 3913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:47.218893 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:47.218902 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:47.218915 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:47.219134 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:47.219469 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:47.219473 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:47.219477 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:47.220200 (+ 723us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:47.220512 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:47.220800 (+ 288us) server_negotiation.cc:299] Negotiation successful
0812 01:10:47.221279 (+ 479us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":357,"threads_started":1}
I20260812 01:10:47.225183 8890 raft_consensus.cc:348] T 00000000000000000000000000000000 P 932fd752cde74e82b551824607013d62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "932fd752cde74e82b551824607013d62" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 42585 } }
I20260812 01:10:47.225579 8890 raft_consensus.cc:374] T 00000000000000000000000000000000 P 932fd752cde74e82b551824607013d62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:47.225739 8890 raft_consensus.cc:729] T 00000000000000000000000000000000 P 932fd752cde74e82b551824607013d62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932fd752cde74e82b551824607013d62, State: Initialized, Role: FOLLOWER
I20260812 01:10:47.226297 8890 consensus_queue.cc:260] T 00000000000000000000000000000000 P 932fd752cde74e82b551824607013d62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "932fd752cde74e82b551824607013d62" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 42585 } }
I20260812 01:10:47.226570 8890 raft_consensus.cc:388] T 00000000000000000000000000000000 P 932fd752cde74e82b551824607013d62 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:10:47.226612 4901 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:10:47.226707 8890 raft_consensus.cc:482] T 00000000000000000000000000000000 P 932fd752cde74e82b551824607013d62 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:10:47.226858 8890 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 932fd752cde74e82b551824607013d62 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:47.228948 8890 raft_consensus.cc:504] T 00000000000000000000000000000000 P 932fd752cde74e82b551824607013d62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "932fd752cde74e82b551824607013d62" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 42585 } }
I20260812 01:10:47.229455 8890 leader_election.cc:302] T 00000000000000000000000000000000 P 932fd752cde74e82b551824607013d62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 932fd752cde74e82b551824607013d62; no voters:
I20260812 01:10:47.230089 8890 leader_election.cc:288] T 00000000000000000000000000000000 P 932fd752cde74e82b551824607013d62 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:10:47.230202 8911 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 932fd752cde74e82b551824607013d62 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:10:47.231397 8911 raft_consensus.cc:686] T 00000000000000000000000000000000 P 932fd752cde74e82b551824607013d62 [term 1 LEADER]: Becoming Leader. State: Replica: 932fd752cde74e82b551824607013d62, State: Running, Role: LEADER
I20260812 01:10:47.232165 8911 consensus_queue.cc:237] T 00000000000000000000000000000000 P 932fd752cde74e82b551824607013d62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "932fd752cde74e82b551824607013d62" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 42585 } }
I20260812 01:10:47.232342 8890 sys_catalog.cc:564] T 00000000000000000000000000000000 P 932fd752cde74e82b551824607013d62 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:10:47.238822 8913 sys_catalog.cc:455] T 00000000000000000000000000000000 P 932fd752cde74e82b551824607013d62 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "932fd752cde74e82b551824607013d62" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "932fd752cde74e82b551824607013d62" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 42585 } } }
I20260812 01:10:47.239235 8913 sys_catalog.cc:458] T 00000000000000000000000000000000 P 932fd752cde74e82b551824607013d62 [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:47.239734 8914 sys_catalog.cc:455] T 00000000000000000000000000000000 P 932fd752cde74e82b551824607013d62 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 932fd752cde74e82b551824607013d62. Latest consensus state: current_term: 1 leader_uuid: "932fd752cde74e82b551824607013d62" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "932fd752cde74e82b551824607013d62" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 42585 } } }
I20260812 01:10:47.240032 8914 sys_catalog.cc:458] T 00000000000000000000000000000000 P 932fd752cde74e82b551824607013d62 [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:47.261346 8923 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:10:47.272907 8923 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:10:47.283825 8901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:47.241951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53845 (local address 127.4.201.126:42585)
0812 01:10:47.242128 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:47.242135 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:47.264401 (+ 22266us) server_negotiation.cc:407] Connection header received
0812 01:10:47.264719 (+ 318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:47.264726 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:47.264822 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:47.264909 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:47.267248 (+ 2339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:47.268500 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:47.270536 (+ 2036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:47.271305 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:47.271427 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:47.275298 (+ 3871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:47.275306 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:47.275311 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:47.275355 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:47.279259 (+ 3904us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:47.280193 (+ 934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:47.280199 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:47.280203 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:47.280363 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:47.281255 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:47.281265 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:47.281268 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:47.281718 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:47.281973 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:47.283211 (+ 1238us) server_negotiation.cc:299] Negotiation successful
0812 01:10:47.283455 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 01:10:47.288518 8923 catalog_manager.cc:1347] Generated new cluster ID: 75eb485da9cf48ba9dd13b48342273eb
I20260812 01:10:47.288622 8923 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:10:47.310420 8923 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:10:47.311750 8923 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:10:47.320181 8923 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 932fd752cde74e82b551824607013d62: Generated new TSK 0
I20260812 01:10:47.320984 8923 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:10:47.331940 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 8787
I20260812 01:10:47.333235 8884 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:10:47.423691 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 8787
2026-08-12T01:10:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2204 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:10:47 dist-test-slave-bndk krb5kdc[8953](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:10:47 dist-test-slave-bndk krb5kdc[8953](info): set up 2 sockets
Aug 12 01:10:47 dist-test-slave-bndk krb5kdc[8953](info): commencing operation
krb5kdc: starting...
W20260812 01:10:48.670657 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.205s user 0.004s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:10:48 dist-test-slave-bndk krb5kdc[8953](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497048, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:10:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:10:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.201.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
I20260812 01:10:48.972499 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:34199
--webserver_interface=127.4.201.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:38825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:34199
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:10:49.305732 8973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:49.306000 8973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:49.306143 8973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:49.313144 8973 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:10:49.313262 8973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:49.313400 8973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:49.313474 8973 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:10:49.313537 8973 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:10:49.322934 8973 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:38825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:34199
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:34199
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:49.324137 8973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:49.325457 8973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:49.337306 8982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:49.337374 8984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:49.337376 8987 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:49.338316 8973 server_base.cc:1034] running on GCE node
I20260812 01:10:49.339064 8973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:49.340417 8973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:49.341614 8973 hybrid_clock.cc:648] HybridClock initialized: now 1786497049341566 us; error 38 us; skew 500 ppm
I20260812 01:10:49.341939 8973 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:10:49 dist-test-slave-bndk krb5kdc[8953](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497049, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:10:49.349486 8973 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:10:49.350881 8973 webserver.cc:460] Webserver started at http://127.4.201.126:41829/ using document root <none> and password file <none>
I20260812 01:10:49.351559 8973 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:49.351673 8973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:49.351964 8973 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:49.354924 8973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "8c975abd68b84778a54b9b77671798cc"
format_stamp: "Formatted at 2026-08-12 01:10:49 on dist-test-slave-bndk"
server_key: "acce6449f76a04e07dbc8a59ef59a181"
server_key_iv: "a97ed0ca3f6710f7ff2a89b6b68bca9d"
server_key_version: "encryptionkey@0"
I20260812 01:10:49.355686 8973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "8c975abd68b84778a54b9b77671798cc"
format_stamp: "Formatted at 2026-08-12 01:10:49 on dist-test-slave-bndk"
server_key: "acce6449f76a04e07dbc8a59ef59a181"
server_key_iv: "a97ed0ca3f6710f7ff2a89b6b68bca9d"
server_key_version: "encryptionkey@0"
I20260812 01:10:49.360796 8973 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 01:10:49.364156 9000 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:49.365552 8973 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:10:49.365710 8973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "8c975abd68b84778a54b9b77671798cc"
format_stamp: "Formatted at 2026-08-12 01:10:49 on dist-test-slave-bndk"
server_key: "acce6449f76a04e07dbc8a59ef59a181"
server_key_iv: "a97ed0ca3f6710f7ff2a89b6b68bca9d"
server_key_version: "encryptionkey@0"
I20260812 01:10:49.365895 8973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:49.385748 8973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:49.389593 8973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:49.389853 8973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:49.407123 8973 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:34199
I20260812 01:10:49.407145 9087 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:34199 every 8 connection(s)
I20260812 01:10:49.408474 8973 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:10:49.410787 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 8973
I20260812 01:10:49.410944 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:10:49.411357 4901 external_mini_cluster.cc:1428] Setting key 86e44e63dd402eca5796a073c5738bab
I20260812 01:10:49.412487 9094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:49.425683 9098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:49.413039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57217 (local address 127.4.201.126:34199)
0812 01:10:49.413828 (+ 789us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:49.413844 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:49.413897 (+ 53us) server_negotiation.cc:407] Connection header received
0812 01:10:49.415886 (+ 1989us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:49.415916 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:49.416416 (+ 500us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:49.416853 (+ 437us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:49.417398 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:49.419383 (+ 1985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:49.420672 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:49.421712 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:49.421890 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:49.422988 (+ 1098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:49.423004 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:49.423022 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:49.423736 (+ 714us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:49.423826 (+ 90us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:49.423867 (+ 41us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:49.423981 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:49.424134 (+ 153us) server_negotiation.cc:299] Negotiation successful
0812 01:10:49.424403 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":346,"threads_started":1}
I20260812 01:10:49.427071 9094 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c975abd68b84778a54b9b77671798cc: Bootstrap starting.
I20260812 01:10:49.429407 4901 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:10:49.430701 9094 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8c975abd68b84778a54b9b77671798cc: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:49.431924 9094 log.cc:824] T 00000000000000000000000000000000 P 8c975abd68b84778a54b9b77671798cc: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:49.435031 9094 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c975abd68b84778a54b9b77671798cc: No bootstrap required, opened a new log
I20260812 01:10:49.440824 9098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:49.434427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43977 (local address 127.4.201.126:34199)
0812 01:10:49.434600 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:49.434606 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:49.435098 (+ 492us) server_negotiation.cc:407] Connection header received
0812 01:10:49.435387 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:49.435393 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:49.435487 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:49.435599 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:49.436017 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:49.437076 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:49.438363 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:49.439056 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:49.439179 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:49.440116 (+ 937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:49.440126 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:49.440130 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:49.440151 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:49.440206 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:49.440225 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:49.440321 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:49.440394 (+ 73us) server_negotiation.cc:299] Negotiation successful
0812 01:10:49.440490 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 01:10:49.444003 9094 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8c975abd68b84778a54b9b77671798cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c975abd68b84778a54b9b77671798cc" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 34199 } }
I20260812 01:10:49.444344 9094 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8c975abd68b84778a54b9b77671798cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:49.444435 9094 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8c975abd68b84778a54b9b77671798cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c975abd68b84778a54b9b77671798cc, State: Initialized, Role: FOLLOWER
I20260812 01:10:49.444939 9094 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8c975abd68b84778a54b9b77671798cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c975abd68b84778a54b9b77671798cc" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 34199 } }
I20260812 01:10:49.445152 9094 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8c975abd68b84778a54b9b77671798cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:10:49.445299 9094 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8c975abd68b84778a54b9b77671798cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:10:49.445436 9094 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8c975abd68b84778a54b9b77671798cc [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:49.447453 9094 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8c975abd68b84778a54b9b77671798cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c975abd68b84778a54b9b77671798cc" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 34199 } }
I20260812 01:10:49.447891 9094 leader_election.cc:302] T 00000000000000000000000000000000 P 8c975abd68b84778a54b9b77671798cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8c975abd68b84778a54b9b77671798cc; no voters:
I20260812 01:10:49.448407 9094 leader_election.cc:288] T 00000000000000000000000000000000 P 8c975abd68b84778a54b9b77671798cc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:10:49.448566 9106 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8c975abd68b84778a54b9b77671798cc [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:10:49.449426 9106 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8c975abd68b84778a54b9b77671798cc [term 1 LEADER]: Becoming Leader. State: Replica: 8c975abd68b84778a54b9b77671798cc, State: Running, Role: LEADER
I20260812 01:10:49.449997 9106 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8c975abd68b84778a54b9b77671798cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c975abd68b84778a54b9b77671798cc" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 34199 } }
I20260812 01:10:49.450662 9094 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8c975abd68b84778a54b9b77671798cc [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:10:49.452809 9109 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c975abd68b84778a54b9b77671798cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8c975abd68b84778a54b9b77671798cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c975abd68b84778a54b9b77671798cc" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 34199 } } }
I20260812 01:10:49.453195 9109 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c975abd68b84778a54b9b77671798cc [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:49.458407 9111 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c975abd68b84778a54b9b77671798cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8c975abd68b84778a54b9b77671798cc. Latest consensus state: current_term: 1 leader_uuid: "8c975abd68b84778a54b9b77671798cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c975abd68b84778a54b9b77671798cc" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 34199 } } }
I20260812 01:10:49.458729 9111 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c975abd68b84778a54b9b77671798cc [sys.catalog]: This master's current role is: LEADER
W20260812 01:10:49.464287 9133 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8c975abd68b84778a54b9b77671798cc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 01:10:49.464417 9133 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 01:10:49.464538 9121 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:10:49.466156 9121 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:10:49.474236 9121 catalog_manager.cc:1347] Generated new cluster ID: 7578031a00404c5296af7a6cec609f28
I20260812 01:10:49.474339 9121 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:10:49.485078 9121 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:10:49.486351 9121 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:10:49.503788 9121 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8c975abd68b84778a54b9b77671798cc: Generated new TSK 0
I20260812 01:10:49.504715 9121 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:10:49.522523 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 8973
W20260812 01:10:49.523731 9082 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:57217
W20260812 01:10:49.524457 4901 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 8973: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 01:10:49.524610 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 8973
2026-08-12T01:10:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2100 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:10:49 dist-test-slave-bndk krb5kdc[9141](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:10:49 dist-test-slave-bndk krb5kdc[9141](info): set up 2 sockets
Aug 12 01:10:49 dist-test-slave-bndk krb5kdc[9141](info): commencing operation
krb5kdc: starting...
W20260812 01:10:50.770697 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.205s user 0.003s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:10:50 dist-test-slave-bndk krb5kdc[9141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497050, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:10:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:10:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.201.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
I20260812 01:10:51.067417 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:43449
--webserver_interface=127.4.201.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:36659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:43449
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:10:51.403841 9165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:51.404136 9165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:51.404270 9165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:51.411518 9165 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:10:51.411634 9165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:51.411705 9165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:51.411785 9165 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:10:51.411844 9165 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:10:51.421851 9165 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:36659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:43449
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:43449
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:51.423153 9165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:51.424479 9165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:51.435842 9171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:51.435781 9176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:51.435811 9182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:51.436594 9165 server_base.cc:1034] running on GCE node
I20260812 01:10:51.437383 9165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:51.438781 9165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:51.439994 9165 hybrid_clock.cc:648] HybridClock initialized: now 1786497051439931 us; error 56 us; skew 500 ppm
I20260812 01:10:51.440320 9165 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:10:51 dist-test-slave-bndk krb5kdc[9141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497051, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:10:51.443467 9165 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:10:51.444880 9165 webserver.cc:460] Webserver started at http://127.4.201.126:35435/ using document root <none> and password file <none>
I20260812 01:10:51.445582 9165 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:51.445704 9165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:51.446004 9165 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:51.448915 9165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "07022f27a64c465ca37289e3eca415d6"
format_stamp: "Formatted at 2026-08-12 01:10:51 on dist-test-slave-bndk"
server_key: "b0996de644475dbbe0488d3e6d727049"
server_key_iv: "8c882e55114586bde64103d403ee39d4"
server_key_version: "encryptionkey@0"
I20260812 01:10:51.449679 9165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "07022f27a64c465ca37289e3eca415d6"
format_stamp: "Formatted at 2026-08-12 01:10:51 on dist-test-slave-bndk"
server_key: "b0996de644475dbbe0488d3e6d727049"
server_key_iv: "8c882e55114586bde64103d403ee39d4"
server_key_version: "encryptionkey@0"
I20260812 01:10:51.454631 9165 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 01:10:51.457906 9191 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:51.459110 9165 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 01:10:51.459272 9165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "07022f27a64c465ca37289e3eca415d6"
format_stamp: "Formatted at 2026-08-12 01:10:51 on dist-test-slave-bndk"
server_key: "b0996de644475dbbe0488d3e6d727049"
server_key_iv: "8c882e55114586bde64103d403ee39d4"
server_key_version: "encryptionkey@0"
I20260812 01:10:51.459457 9165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:51.464924 9165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:51.468544 9165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:51.468812 9165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:51.486021 9165 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:43449
I20260812 01:10:51.486052 9283 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:43449 every 8 connection(s)
I20260812 01:10:51.487305 9165 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:10:51.490830 9286 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:51.494645 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 9165
I20260812 01:10:51.494829 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:10:51.495368 4901 external_mini_cluster.cc:1428] Setting key 9ab347cc6e6d7791ca62a71447585a63
I20260812 01:10:51.503298 9286 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07022f27a64c465ca37289e3eca415d6: Bootstrap starting.
I20260812 01:10:51.505142 9292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:51.497252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56725 (local address 127.4.201.126:43449)
0812 01:10:51.498167 (+ 915us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:51.498183 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:51.498534 (+ 351us) server_negotiation.cc:407] Connection header received
0812 01:10:51.501356 (+ 2822us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:51.501388 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:51.501811 (+ 423us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:51.502244 (+ 433us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:51.503229 (+ 985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:51.503237 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:51.503253 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:51.503271 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:51.503346 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:51.503375 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:51.503590 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:51.503713 (+ 123us) server_negotiation.cc:299] Negotiation successful
0812 01:10:51.503900 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":658,"thread_start_us":390,"threads_started":1}
I20260812 01:10:51.506835 9286 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 07022f27a64c465ca37289e3eca415d6: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:51.507987 9286 log.cc:824] T 00000000000000000000000000000000 P 07022f27a64c465ca37289e3eca415d6: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:51.508610 4901 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:10:51.510558 9286 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07022f27a64c465ca37289e3eca415d6: No bootstrap required, opened a new log
I20260812 01:10:51.515118 9292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:51.512776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56377 (local address 127.4.201.126:43449)
0812 01:10:51.512960 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:51.512965 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:51.513321 (+ 356us) server_negotiation.cc:407] Connection header received
0812 01:10:51.513472 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:51.513476 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:51.513528 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:51.513611 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:51.514518 (+ 907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:51.514522 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:51.514525 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 01:10:51.514539 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:51.514576 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 01:10:51.514589 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:51.514676 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:51.514796 (+ 120us) server_negotiation.cc:299] Negotiation successful
0812 01:10:51.514843 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 01:10:51.518556 9286 raft_consensus.cc:348] T 00000000000000000000000000000000 P 07022f27a64c465ca37289e3eca415d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07022f27a64c465ca37289e3eca415d6" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43449 } }
I20260812 01:10:51.518884 9286 raft_consensus.cc:374] T 00000000000000000000000000000000 P 07022f27a64c465ca37289e3eca415d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:10:51.518975 9286 raft_consensus.cc:729] T 00000000000000000000000000000000 P 07022f27a64c465ca37289e3eca415d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07022f27a64c465ca37289e3eca415d6, State: Initialized, Role: FOLLOWER
I20260812 01:10:51.519502 9286 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07022f27a64c465ca37289e3eca415d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07022f27a64c465ca37289e3eca415d6" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43449 } }
I20260812 01:10:51.519716 9286 raft_consensus.cc:388] T 00000000000000000000000000000000 P 07022f27a64c465ca37289e3eca415d6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 01:10:51.519843 9286 raft_consensus.cc:482] T 00000000000000000000000000000000 P 07022f27a64c465ca37289e3eca415d6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 01:10:51.519994 9286 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 07022f27a64c465ca37289e3eca415d6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:51.522128 9286 raft_consensus.cc:504] T 00000000000000000000000000000000 P 07022f27a64c465ca37289e3eca415d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07022f27a64c465ca37289e3eca415d6" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43449 } }
I20260812 01:10:51.522583 9286 leader_election.cc:302] T 00000000000000000000000000000000 P 07022f27a64c465ca37289e3eca415d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 07022f27a64c465ca37289e3eca415d6; no voters:
I20260812 01:10:51.523097 9286 leader_election.cc:288] T 00000000000000000000000000000000 P 07022f27a64c465ca37289e3eca415d6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 01:10:51.523217 9304 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 07022f27a64c465ca37289e3eca415d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:10:51.523823 9304 raft_consensus.cc:686] T 00000000000000000000000000000000 P 07022f27a64c465ca37289e3eca415d6 [term 1 LEADER]: Becoming Leader. State: Replica: 07022f27a64c465ca37289e3eca415d6, State: Running, Role: LEADER
I20260812 01:10:51.524312 9304 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07022f27a64c465ca37289e3eca415d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07022f27a64c465ca37289e3eca415d6" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43449 } }
I20260812 01:10:51.524947 9286 sys_catalog.cc:564] T 00000000000000000000000000000000 P 07022f27a64c465ca37289e3eca415d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:10:51.526847 9307 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07022f27a64c465ca37289e3eca415d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07022f27a64c465ca37289e3eca415d6. Latest consensus state: current_term: 1 leader_uuid: "07022f27a64c465ca37289e3eca415d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07022f27a64c465ca37289e3eca415d6" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43449 } } }
I20260812 01:10:51.527264 9307 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07022f27a64c465ca37289e3eca415d6 [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:51.527204 9306 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07022f27a64c465ca37289e3eca415d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "07022f27a64c465ca37289e3eca415d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07022f27a64c465ca37289e3eca415d6" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 43449 } } }
I20260812 01:10:51.527480 9306 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07022f27a64c465ca37289e3eca415d6 [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:51.529050 9317 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:10:51.534581 9317 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:10:51.542604 9317 catalog_manager.cc:1347] Generated new cluster ID: 125fbaeedd4e40658d99b6e927ac25c7
I20260812 01:10:51.542701 9317 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:10:51.565091 9317 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:10:51.565577 9317 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:10:51.577111 9317 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 07022f27a64c465ca37289e3eca415d6: Generated new TSK 0
I20260812 01:10:51.577875 9317 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:10:51.588349 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 9165
W20260812 01:10:51.589459 9272 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:56725
W20260812 01:10:51.590150 4901 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 9165: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 01:10:51.590286 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 9165
2026-08-12T01:10:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2068 ms)
[----------] 18 tests from AuthTokenIssuingTest (38216 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:10:51 dist-test-slave-bndk krb5kdc[9339](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:10:51 dist-test-slave-bndk krb5kdc[9339](info): set up 2 sockets
Aug 12 01:10:51 dist-test-slave-bndk krb5kdc[9339](info): commencing operation
krb5kdc: starting...
W20260812 01:10:52.839936 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.204s user 0.000s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:10:53 dist-test-slave-bndk krb5kdc[9339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497053, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:10:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:10:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.201.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
I20260812 01:10:53.145931 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:38309
--webserver_interface=127.4.201.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:40507
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:38309,127.4.201.125:34827,127.4.201.124:46547
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:10:53.480657 9359 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 01:10:53.480988 9359 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:53.481088 9359 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:53.481205 9359 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:53.488401 9359 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:10:53.488488 9359 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:53.488561 9359 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:53.488633 9359 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:10:53.488730 9359 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:10:53.498495 9359 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:40507
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:38309,127.4.201.125:34827,127.4.201.124:46547
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:38309
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:53.499775 9359 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:53.501080 9359 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:53.512638 9366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:53.512638 9373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:53.512753 9368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:53.513855 9359 server_base.cc:1034] running on GCE node
I20260812 01:10:53.514593 9359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:53.515928 9359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:53.517144 9359 hybrid_clock.cc:648] HybridClock initialized: now 1786497053517076 us; error 36 us; skew 500 ppm
I20260812 01:10:53.517513 9359 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:10:53 dist-test-slave-bndk krb5kdc[9339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497053, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:10:53.520511 9359 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:10:53.521878 9359 webserver.cc:460] Webserver started at http://127.4.201.126:43647/ using document root <none> and password file <none>
I20260812 01:10:53.522524 9359 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:53.522612 9359 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:53.522877 9359 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:53.525780 9359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "895f7dc431f64065a324e26ea4e7511e"
format_stamp: "Formatted at 2026-08-12 01:10:53 on dist-test-slave-bndk"
server_key: "671ab95d059d75a085c05d8ad7280948"
server_key_iv: "356353ef6ab649fe2f046999c2c42e4a"
server_key_version: "encryptionkey@0"
I20260812 01:10:53.526517 9359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "895f7dc431f64065a324e26ea4e7511e"
format_stamp: "Formatted at 2026-08-12 01:10:53 on dist-test-slave-bndk"
server_key: "671ab95d059d75a085c05d8ad7280948"
server_key_iv: "356353ef6ab649fe2f046999c2c42e4a"
server_key_version: "encryptionkey@0"
I20260812 01:10:53.531502 9359 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 01:10:53.534888 9382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:53.536248 9359 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 01:10:53.536417 9359 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "895f7dc431f64065a324e26ea4e7511e"
format_stamp: "Formatted at 2026-08-12 01:10:53 on dist-test-slave-bndk"
server_key: "671ab95d059d75a085c05d8ad7280948"
server_key_iv: "356353ef6ab649fe2f046999c2c42e4a"
server_key_version: "encryptionkey@0"
I20260812 01:10:53.536610 9359 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:53.551451 9359 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:53.555169 9359 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:53.555408 9359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:53.572384 9359 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:38309
I20260812 01:10:53.572405 9464 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:38309 every 8 connection(s)
I20260812 01:10:53.573647 9359 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:10:53.577162 9466 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:53.584012 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 9359
I20260812 01:10:53.584230 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:10:53.583483 9466 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38309 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:10:53.585075 4901 external_mini_cluster.cc:1428] Setting key 4d3093772fb75f8aafea77a0fd022362
Aug 12 01:10:53 dist-test-slave-bndk krb5kdc[9339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497053, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:10:53.606122 9473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:53.587073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47082 (local address 127.4.201.126:38309)
0812 01:10:53.588753 (+ 1680us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:53.588762 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:53.588805 (+ 43us) server_negotiation.cc:407] Connection header received
0812 01:10:53.590551 (+ 1746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:53.590557 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:53.590766 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:53.590918 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:53.592375 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:53.593610 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:53.595377 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:53.595908 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:53.596032 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:53.599605 (+ 3573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:53.599616 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:53.599630 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:53.599665 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:53.602235 (+ 2570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:53.603069 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:53.603076 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:53.603078 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:53.603215 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:53.603610 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:53.603612 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:53.603614 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:53.604073 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:53.604223 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:53.604824 (+ 601us) server_negotiation.cc:299] Negotiation successful
0812 01:10:53.605137 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":1501,"thread_start_us":1270,"threads_started":1}
I20260812 01:10:53.606175 9471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:53.587073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:38309 (local address 127.0.0.1:47082)
0812 01:10:53.587921 (+ 848us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:53.587968 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:53.590180 (+ 2212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:53.591005 (+ 825us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:53.591013 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:53.591708 (+ 695us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:10:53.592162 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:53.592186 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:53.593763 (+ 1577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:53.593769 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:53.595237 (+ 1468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:53.595254 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:53.596143 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:53.596151 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:53.596308 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:53.596935 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:10:53.596963 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:10:53.599359 (+ 2396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:10:53.602363 (+ 3004us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:53.602376 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:53.602386 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:53.602955 (+ 569us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:53.603323 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:53.603329 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:53.603332 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:53.603519 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:53.604216 (+ 697us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:10:53.604224 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:10:53.604458 (+ 234us) client_negotiation.cc:769] Sending connection context
0812 01:10:53.604706 (+ 248us) client_negotiation.cc:240] Negotiation successful
0812 01:10:53.605344 (+ 638us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":566,"mutex_wait_us":131,"thread_start_us":342,"threads_started":1}
I20260812 01:10:53.608903 9466 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.201.125" port: 34827 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:10:53.609936 9471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:53.609538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:34827 (local address 127.0.0.1:52870)
0812 01:10:53.609699 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:53.609813 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.125:34827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260812 01:10:53.610201 9386 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.201.125:34827: connect: Connection refused (error 111)
I20260812 01:10:53.611733 9471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:53.611326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:34827 (local address 127.0.0.1:52886)
0812 01:10:53.611495 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:53.611582 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.125:34827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260812 01:10:53.611923 9466 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.125:34827: Network error: Client connection negotiation failed: client connection to 127.4.201.125:34827: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.4.201.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.125.keytab.
Entry for principal kudu/127.4.201.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.125.keytab.
I20260812 01:10:53.652354 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.125:34827
--webserver_interface=127.4.201.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.125.keytab
--principal=kudu/127.4.201.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:40507
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:38309,127.4.201.125:34827,127.4.201.124:46547
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:10:53.661271 9466 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.125" port: 34827 } attempt: 1
I20260812 01:10:53.662442 9471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:53.661990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:34827 (local address 127.0.0.1:52902)
0812 01:10:53.662183 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:53.662303 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.125:34827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260812 01:10:53.663410 9471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:53.663064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:34827 (local address 127.0.0.1:52904)
0812 01:10:53.663211 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:53.663277 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.125:34827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260812 01:10:53.663597 9466 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.125:34827: Network error: Client connection negotiation failed: client connection to 127.4.201.125:34827: connect: Connection refused (error 111)
I20260812 01:10:53.731874 9466 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.125" port: 34827 } attempt: 2
I20260812 01:10:53.733165 9471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:53.732581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:34827 (local address 127.0.0.1:52916)
0812 01:10:53.732865 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:53.732984 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.125:34827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260812 01:10:53.734247 9471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:53.733827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:34827 (local address 127.0.0.1:52924)
0812 01:10:53.733982 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:53.734087 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.125:34827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260812 01:10:53.734479 9466 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.125:34827: Network error: Client connection negotiation failed: client connection to 127.4.201.125:34827: connect: Connection refused (error 111)
I20260812 01:10:53.825752 9466 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.125" port: 34827 } attempt: 3
I20260812 01:10:53.827020 9471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:53.826488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:34827 (local address 127.0.0.1:52930)
0812 01:10:53.826718 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:53.826837 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.125:34827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260812 01:10:53.828096 9471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:53.827682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:34827 (local address 127.0.0.1:52940)
0812 01:10:53.827832 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:53.827929 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.125:34827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260812 01:10:53.828279 9466 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.125:34827: Network error: Client connection negotiation failed: client connection to 127.4.201.125:34827: connect: Connection refused (error 111)
I20260812 01:10:53.971511 9466 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.125" port: 34827 } attempt: 4
I20260812 01:10:53.972791 9471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:53.972165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:34827 (local address 127.0.0.1:52950)
0812 01:10:53.972504 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:53.972615 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.125:34827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171}
I20260812 01:10:53.973879 9471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:53.973462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:34827 (local address 127.0.0.1:52964)
0812 01:10:53.973620 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:53.973718 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.125:34827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260812 01:10:53.974063 9466 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.125:34827: Network error: Client connection negotiation failed: client connection to 127.4.201.125:34827: connect: Connection refused (error 111)
W20260812 01:10:53.991184 9480 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 01:10:53.991532 9480 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:53.991629 9480 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:53.991714 9480 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:53.999132 9480 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:10:53.999212 9480 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:53.999276 9480 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:53.999325 9480 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:10:53.999392 9480 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:10:54.008926 9480 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:40507
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:38309,127.4.201.125:34827,127.4.201.124:46547
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.125.keytab
--principal=kudu/127.4.201.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.125:34827
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.4.201.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:54.010166 9480 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:54.011473 9480 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:54.022648 9490 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:54.022727 9489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:54.022682 9493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:54.023532 9480 server_base.cc:1034] running on GCE node
I20260812 01:10:54.024253 9480 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:54.025590 9480 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:54.026790 9480 hybrid_clock.cc:648] HybridClock initialized: now 1786497054026723 us; error 47 us; skew 500 ppm
I20260812 01:10:54.027082 9480 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:10:54 dist-test-slave-bndk krb5kdc[9339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497054, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:10:54.030041 9480 init.cc:377] Logged in from keytab as kudu/127.4.201.125@KRBTEST.COM (short username kudu)
I20260812 01:10:54.031363 9480 webserver.cc:460] Webserver started at http://127.4.201.125:39861/ using document root <none> and password file <none>
I20260812 01:10:54.031982 9480 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:54.032083 9480 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:54.032369 9480 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:54.035199 9480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-1/data/instance:
uuid: "75a49a6b2edc4a87b7ffe41835a535cf"
format_stamp: "Formatted at 2026-08-12 01:10:54 on dist-test-slave-bndk"
server_key: "bcf26585153ee1c6c24f0a9ff4793d4c"
server_key_iv: "e70ad33282dfe58185ddeee6b62d7fd9"
server_key_version: "encryptionkey@0"
I20260812 01:10:54.035923 9480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-1/wal/instance:
uuid: "75a49a6b2edc4a87b7ffe41835a535cf"
format_stamp: "Formatted at 2026-08-12 01:10:54 on dist-test-slave-bndk"
server_key: "bcf26585153ee1c6c24f0a9ff4793d4c"
server_key_iv: "e70ad33282dfe58185ddeee6b62d7fd9"
server_key_version: "encryptionkey@0"
I20260812 01:10:54.040750 9480 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.004s
I20260812 01:10:54.044106 9508 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:54.045390 9480 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:10:54.045542 9480 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-1/wal
uuid: "75a49a6b2edc4a87b7ffe41835a535cf"
format_stamp: "Formatted at 2026-08-12 01:10:54 on dist-test-slave-bndk"
server_key: "bcf26585153ee1c6c24f0a9ff4793d4c"
server_key_iv: "e70ad33282dfe58185ddeee6b62d7fd9"
server_key_version: "encryptionkey@0"
I20260812 01:10:54.045729 9480 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:54.058593 9480 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:54.062134 9480 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:54.062366 9480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:54.078972 9480 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.125:34827
I20260812 01:10:54.078990 9592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.125:34827 every 8 connection(s)
I20260812 01:10:54.080211 9480 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-1/data/info.pb
I20260812 01:10:54.083061 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 9480
I20260812 01:10:54.083222 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-1/wal/instance
I20260812 01:10:54.083653 4901 external_mini_cluster.cc:1428] Setting key 96d84faf3f14cbece86520b5de531766
I20260812 01:10:54.083760 9594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:54.090196 9594 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38309 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 01:10:54 dist-test-slave-bndk krb5kdc[9339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497054, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.125@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:10:54.110708 9473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.092861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47086 (local address 127.4.201.126:38309)
0812 01:10:54.093066 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:54.093072 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:54.094195 (+ 1123us) server_negotiation.cc:407] Connection header received
0812 01:10:54.096049 (+ 1854us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:54.096054 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:54.096137 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:54.096245 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:54.097836 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.098510 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.100518 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.100911 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.100999 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:54.104723 (+ 3724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:54.104728 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:54.104732 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:54.104763 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:54.107276 (+ 2513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:54.108048 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:54.108053 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:54.108055 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:54.108174 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:54.108576 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:54.108580 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:54.108582 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:54.108864 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:54.108999 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:54.110130 (+ 1131us) server_negotiation.cc:299] Negotiation successful
0812 01:10:54.110375 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 01:10:54.112828 9596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.093281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:38309 (local address 127.0.0.1:47086)
0812 01:10:54.094030 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:54.094076 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:54.095785 (+ 1709us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:54.096427 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:54.096435 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:54.096930 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:10:54.097659 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:54.097683 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.098667 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.098672 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:54.100380 (+ 1708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:54.100395 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.101128 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.101135 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:54.101410 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:54.102071 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:10:54.102100 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:10:54.104513 (+ 2413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:10:54.107409 (+ 2896us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:54.107419 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:54.107434 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:54.107942 (+ 508us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:54.108275 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:54.108280 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:54.108284 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:54.108462 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:54.108994 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:10:54.109001 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:10:54.109389 (+ 388us) client_negotiation.cc:769] Sending connection context
0812 01:10:54.110936 (+ 1547us) client_negotiation.cc:240] Negotiation successful
0812 01:10:54.111451 (+ 515us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":303,"threads_started":1}
I20260812 01:10:54.114899 9594 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.201.125" port: 34827 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.4.201.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.124@KRBTEST.COM" created.
Aug 12 01:10:54 dist-test-slave-bndk krb5kdc[9339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497054, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.125@KRBTEST.COM for kudu/127.4.201.125@KRBTEST.COM
I20260812 01:10:54.135012 9596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.115974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:34827 (local address 127.0.0.1:52980)
0812 01:10:54.118832 (+ 2858us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:54.118856 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:54.118968 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:54.120321 (+ 1353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:54.120326 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:54.120827 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:10:54.121026 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:54.121041 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.122902 (+ 1861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.122908 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:54.124134 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:54.124147 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.124956 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.124962 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:54.125143 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:54.125739 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:10:54.125763 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:10:54.128051 (+ 2288us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:10:54.132260 (+ 4209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:54.132266 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:54.132269 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:54.132761 (+ 492us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:54.133178 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:54.133183 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:54.133187 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:54.133368 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:54.134072 (+ 704us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:10:54.134077 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:10:54.134222 (+ 145us) client_negotiation.cc:769] Sending connection context
0812 01:10:54.134339 (+ 117us) client_negotiation.cc:240] Negotiation successful
0812 01:10:54.134656 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1113}
I20260812 01:10:54.136397 9599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.116420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52980 (local address 127.4.201.125:34827)
0812 01:10:54.119337 (+ 2917us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:54.119346 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:54.119387 (+ 41us) server_negotiation.cc:407] Connection header received
0812 01:10:54.119445 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:54.119450 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:54.120116 (+ 666us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:54.120305 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:54.121236 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.122750 (+ 1514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.124265 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.124815 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.124929 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:54.128239 (+ 3310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:54.128251 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:54.128268 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:54.128297 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:54.132134 (+ 3837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:54.132898 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:54.132906 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:54.132909 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:54.133051 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:54.133497 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:54.133501 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:54.133504 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:54.133935 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:54.135565 (+ 1630us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:54.135761 (+ 196us) server_negotiation.cc:299] Negotiation successful
0812 01:10:54.136015 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2668,"thread_start_us":2492,"threads_started":1}
I20260812 01:10:54.139834 9594 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46547 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:10:54.141048 9596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.140535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46547 (local address 127.0.0.1:55190)
0812 01:10:54.140722 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:54.140863 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260812 01:10:54.141314 9512 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46547: connect: Connection refused (error 111)
I20260812 01:10:54.143222 9596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.142814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46547 (local address 127.0.0.1:55200)
0812 01:10:54.143013 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:54.143103 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
W20260812 01:10:54.143395 9594 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.124:46547: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46547: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.124.keytab.
Entry for principal kudu/127.4.201.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.124.keytab.
I20260812 01:10:54.161451 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.124:46547
--webserver_interface=127.4.201.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.124.keytab
--principal=kudu/127.4.201.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:40507
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:38309,127.4.201.125:34827,127.4.201.124:46547
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:10:54.192734 9594 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46547 } attempt: 1
I20260812 01:10:54.193917 9596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.193476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46547 (local address 127.0.0.1:55202)
0812 01:10:54.193660 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:54.193768 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260812 01:10:54.194828 9596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.194514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46547 (local address 127.0.0.1:55214)
0812 01:10:54.194638 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:54.194724 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260812 01:10:54.195022 9594 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.124:46547: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46547: connect: Connection refused (error 111)
I20260812 01:10:54.263216 9594 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46547 } attempt: 2
I20260812 01:10:54.264382 9596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.263948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46547 (local address 127.0.0.1:55222)
0812 01:10:54.264138 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:54.264228 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260812 01:10:54.265375 9596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.265019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46547 (local address 127.0.0.1:55224)
0812 01:10:54.265146 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:54.265245 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260812 01:10:54.265580 9594 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.124:46547: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46547: connect: Connection refused (error 111)
I20260812 01:10:54.273319 9466 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.125" port: 34827 } attempt: 5
Aug 12 01:10:54 dist-test-slave-bndk krb5kdc[9339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497053, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for kudu/127.4.201.125@KRBTEST.COM
I20260812 01:10:54.285845 9599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.274147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52984 (local address 127.4.201.125:34827)
0812 01:10:54.274314 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:54.274320 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:54.274340 (+ 20us) server_negotiation.cc:407] Connection header received
0812 01:10:54.274404 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:54.274407 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:54.274495 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:54.274581 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:54.275412 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.276124 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.277290 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.277730 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.277843 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:54.281011 (+ 3168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:54.281017 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:54.281020 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:54.281052 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:54.283459 (+ 2407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:54.284197 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:54.284201 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:54.284203 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:54.284312 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:54.284668 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:54.284671 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:54.284673 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:54.284926 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:54.285036 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:54.285462 (+ 426us) server_negotiation.cc:299] Negotiation successful
0812 01:10:54.285631 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 01:10:54.286021 9471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.273948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:34827 (local address 127.0.0.1:52984)
0812 01:10:54.274129 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:54.274145 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:54.274271 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:54.274653 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:54.274659 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:54.275059 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:10:54.275261 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:54.275272 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.276265 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.276269 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:54.277127 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:54.277140 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.277875 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.277882 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:54.278095 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:54.278653 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:10:54.278671 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:10:54.280816 (+ 2145us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:10:54.283595 (+ 2779us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:54.283601 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:54.283606 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:54.284100 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:54.284406 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:54.284410 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:54.284414 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:54.284579 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:54.285029 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:10:54.285034 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:10:54.285196 (+ 162us) client_negotiation.cc:769] Sending connection context
0812 01:10:54.285388 (+ 192us) client_negotiation.cc:240] Negotiation successful
0812 01:10:54.285684 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260812 01:10:54.287078 9466 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46547 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:10:54.287997 9471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.287652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46547 (local address 127.0.0.1:55232)
0812 01:10:54.287789 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:54.287858 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260812 01:10:54.288869 9471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.288582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46547 (local address 127.0.0.1:55236)
0812 01:10:54.288702 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:54.288779 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260812 01:10:54.289070 9466 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.124:46547: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46547: connect: Connection refused (error 111)
I20260812 01:10:54.340267 9466 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46547 } attempt: 1
I20260812 01:10:54.341588 9471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.341082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46547 (local address 127.0.0.1:55246)
0812 01:10:54.341315 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:54.341414 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260812 01:10:54.342590 9471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.342293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46547 (local address 127.0.0.1:55260)
0812 01:10:54.342413 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:54.342483 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260812 01:10:54.342816 9466 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.124:46547: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46547: connect: Connection refused (error 111)
I20260812 01:10:54.356777 9594 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46547 } attempt: 3
I20260812 01:10:54.357905 9596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.357470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46547 (local address 127.0.0.1:55270)
0812 01:10:54.357670 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:54.357761 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260812 01:10:54.358901 9596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.358499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46547 (local address 127.0.0.1:55276)
0812 01:10:54.358720 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:54.358791 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
W20260812 01:10:54.359114 9594 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.124:46547: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46547: connect: Connection refused (error 111)
I20260812 01:10:54.411015 9466 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46547 } attempt: 2
I20260812 01:10:54.412227 9471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.411732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46547 (local address 127.0.0.1:55288)
0812 01:10:54.411951 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:54.412059 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260812 01:10:54.413180 9471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.412845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46547 (local address 127.0.0.1:55296)
0812 01:10:54.413003 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:54.413074 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260812 01:10:54.413450 9466 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.124:46547: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46547: connect: Connection refused (error 111)
W20260812 01:10:54.496292 9604 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 01:10:54.496627 9604 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:54.496728 9604 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:54.496842 9604 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260812 01:10:54.502301 9594 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46547 } attempt: 4
I20260812 01:10:54.503377 9596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.502910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46547 (local address 127.0.0.1:55300)
0812 01:10:54.503142 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:54.503228 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260812 01:10:54.504051 9604 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:10:54.504137 9604 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:54.504221 9604 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:54.504290 9604 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:10:54.504374 9604 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:10:54.504390 9596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.504031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46547 (local address 127.0.0.1:55316)
0812 01:10:54.504174 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:54.504261 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260812 01:10:54.504585 9594 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.124:46547: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46547: connect: Connection refused (error 111)
I20260812 01:10:54.514150 9604 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:40507
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:38309,127.4.201.125:34827,127.4.201.124:46547
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.124.keytab
--principal=kudu/127.4.201.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.124:46547
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.4.201.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:54.515367 9604 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:54.516590 9604 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 01:10:54.519637 9466 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46547 } attempt: 3
I20260812 01:10:54.520596 9471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.520169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46547 (local address 127.0.0.1:55318)
0812 01:10:54.520349 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:54.520433 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260812 01:10:54.521780 9471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.521356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46547 (local address 127.0.0.1:55322)
0812 01:10:54.521551 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:54.521648 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260812 01:10:54.522104 9466 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.124:46547: Network error: Client connection negotiation failed: client connection to 127.4.201.124:46547: connect: Connection refused (error 111)
W20260812 01:10:54.528244 9611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:54.528180 9612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:54.528246 9615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:54.529279 9604 server_base.cc:1034] running on GCE node
I20260812 01:10:54.529999 9604 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:54.531261 9604 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:54.532491 9604 hybrid_clock.cc:648] HybridClock initialized: now 1786497054532423 us; error 40 us; skew 500 ppm
I20260812 01:10:54.532795 9604 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:10:54 dist-test-slave-bndk krb5kdc[9339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497054, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:10:54.539281 9604 init.cc:377] Logged in from keytab as kudu/127.4.201.124@KRBTEST.COM (short username kudu)
I20260812 01:10:54.540802 9604 webserver.cc:460] Webserver started at http://127.4.201.124:42071/ using document root <none> and password file <none>
I20260812 01:10:54.541549 9604 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:54.541644 9604 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:54.541950 9604 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:54.544910 9604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-2/data/instance:
uuid: "30d35b00a09a4d4da8497319539851c9"
format_stamp: "Formatted at 2026-08-12 01:10:54 on dist-test-slave-bndk"
server_key: "87580620ddc407d9373efe28f1587672"
server_key_iv: "9a9412d4f38c9ae59b360684f32732ff"
server_key_version: "encryptionkey@0"
I20260812 01:10:54.545706 9604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-2/wal/instance:
uuid: "30d35b00a09a4d4da8497319539851c9"
format_stamp: "Formatted at 2026-08-12 01:10:54 on dist-test-slave-bndk"
server_key: "87580620ddc407d9373efe28f1587672"
server_key_iv: "9a9412d4f38c9ae59b360684f32732ff"
server_key_version: "encryptionkey@0"
I20260812 01:10:54.550797 9604 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 01:10:54.554061 9626 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:54.555305 9604 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 01:10:54.555461 9604 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-2/wal
uuid: "30d35b00a09a4d4da8497319539851c9"
format_stamp: "Formatted at 2026-08-12 01:10:54 on dist-test-slave-bndk"
server_key: "87580620ddc407d9373efe28f1587672"
server_key_iv: "9a9412d4f38c9ae59b360684f32732ff"
server_key_version: "encryptionkey@0"
I20260812 01:10:54.555658 9604 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:54.569504 9604 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:54.574128 9604 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:54.574384 9604 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:54.592679 9604 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.124:46547
I20260812 01:10:54.592686 9712 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.124:46547 every 8 connection(s)
I20260812 01:10:54.594029 9604 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-2/data/info.pb
I20260812 01:10:54.597662 9714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:54.600628 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 9604
I20260812 01:10:54.600817 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786496689953932-4901-0/minicluster-data/master-2/wal/instance
I20260812 01:10:54.601383 4901 external_mini_cluster.cc:1428] Setting key ad722c0af7ee2df31d14d402db725c58
I20260812 01:10:54.605156 9714 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38309 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 01:10:54 dist-test-slave-bndk krb5kdc[9339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497053, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.124@KRBTEST.COM
Aug 12 01:10:54 dist-test-slave-bndk krb5kdc[9339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497054, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.124@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:10:54.623462 9473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.608382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47096 (local address 127.4.201.126:38309)
0812 01:10:54.608543 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:54.608548 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:54.609178 (+ 630us) server_negotiation.cc:407] Connection header received
0812 01:10:54.609385 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:54.609389 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:54.609457 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:54.609547 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:54.610887 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.611679 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.613362 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.613787 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.613884 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:54.617206 (+ 3322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:54.617234 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:54.617239 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:54.617280 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:54.620361 (+ 3081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:54.621139 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:54.621144 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:54.621148 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:54.621334 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:54.621764 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:54.621768 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:54.621772 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:54.622119 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:54.622249 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:54.622880 (+ 631us) server_negotiation.cc:299] Negotiation successful
0812 01:10:54.623117 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 01:10:54.624301 9720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.603282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55336 (local address 127.4.201.124:46547)
0812 01:10:54.604025 (+ 743us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:54.604037 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:54.604077 (+ 40us) server_negotiation.cc:407] Connection header received
0812 01:10:54.605711 (+ 1634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:54.605734 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:54.606117 (+ 383us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:54.606433 (+ 316us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:54.608180 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.609994 (+ 1814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.611501 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.612280 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.612405 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:54.616826 (+ 4421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:54.616834 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:54.616846 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:54.616878 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:54.620078 (+ 3200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:54.620867 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:54.620873 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:54.620875 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:54.621047 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:54.621457 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:54.621461 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:54.621463 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:54.622085 (+ 622us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:54.622374 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:54.622711 (+ 337us) server_negotiation.cc:299] Negotiation successful
0812 01:10:54.623143 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":6,"server-negotiator.queue_time_us":546,"thread_start_us":341,"threads_started":1}
I20260812 01:10:54.624282 9722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.608358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:38309 (local address 127.0.0.1:47096)
0812 01:10:54.609040 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:54.609074 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:54.609255 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:54.609636 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:54.609643 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:54.610391 (+ 748us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:10:54.610703 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:54.610716 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.611847 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.611851 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:54.613189 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:54.613206 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.614030 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.614039 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:54.614230 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:54.614789 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:10:54.614819 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:10:54.617012 (+ 2193us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:10:54.620483 (+ 3471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:54.620496 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:54.620507 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:54.621025 (+ 518us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:54.621461 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:54.621465 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:54.621467 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:54.621650 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:54.622258 (+ 608us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:10:54.622266 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:10:54.622494 (+ 228us) client_negotiation.cc:769] Sending connection context
0812 01:10:54.622756 (+ 262us) client_negotiation.cc:240] Negotiation successful
0812 01:10:54.623861 (+ 1105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"mutex_wait_us":736,"spinlock_wait_cycles":15232,"thread_start_us":323,"threads_started":1}
I20260812 01:10:54.626556 9714 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.201.125" port: 34827 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 01:10:54 dist-test-slave-bndk krb5kdc[9339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497054, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.124@KRBTEST.COM for kudu/127.4.201.125@KRBTEST.COM
Aug 12 01:10:54 dist-test-slave-bndk krb5kdc[9339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497053, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:10:54.638710 9722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.627324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:34827 (local address 127.0.0.1:52998)
0812 01:10:54.627584 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:54.627601 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:54.627704 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:54.628023 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:54.628028 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:54.628365 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:10:54.628512 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:54.628521 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.629519 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.629525 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:54.630353 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:54.630365 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.631027 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.631032 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:54.631211 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:54.631690 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:10:54.631707 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:10:54.633570 (+ 1863us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:10:54.636455 (+ 2885us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:54.636460 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:54.636465 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:54.636803 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:54.637160 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:54.637166 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:54.637170 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:54.637359 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:54.637833 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:10:54.637838 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:10:54.637989 (+ 151us) client_negotiation.cc:769] Sending connection context
0812 01:10:54.638106 (+ 117us) client_negotiation.cc:240] Negotiation successful
0812 01:10:54.638371 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163}
I20260812 01:10:54.638751 9599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.627416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52998 (local address 127.4.201.125:34827)
0812 01:10:54.627589 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:54.627595 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:54.627649 (+ 54us) server_negotiation.cc:407] Connection header received
0812 01:10:54.627824 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:54.627828 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:54.627891 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:54.627980 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:54.628653 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.629384 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.630492 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.630894 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.631012 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:54.633745 (+ 2733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:54.633750 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:54.633753 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:54.633783 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:54.636335 (+ 2552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:54.636913 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:54.636917 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:54.636919 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:54.637056 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:54.637461 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:54.637465 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:54.637467 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:54.637711 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:54.637850 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:54.638210 (+ 360us) server_negotiation.cc:299] Negotiation successful
0812 01:10:54.638411 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 01:10:54.639740 9714 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46547 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:10:54.640236 9473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.627441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47102 (local address 127.4.201.126:38309)
0812 01:10:54.627594 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:54.627599 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:54.627734 (+ 135us) server_negotiation.cc:407] Connection header received
0812 01:10:54.627889 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:54.627894 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:54.627956 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:54.628041 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:54.629172 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.629912 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.631084 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.631502 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.631610 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:54.635308 (+ 3698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:54.635312 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:54.635316 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:54.635344 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:54.637799 (+ 2455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:54.638385 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:54.638389 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:54.638391 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:54.638511 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:54.638892 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:54.638898 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:54.638901 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:54.639240 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:54.639513 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:54.639804 (+ 291us) server_negotiation.cc:299] Negotiation successful
0812 01:10:54.639997 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
Aug 12 01:10:54 dist-test-slave-bndk krb5kdc[9339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497054, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.124@KRBTEST.COM for kudu/127.4.201.124@KRBTEST.COM
Aug 12 01:10:54 dist-test-slave-bndk krb5kdc[9339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497053, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.125@KRBTEST.COM
I20260812 01:10:54.652542 9722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.640540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46547 (local address 127.0.0.1:55352)
0812 01:10:54.640708 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:54.640727 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:54.640822 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:54.641178 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:54.641183 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:54.641634 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:10:54.641808 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:54.641821 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.642742 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.642748 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:54.643566 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:54.643578 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.644302 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.644306 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:54.644443 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:54.644915 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:10:54.644929 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:10:54.646963 (+ 2034us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:10:54.650138 (+ 3175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:54.650144 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:54.650148 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:54.650627 (+ 479us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:54.651020 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:54.651023 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:54.651026 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:54.651155 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:54.651743 (+ 588us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:10:54.651747 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:10:54.651879 (+ 132us) client_negotiation.cc:769] Sending connection context
0812 01:10:54.651989 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 01:10:54.652236 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260812 01:10:54.652770 9720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.640800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55352 (local address 127.4.201.124:46547)
0812 01:10:54.640935 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:54.640939 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:54.640952 (+ 13us) server_negotiation.cc:407] Connection header received
0812 01:10:54.640989 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:54.640992 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:54.641041 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:54.641135 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:54.641963 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.642625 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.643702 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.644093 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.644162 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:54.647152 (+ 2990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:54.647158 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:54.647163 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:54.647199 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:54.650000 (+ 2801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:54.650743 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:54.650748 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:54.650751 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:54.650902 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:54.651260 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:54.651266 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:54.651269 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:54.651610 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:54.651755 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:54.652110 (+ 355us) server_negotiation.cc:299] Negotiation successful
0812 01:10:54.652411 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":44}
I20260812 01:10:54.656111 9599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.641802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53010 (local address 127.4.201.125:34827)
0812 01:10:54.641947 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:54.641952 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:54.641982 (+ 30us) server_negotiation.cc:407] Connection header received
0812 01:10:54.642141 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:54.642146 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:54.642208 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:54.642282 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:54.643442 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.644219 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.645518 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.645990 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.646112 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:54.650763 (+ 4651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:54.650769 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:54.650773 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:54.650808 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:54.653680 (+ 2872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:54.654344 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:54.654348 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:54.654351 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:54.654494 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:54.654844 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:54.654848 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:54.654850 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:54.655109 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:54.655367 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:54.655620 (+ 253us) server_negotiation.cc:299] Negotiation successful
0812 01:10:54.655832 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 01:10:54.657677 9714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30d35b00a09a4d4da8497319539851c9: Bootstrap starting.
I20260812 01:10:54.660989 4901 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:10:54.661445 9714 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 30d35b00a09a4d4da8497319539851c9: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:54.662716 9714 log.cc:824] T 00000000000000000000000000000000 P 30d35b00a09a4d4da8497319539851c9: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:54.665495 9714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30d35b00a09a4d4da8497319539851c9: No bootstrap required, opened a new log
I20260812 01:10:54.664390 9426 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "895f7dc431f64065a324e26ea4e7511e"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47102
I20260812 01:10:54.672390 9714 raft_consensus.cc:348] T 00000000000000000000000000000000 P 30d35b00a09a4d4da8497319539851c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895f7dc431f64065a324e26ea4e7511e" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38309 } } peers { permanent_uuid: "75a49a6b2edc4a87b7ffe41835a535cf" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 34827 } } peers { permanent_uuid: "30d35b00a09a4d4da8497319539851c9" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46547 } }
I20260812 01:10:54.672716 9714 raft_consensus.cc:729] T 00000000000000000000000000000000 P 30d35b00a09a4d4da8497319539851c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30d35b00a09a4d4da8497319539851c9, State: Initialized, Role: FOLLOWER
I20260812 01:10:54.673130 9714 consensus_queue.cc:260] T 00000000000000000000000000000000 P 30d35b00a09a4d4da8497319539851c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895f7dc431f64065a324e26ea4e7511e" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38309 } } peers { permanent_uuid: "75a49a6b2edc4a87b7ffe41835a535cf" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 34827 } } peers { permanent_uuid: "30d35b00a09a4d4da8497319539851c9" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46547 } }
I20260812 01:10:54.674017 9725 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30d35b00a09a4d4da8497319539851c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895f7dc431f64065a324e26ea4e7511e" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38309 } } peers { permanent_uuid: "75a49a6b2edc4a87b7ffe41835a535cf" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 34827 } } peers { permanent_uuid: "30d35b00a09a4d4da8497319539851c9" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46547 } } }
I20260812 01:10:54.674320 9725 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30d35b00a09a4d4da8497319539851c9 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:10:54.675282 9714 sys_catalog.cc:564] T 00000000000000000000000000000000 P 30d35b00a09a4d4da8497319539851c9 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 01:10:54.683689 9748 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 30d35b00a09a4d4da8497319539851c9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 01:10:54.683804 9748 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 01:10:54.682173 9604 master_runner.cc:186] Error getting master registration for 127.4.201.126:38309: OK, instance_id { permanent_uuid: "895f7dc431f64065a324e26ea4e7511e" instance_seqno: 1786497053567423 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 01:10:54.692871 9604 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:10:54.699343 9466 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46547 } attempt: 4
Aug 12 01:10:54 dist-test-slave-bndk krb5kdc[9339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497053, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for kudu/127.4.201.124@KRBTEST.COM
I20260812 01:10:54.715867 9471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.700093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46547 (local address 127.0.0.1:55354)
0812 01:10:54.700280 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:54.700300 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:54.700408 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:54.700773 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:54.700779 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:54.701338 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:10:54.701564 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:54.701576 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.703048 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.703054 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:54.704527 (+ 1473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:54.704544 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.705595 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.705602 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:54.705808 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:54.706404 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:10:54.706426 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:10:54.709186 (+ 2760us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:10:54.713119 (+ 3933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:54.713125 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:54.713128 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:54.713658 (+ 530us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:54.714059 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:54.714064 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:54.714068 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:54.714236 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:54.714904 (+ 668us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:10:54.714909 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:10:54.715070 (+ 161us) client_negotiation.cc:769] Sending connection context
0812 01:10:54.715200 (+ 130us) client_negotiation.cc:240] Negotiation successful
0812 01:10:54.715467 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 01:10:54.715936 9720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.700159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55354 (local address 127.4.201.124:46547)
0812 01:10:54.700362 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:54.700368 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:54.700392 (+ 24us) server_negotiation.cc:407] Connection header received
0812 01:10:54.700536 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:54.700542 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:54.700625 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:54.700742 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:54.701727 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.702884 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.704680 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.705444 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.705576 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:54.709391 (+ 3815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:54.709399 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:54.709404 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:54.709445 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:54.712982 (+ 3537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:54.713780 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:54.713786 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:54.713790 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:54.713936 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:54.714358 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:54.714364 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:54.714367 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:54.714795 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:54.714996 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:54.715350 (+ 354us) server_negotiation.cc:299] Negotiation successful
0812 01:10:54.715578 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 01:10:54.722265 9466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 895f7dc431f64065a324e26ea4e7511e: Bootstrap starting.
I20260812 01:10:54.726596 9466 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 895f7dc431f64065a324e26ea4e7511e: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:54.727978 9466 log.cc:824] T 00000000000000000000000000000000 P 895f7dc431f64065a324e26ea4e7511e: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:54.731480 9466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 895f7dc431f64065a324e26ea4e7511e: No bootstrap required, opened a new log
I20260812 01:10:54.739080 9466 raft_consensus.cc:348] T 00000000000000000000000000000000 P 895f7dc431f64065a324e26ea4e7511e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895f7dc431f64065a324e26ea4e7511e" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38309 } } peers { permanent_uuid: "75a49a6b2edc4a87b7ffe41835a535cf" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 34827 } } peers { permanent_uuid: "30d35b00a09a4d4da8497319539851c9" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46547 } }
I20260812 01:10:54.739501 9466 raft_consensus.cc:729] T 00000000000000000000000000000000 P 895f7dc431f64065a324e26ea4e7511e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895f7dc431f64065a324e26ea4e7511e, State: Initialized, Role: FOLLOWER
I20260812 01:10:54.740036 9466 consensus_queue.cc:260] T 00000000000000000000000000000000 P 895f7dc431f64065a324e26ea4e7511e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895f7dc431f64065a324e26ea4e7511e" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38309 } } peers { permanent_uuid: "75a49a6b2edc4a87b7ffe41835a535cf" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 34827 } } peers { permanent_uuid: "30d35b00a09a4d4da8497319539851c9" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46547 } }
I20260812 01:10:54.741130 9755 sys_catalog.cc:455] T 00000000000000000000000000000000 P 895f7dc431f64065a324e26ea4e7511e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895f7dc431f64065a324e26ea4e7511e" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38309 } } peers { permanent_uuid: "75a49a6b2edc4a87b7ffe41835a535cf" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 34827 } } peers { permanent_uuid: "30d35b00a09a4d4da8497319539851c9" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46547 } } }
I20260812 01:10:54.741541 9755 sys_catalog.cc:458] T 00000000000000000000000000000000 P 895f7dc431f64065a324e26ea4e7511e [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:10:54.742466 9466 sys_catalog.cc:564] T 00000000000000000000000000000000 P 895f7dc431f64065a324e26ea4e7511e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:10:54.742537 9426 raft_consensus.cc:482] T 00000000000000000000000000000000 P 895f7dc431f64065a324e26ea4e7511e [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 01:10:54.742741 9426 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 895f7dc431f64065a324e26ea4e7511e [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:54.745657 9426 raft_consensus.cc:504] T 00000000000000000000000000000000 P 895f7dc431f64065a324e26ea4e7511e [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895f7dc431f64065a324e26ea4e7511e" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38309 } } peers { permanent_uuid: "75a49a6b2edc4a87b7ffe41835a535cf" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 34827 } } peers { permanent_uuid: "30d35b00a09a4d4da8497319539851c9" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46547 } }
I20260812 01:10:54.748148 9426 leader_election.cc:288] T 00000000000000000000000000000000 P 895f7dc431f64065a324e26ea4e7511e [CANDIDATE]: Term 1 election: Requested vote from peers 75a49a6b2edc4a87b7ffe41835a535cf (127.4.201.125:34827), 30d35b00a09a4d4da8497319539851c9 (127.4.201.124:46547)
I20260812 01:10:54.749245 9672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "895f7dc431f64065a324e26ea4e7511e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "30d35b00a09a4d4da8497319539851c9"
I20260812 01:10:54.750432 9672 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 30d35b00a09a4d4da8497319539851c9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:54.753892 9672 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 30d35b00a09a4d4da8497319539851c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895f7dc431f64065a324e26ea4e7511e in term 1.
I20260812 01:10:54.754678 9386 leader_election.cc:302] T 00000000000000000000000000000000 P 895f7dc431f64065a324e26ea4e7511e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d35b00a09a4d4da8497319539851c9, 895f7dc431f64065a324e26ea4e7511e; no voters:
I20260812 01:10:54.755149 9755 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 895f7dc431f64065a324e26ea4e7511e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:10:54.757244 9755 raft_consensus.cc:686] T 00000000000000000000000000000000 P 895f7dc431f64065a324e26ea4e7511e [term 1 LEADER]: Becoming Leader. State: Replica: 895f7dc431f64065a324e26ea4e7511e, State: Running, Role: LEADER
I20260812 01:10:54.757850 9755 consensus_queue.cc:237] T 00000000000000000000000000000000 P 895f7dc431f64065a324e26ea4e7511e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895f7dc431f64065a324e26ea4e7511e" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38309 } } peers { permanent_uuid: "75a49a6b2edc4a87b7ffe41835a535cf" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 34827 } } peers { permanent_uuid: "30d35b00a09a4d4da8497319539851c9" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46547 } }
I20260812 01:10:54.768811 9771 sys_catalog.cc:455] T 00000000000000000000000000000000 P 895f7dc431f64065a324e26ea4e7511e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 895f7dc431f64065a324e26ea4e7511e. Latest consensus state: current_term: 1 leader_uuid: "895f7dc431f64065a324e26ea4e7511e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895f7dc431f64065a324e26ea4e7511e" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38309 } } peers { permanent_uuid: "75a49a6b2edc4a87b7ffe41835a535cf" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 34827 } } peers { permanent_uuid: "30d35b00a09a4d4da8497319539851c9" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46547 } } }
I20260812 01:10:54.769275 9771 sys_catalog.cc:458] T 00000000000000000000000000000000 P 895f7dc431f64065a324e26ea4e7511e [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:54.770511 9780 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:10:54.776904 9781 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 01:10:54.792656 9780 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:10:54.781572 9359 master_runner.cc:186] Error getting master registration for 127.4.201.125:34827: OK, instance_id { permanent_uuid: "75a49a6b2edc4a87b7ffe41835a535cf" instance_seqno: 1786497054074294 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 01:10:54.794768 9359 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:10:54.803797 9594 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46547 } attempt: 5
W20260812 01:10:54.808326 9392 tablet.cc:2369] T 00000000000000000000000000000000 P 895f7dc431f64065a324e26ea4e7511e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:10:54.811074 9672 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 30d35b00a09a4d4da8497319539851c9 [term 1 FOLLOWER]: Refusing update from remote peer 895f7dc431f64065a324e26ea4e7511e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:10:54.813107 9755 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 895f7dc431f64065a324e26ea4e7511e [LEADER]: Connected to new peer: Peer: permanent_uuid: "30d35b00a09a4d4da8497319539851c9" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:10:54.825143 9599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.785099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53012 (local address 127.4.201.125:34827)
0812 01:10:54.785290 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:54.785296 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:54.802248 (+ 16952us) server_negotiation.cc:407] Connection header received
0812 01:10:54.802510 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:54.802516 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:54.802592 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:54.802663 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:54.805903 (+ 3240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.807012 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.809579 (+ 2567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.810202 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.810300 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:54.816234 (+ 5934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:54.816241 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:54.816246 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:54.816289 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:54.819874 (+ 3585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:54.821205 (+ 1331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:54.821210 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:54.821256 (+ 46us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:54.821516 (+ 260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:54.822279 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:54.822285 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:54.822289 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:54.822903 (+ 614us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:54.823262 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:54.824234 (+ 972us) server_negotiation.cc:299] Negotiation successful
0812 01:10:54.824612 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260812 01:10:54.826519 9633 tablet.cc:2369] T 00000000000000000000000000000000 P 30d35b00a09a4d4da8497319539851c9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:10:54.829576 9473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.779582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47104 (local address 127.4.201.126:38309)
0812 01:10:54.779766 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:54.779774 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:54.797175 (+ 17401us) server_negotiation.cc:407] Connection header received
0812 01:10:54.797500 (+ 325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:54.797506 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:54.797594 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:54.797668 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:54.800051 (+ 2383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.801306 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.804914 (+ 3608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.805648 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.805757 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:54.812177 (+ 6420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:54.812184 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:54.812189 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:54.812229 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:54.821172 (+ 8943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:54.825206 (+ 4034us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:54.825242 (+ 36us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:54.825251 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:54.825533 (+ 282us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:54.827353 (+ 1820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:54.827358 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:54.827362 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:54.827751 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:54.827988 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:54.828924 (+ 936us) server_negotiation.cc:299] Negotiation successful
0812 01:10:54.829188 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 01:10:54.837925 9720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.797364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55366 (local address 127.4.201.124:46547)
0812 01:10:54.797545 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:54.797551 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:54.803623 (+ 6072us) server_negotiation.cc:407] Connection header received
0812 01:10:54.803914 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:54.803924 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:54.804052 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:54.804130 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:54.811193 (+ 7063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.812285 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.816656 (+ 4371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.817346 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.817446 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:54.828137 (+ 10691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:54.828144 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:54.828149 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:54.828194 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:54.832232 (+ 4038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:54.832968 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:54.832974 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:54.833017 (+ 43us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:54.833386 (+ 369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:54.834033 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:54.834039 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:54.834043 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:54.834774 (+ 731us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:54.836426 (+ 1652us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:54.836686 (+ 260us) server_negotiation.cc:299] Negotiation successful
0812 01:10:54.837170 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
Aug 12 01:10:54 dist-test-slave-bndk krb5kdc[9339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497054, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.125@KRBTEST.COM for kudu/127.4.201.124@KRBTEST.COM
I20260812 01:10:54.853735 9596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.804357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:46547 (local address 127.0.0.1:55382)
0812 01:10:54.804703 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:54.804722 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:54.804825 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:54.825337 (+ 20512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:54.825343 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:54.825831 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:10:54.826032 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:54.826044 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.833337 (+ 7293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.833344 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:54.834825 (+ 1481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:54.834841 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.835959 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.835966 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:54.836209 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:54.836849 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:10:54.836873 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:10:54.839836 (+ 2963us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:10:54.850636 (+ 10800us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:54.850643 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:54.850648 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:54.851234 (+ 586us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:54.851752 (+ 518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:54.851758 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:54.851762 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:54.851934 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:54.852630 (+ 696us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:10:54.852636 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:10:54.852806 (+ 170us) client_negotiation.cc:769] Sending connection context
0812 01:10:54.852956 (+ 150us) client_negotiation.cc:240] Negotiation successful
0812 01:10:54.853288 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234}
I20260812 01:10:54.855234 9792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:54.805019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55382 (local address 127.4.201.124:46547)
0812 01:10:54.823726 (+ 18707us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:54.823732 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:54.823756 (+ 24us) server_negotiation.cc:407] Connection header received
0812 01:10:54.823804 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:54.823809 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:54.823882 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:54.826182 (+ 2300us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:54.826450 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.827634 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.835039 (+ 7405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:54.835783 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:54.840020 (+ 4237us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:54.840263 (+ 243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:54.840269 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:54.840275 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:54.840306 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:54.850436 (+ 10130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:54.851439 (+ 1003us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:54.851444 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:54.851449 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:54.851613 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:54.852073 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:54.852078 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:54.852081 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:54.852478 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:54.854393 (+ 1915us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:54.854562 (+ 169us) server_negotiation.cc:299] Negotiation successful
0812 01:10:54.854800 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18548,"thread_start_us":18942,"threads_started":1}
I20260812 01:10:54.861778 9594 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75a49a6b2edc4a87b7ffe41835a535cf: Bootstrap starting.
I20260812 01:10:54.864761 9725 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30d35b00a09a4d4da8497319539851c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 895f7dc431f64065a324e26ea4e7511e. Latest consensus state: current_term: 1 leader_uuid: "895f7dc431f64065a324e26ea4e7511e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895f7dc431f64065a324e26ea4e7511e" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38309 } } peers { permanent_uuid: "75a49a6b2edc4a87b7ffe41835a535cf" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 34827 } } peers { permanent_uuid: "30d35b00a09a4d4da8497319539851c9" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46547 } } }
I20260812 01:10:54.865098 9725 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30d35b00a09a4d4da8497319539851c9 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:10:54.865499 9788 mvcc.cc:205] Tried to move back new op lower bound from 7317491936470446080 to 7317491936293400576. Current Snapshot: MvccSnapshot[applied={T|T < 7317491936470446080}]
I20260812 01:10:54.869963 9594 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 75a49a6b2edc4a87b7ffe41835a535cf: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:54.875036 9594 log.cc:824] T 00000000000000000000000000000000 P 75a49a6b2edc4a87b7ffe41835a535cf: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:54.880934 9725 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30d35b00a09a4d4da8497319539851c9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "895f7dc431f64065a324e26ea4e7511e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895f7dc431f64065a324e26ea4e7511e" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38309 } } peers { permanent_uuid: "75a49a6b2edc4a87b7ffe41835a535cf" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 34827 } } peers { permanent_uuid: "30d35b00a09a4d4da8497319539851c9" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46547 } } }
I20260812 01:10:54.881181 9725 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30d35b00a09a4d4da8497319539851c9 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:10:54.883428 9780 catalog_manager.cc:1347] Generated new cluster ID: 03739ce9ae4246fdaccc11db54ff9a78
I20260812 01:10:54.883545 9780 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:10:54.885109 9755 sys_catalog.cc:455] T 00000000000000000000000000000000 P 895f7dc431f64065a324e26ea4e7511e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "895f7dc431f64065a324e26ea4e7511e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895f7dc431f64065a324e26ea4e7511e" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38309 } } peers { permanent_uuid: "75a49a6b2edc4a87b7ffe41835a535cf" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 34827 } } peers { permanent_uuid: "30d35b00a09a4d4da8497319539851c9" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46547 } } }
I20260812 01:10:54.885443 9755 sys_catalog.cc:458] T 00000000000000000000000000000000 P 895f7dc431f64065a324e26ea4e7511e [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:54.888290 9594 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75a49a6b2edc4a87b7ffe41835a535cf: No bootstrap required, opened a new log
I20260812 01:10:54.900509 9780 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:10:54.902369 9780 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:10:54.904448 9594 raft_consensus.cc:348] T 00000000000000000000000000000000 P 75a49a6b2edc4a87b7ffe41835a535cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895f7dc431f64065a324e26ea4e7511e" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38309 } } peers { permanent_uuid: "75a49a6b2edc4a87b7ffe41835a535cf" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 34827 } } peers { permanent_uuid: "30d35b00a09a4d4da8497319539851c9" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46547 } }
I20260812 01:10:54.905040 9594 raft_consensus.cc:729] T 00000000000000000000000000000000 P 75a49a6b2edc4a87b7ffe41835a535cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75a49a6b2edc4a87b7ffe41835a535cf, State: Initialized, Role: FOLLOWER
I20260812 01:10:54.905966 9594 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75a49a6b2edc4a87b7ffe41835a535cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895f7dc431f64065a324e26ea4e7511e" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38309 } } peers { permanent_uuid: "75a49a6b2edc4a87b7ffe41835a535cf" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 34827 } } peers { permanent_uuid: "30d35b00a09a4d4da8497319539851c9" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46547 } }
I20260812 01:10:54.917886 9554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "895f7dc431f64065a324e26ea4e7511e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "75a49a6b2edc4a87b7ffe41835a535cf"
I20260812 01:10:54.918267 9552 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 75a49a6b2edc4a87b7ffe41835a535cf [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:54.918541 9594 sys_catalog.cc:564] T 00000000000000000000000000000000 P 75a49a6b2edc4a87b7ffe41835a535cf [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:10:54.922113 9552 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 75a49a6b2edc4a87b7ffe41835a535cf [term 1 FOLLOWER]: Refusing update from remote peer 895f7dc431f64065a324e26ea4e7511e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:10:54.923210 9780 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 895f7dc431f64065a324e26ea4e7511e: Generated new TSK 0
I20260812 01:10:54.924239 9780 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:10:54.925477 9554 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 75a49a6b2edc4a87b7ffe41835a535cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895f7dc431f64065a324e26ea4e7511e in term 1.
I20260812 01:10:54.927130 9771 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 895f7dc431f64065a324e26ea4e7511e [LEADER]: Connected to new peer: Peer: permanent_uuid: "75a49a6b2edc4a87b7ffe41835a535cf" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 34827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:10:54.927430 9801 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75a49a6b2edc4a87b7ffe41835a535cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895f7dc431f64065a324e26ea4e7511e" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38309 } } peers { permanent_uuid: "75a49a6b2edc4a87b7ffe41835a535cf" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 34827 } } peers { permanent_uuid: "30d35b00a09a4d4da8497319539851c9" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46547 } } }
I20260812 01:10:54.927850 9801 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75a49a6b2edc4a87b7ffe41835a535cf [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:10:54.979205 9801 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75a49a6b2edc4a87b7ffe41835a535cf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 895f7dc431f64065a324e26ea4e7511e. Latest consensus state: current_term: 1 leader_uuid: "895f7dc431f64065a324e26ea4e7511e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895f7dc431f64065a324e26ea4e7511e" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38309 } } peers { permanent_uuid: "75a49a6b2edc4a87b7ffe41835a535cf" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 34827 } } peers { permanent_uuid: "30d35b00a09a4d4da8497319539851c9" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46547 } } }
I20260812 01:10:54.979581 9801 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75a49a6b2edc4a87b7ffe41835a535cf [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:10:54.979939 9804 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75a49a6b2edc4a87b7ffe41835a535cf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "895f7dc431f64065a324e26ea4e7511e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895f7dc431f64065a324e26ea4e7511e" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38309 } } peers { permanent_uuid: "75a49a6b2edc4a87b7ffe41835a535cf" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 34827 } } peers { permanent_uuid: "30d35b00a09a4d4da8497319539851c9" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46547 } } }
I20260812 01:10:54.980333 9804 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75a49a6b2edc4a87b7ffe41835a535cf [sys.catalog]: This master's current role is: FOLLOWER
W20260812 01:10:55.044160 4901 mini_kdc.cc:348] Time spent kdestroy: real 0.105s user 0.002s sys 0.033s
I20260812 01:10:55.061643 9833 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
W20260812 01:10:55.104431 9473 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:10:55.081384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47108 (local address 127.4.201.126:38309)
0812 01:10:55.081602 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:55.081609 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:55.101351 (+ 19742us) server_negotiation.cc:407] Connection header received
0812 01:10:55.102841 (+ 1490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:55.102848 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:55.102934 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:55.103003 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:55.104176 (+ 1173us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47108: BlockingRecv error: recv got EOF from 127.0.0.1:47108 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260812 01:10:55.106383 9599 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:10:55.078544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53018 (local address 127.4.201.125:34827)
0812 01:10:55.078750 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:55.078756 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:55.100844 (+ 22088us) server_negotiation.cc:407] Connection header received
0812 01:10:55.104975 (+ 4131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:55.104981 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:55.105088 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:55.105155 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:55.106178 (+ 1023us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53018: BlockingRecv error: recv got EOF from 127.0.0.1:53018 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260812 01:10:55.108608 9792 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:10:55.101932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55394 (local address 127.4.201.124:46547)
0812 01:10:55.102123 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:55.102129 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:55.107096 (+ 4967us) server_negotiation.cc:407] Connection header received
0812 01:10:55.107230 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:55.107235 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:55.107337 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:55.107434 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:55.108360 (+ 926us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55394: BlockingRecv error: recv got EOF from 127.0.0.1:55394 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260812 01:10:55.118944 9599 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:10:55.114785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53030 (local address 127.4.201.125:34827)
0812 01:10:55.114950 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:55.114954 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:55.117698 (+ 2744us) server_negotiation.cc:407] Connection header received
0812 01:10:55.117898 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:55.117902 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:55.117993 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:55.118077 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:55.118735 (+ 658us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53030: BlockingRecv error: recv got EOF from 127.0.0.1:53030 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260812 01:10:55.126812 9599 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:10:55.123630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53036 (local address 127.4.201.125:34827)
0812 01:10:55.123772 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:55.123777 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:55.125691 (+ 1914us) server_negotiation.cc:407] Connection header received
0812 01:10:55.125866 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:55.125870 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:55.125936 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:55.126018 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:55.126668 (+ 650us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53036: BlockingRecv error: recv got EOF from 127.0.0.1:53036 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
W20260812 01:10:55.134382 9599 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:10:55.132537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53042 (local address 127.4.201.125:34827)
0812 01:10:55.132702 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:55.132709 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:55.133140 (+ 431us) server_negotiation.cc:407] Connection header received
0812 01:10:55.133350 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:55.133355 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:55.133432 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:55.133524 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:55.134200 (+ 676us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53042: BlockingRecv error: recv got EOF from 127.0.0.1:53042 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260812 01:10:55.144934 9599 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:10:55.142997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53052 (local address 127.4.201.125:34827)
0812 01:10:55.143217 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:55.143224 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:55.143708 (+ 484us) server_negotiation.cc:407] Connection header received
0812 01:10:55.143889 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:55.143894 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:55.143964 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:55.144046 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:55.144741 (+ 695us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53052: BlockingRecv error: recv got EOF from 127.0.0.1:53052 (error 108)
Metrics: {"server-negotiator.queue_time_us":106}
W20260812 01:10:55.161036 9599 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:10:55.158565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53054 (local address 127.4.201.125:34827)
0812 01:10:55.158804 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:55.158810 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:55.159393 (+ 583us) server_negotiation.cc:407] Connection header received
0812 01:10:55.159634 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:55.159640 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:55.159727 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:55.159824 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:55.160812 (+ 988us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53054: BlockingRecv error: recv got EOF from 127.0.0.1:53054 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260812 01:10:55.183087 9599 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:10:55.180784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53056 (local address 127.4.201.125:34827)
0812 01:10:55.180974 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:55.180980 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:55.181563 (+ 583us) server_negotiation.cc:407] Connection header received
0812 01:10:55.181769 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:55.181774 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:55.181873 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:55.181998 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:55.182853 (+ 855us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53056: BlockingRecv error: recv got EOF from 127.0.0.1:53056 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260812 01:10:55.221824 9599 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:10:55.219422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53064 (local address 127.4.201.125:34827)
0812 01:10:55.219626 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:55.219632 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:55.220198 (+ 566us) server_negotiation.cc:407] Connection header received
0812 01:10:55.220420 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:55.220426 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:55.220531 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:55.220655 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:55.221547 (+ 892us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53064: BlockingRecv error: recv got EOF from 127.0.0.1:53064 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260812 01:10:55.290992 9599 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:10:55.289120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53076 (local address 127.4.201.125:34827)
0812 01:10:55.289367 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:55.289374 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:55.289657 (+ 283us) server_negotiation.cc:407] Connection header received
0812 01:10:55.289840 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:55.289846 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:55.289942 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:55.290077 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:55.290777 (+ 700us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53076: BlockingRecv error: recv got EOF from 127.0.0.1:53076 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260812 01:10:55.424347 9599 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:10:55.422512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53082 (local address 127.4.201.125:34827)
0812 01:10:55.422747 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:55.422754 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:55.423045 (+ 291us) server_negotiation.cc:407] Connection header received
0812 01:10:55.423222 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:55.423226 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:55.423302 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:55.423390 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:55.424087 (+ 697us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53082: BlockingRecv error: recv got EOF from 127.0.0.1:53082 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 01:10:55.429692 9771 sys_catalog.cc:455] T 00000000000000000000000000000000 P 895f7dc431f64065a324e26ea4e7511e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "895f7dc431f64065a324e26ea4e7511e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895f7dc431f64065a324e26ea4e7511e" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 38309 } } peers { permanent_uuid: "75a49a6b2edc4a87b7ffe41835a535cf" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 34827 } } peers { permanent_uuid: "30d35b00a09a4d4da8497319539851c9" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 46547 } } }
I20260812 01:10:55.430004 9771 sys_catalog.cc:458] T 00000000000000000000000000000000 P 895f7dc431f64065a324e26ea4e7511e [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:55.686515 9748 catalog_manager.cc:1259] Loaded cluster ID: 03739ce9ae4246fdaccc11db54ff9a78
I20260812 01:10:55.686646 9748 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 30d35b00a09a4d4da8497319539851c9: loading cluster ID for follower catalog manager: success
W20260812 01:10:55.689244 9599 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:10:55.687241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53090 (local address 127.4.201.125:34827)
0812 01:10:55.687402 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:55.687407 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:55.687796 (+ 389us) server_negotiation.cc:407] Connection header received
0812 01:10:55.687987 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:55.687991 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:55.688072 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:55.688164 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:55.689015 (+ 851us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53090: BlockingRecv error: recv got EOF from 127.0.0.1:53090 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 01:10:55.690327 9748 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 30d35b00a09a4d4da8497319539851c9: acquiring CA information for follower catalog manager: success
I20260812 01:10:55.692134 9748 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 30d35b00a09a4d4da8497319539851c9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 01:10:56.066104 9833 catalog_manager.cc:1259] Loaded cluster ID: 03739ce9ae4246fdaccc11db54ff9a78
I20260812 01:10:56.066227 9833 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 75a49a6b2edc4a87b7ffe41835a535cf: loading cluster ID for follower catalog manager: success
I20260812 01:10:56.068969 9833 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 75a49a6b2edc4a87b7ffe41835a535cf: acquiring CA information for follower catalog manager: success
I20260812 01:10:56.070789 9833 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 75a49a6b2edc4a87b7ffe41835a535cf: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 01:10:56.218441 9935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:56.210915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53106 (local address 127.4.201.125:34827)
0812 01:10:56.211625 (+ 710us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:56.211631 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:56.211945 (+ 314us) server_negotiation.cc:407] Connection header received
0812 01:10:56.212151 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:56.212155 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:56.212314 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:56.212436 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:10:56.212971 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:56.213827 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:56.215846 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:56.216357 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:56.216465 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:56.217072 (+ 607us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:10:56.217755 (+ 683us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:10:56.217883 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:56.218027 (+ 144us) server_negotiation.cc:299] Negotiation successful
0812 01:10:56.218100 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":550,"thread_start_us":352,"threads_started":1}
I20260812 01:10:56.232895 9952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:56.227448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55400 (local address 127.4.201.124:46547)
0812 01:10:56.228050 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:56.228057 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:56.228074 (+ 17us) server_negotiation.cc:407] Connection header received
0812 01:10:56.228168 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:56.228173 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:56.228330 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:56.228476 (+ 146us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:10:56.228887 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:56.229627 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:56.230850 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:56.231244 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:56.231368 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:56.231805 (+ 437us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:10:56.232295 (+ 490us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:10:56.232428 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:56.232530 (+ 102us) server_negotiation.cc:299] Negotiation successful
0812 01:10:56.232610 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":475,"thread_start_us":361,"threads_started":1}
I20260812 01:10:56.260157 9935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:56.238979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53114 (local address 127.4.201.125:34827)
0812 01:10:56.239160 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:56.239167 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:56.253473 (+ 14306us) server_negotiation.cc:407] Connection header received
0812 01:10:56.253856 (+ 383us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:56.253861 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:56.253941 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:56.254001 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:10:56.254711 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:56.255821 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:56.257841 (+ 2020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:56.258469 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:56.258577 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:56.259284 (+ 707us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:10:56.259438 (+ 154us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:10:56.259505 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:56.259765 (+ 260us) server_negotiation.cc:299] Negotiation successful
0812 01:10:56.259881 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 01:10:56.261130 9952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:56.246592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55402 (local address 127.4.201.124:46547)
0812 01:10:56.246768 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:56.246775 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:56.254793 (+ 8018us) server_negotiation.cc:407] Connection header received
0812 01:10:56.254955 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:56.254961 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:56.255054 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:56.255138 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:10:56.255848 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:56.256868 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:56.259079 (+ 2211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:56.259660 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:56.259743 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:56.260355 (+ 612us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:10:56.260488 (+ 133us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:10:56.260548 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:56.260790 (+ 242us) server_negotiation.cc:299] Negotiation successful
0812 01:10:56.260871 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 01:10:56.263316 9962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:56.238939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47120 (local address 127.4.201.126:38309)
0812 01:10:56.255254 (+ 16315us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:56.255260 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:56.255278 (+ 18us) server_negotiation.cc:407] Connection header received
0812 01:10:56.255387 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:56.255392 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:56.255615 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:56.256573 (+ 958us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:10:56.256735 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:56.257754 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:56.259755 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:56.260321 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:56.260919 (+ 598us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:56.261096 (+ 177us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:10:56.262387 (+ 1291us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:10:56.262880 (+ 493us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:56.262934 (+ 54us) server_negotiation.cc:299] Negotiation successful
0812 01:10:56.263019 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16188,"thread_start_us":16245,"threads_started":1}
I20260812 01:10:56.268515 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 9359
I20260812 01:10:56.269840 9457 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:10:56.379534 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 9359
I20260812 01:10:56.418052 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 9480
I20260812 01:10:56.419425 9584 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:10:56.528745 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 9480
I20260812 01:10:56.553259 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 9604
I20260812 01:10:56.554353 9707 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:10:56.660678 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 9604
2026-08-12T01:10:56Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5071 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 01:10:56 dist-test-slave-bndk krb5kdc[9974](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 01:10:56 dist-test-slave-bndk krb5kdc[9974](info): set up 2 sockets
Aug 12 01:10:56 dist-test-slave-bndk krb5kdc[9974](info): commencing operation
krb5kdc: starting...
W20260812 01:10:57.919061 4901 mini_kdc.cc:121] Time spent starting KDC: real 1.213s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/krb5kdc/test-user.keytab.
Aug 12 01:10:58 dist-test-slave-bndk krb5kdc[9974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497058, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T01:10:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:10:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.201.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
Entry for principal kudu/127.4.201.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab.
I20260812 01:10:58.221925 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:33551
--webserver_interface=127.4.201.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:38481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:33551,127.4.201.125:32869,127.4.201.124:44469
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 01:10:58.558063 9993 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 01:10:58.558393 9993 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:58.558491 9993 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:58.558609 9993 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:58.566181 9993 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:10:58.566277 9993 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:58.566375 9993 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:58.566439 9993 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:10:58.566524 9993 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:10:58.576166 9993 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:38481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:33551,127.4.201.125:32869,127.4.201.124:44469
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.126.keytab
--principal=kudu/127.4.201.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.126:33551
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.201.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:58.577432 9993 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:58.578742 9993 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:58.589689 10013 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:58.589826 10006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:58.589840 10003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:58.590649 9993 server_base.cc:1034] running on GCE node
I20260812 01:10:58.591398 9993 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:58.592681 9993 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:58.593892 9993 hybrid_clock.cc:648] HybridClock initialized: now 1786497058593822 us; error 36 us; skew 500 ppm
I20260812 01:10:58.594197 9993 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:10:58 dist-test-slave-bndk krb5kdc[9974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497058, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:10:58.597144 9993 init.cc:377] Logged in from keytab as kudu/127.4.201.126@KRBTEST.COM (short username kudu)
I20260812 01:10:58.598518 9993 webserver.cc:460] Webserver started at http://127.4.201.126:40345/ using document root <none> and password file <none>
I20260812 01:10:58.599165 9993 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:58.599262 9993 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:58.599572 9993 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:58.602583 9993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-0/data/instance:
uuid: "afaaa0b24f8d41dfbade786edeb95d0c"
format_stamp: "Formatted at 2026-08-12 01:10:58 on dist-test-slave-bndk"
server_key: "f9230d39ccbc721c9404434c0a1980d6"
server_key_iv: "aa86253d5edd54630927a82b5783ec74"
server_key_version: "encryptionkey@0"
I20260812 01:10:58.603356 9993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-0/wal/instance:
uuid: "afaaa0b24f8d41dfbade786edeb95d0c"
format_stamp: "Formatted at 2026-08-12 01:10:58 on dist-test-slave-bndk"
server_key: "f9230d39ccbc721c9404434c0a1980d6"
server_key_iv: "aa86253d5edd54630927a82b5783ec74"
server_key_version: "encryptionkey@0"
I20260812 01:10:58.608390 9993 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 01:10:58.611713 10023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:58.612944 9993 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 01:10:58.613099 9993 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-0/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-0/wal
uuid: "afaaa0b24f8d41dfbade786edeb95d0c"
format_stamp: "Formatted at 2026-08-12 01:10:58 on dist-test-slave-bndk"
server_key: "f9230d39ccbc721c9404434c0a1980d6"
server_key_iv: "aa86253d5edd54630927a82b5783ec74"
server_key_version: "encryptionkey@0"
I20260812 01:10:58.613329 9993 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:58.643276 9993 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:58.647142 9993 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:58.647406 9993 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:58.665421 9993 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.126:33551
I20260812 01:10:58.665442 10109 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.126:33551 every 8 connection(s)
I20260812 01:10:58.666746 9993 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-0/data/info.pb
I20260812 01:10:58.668694 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 9993
I20260812 01:10:58.668900 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-0/wal/instance
I20260812 01:10:58.669476 4901 external_mini_cluster.cc:1428] Setting key d3092713e6965836be2e69662033aafc
I20260812 01:10:58.671274 10110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:58.679937 10110 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33551 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 01:10:58 dist-test-slave-bndk krb5kdc[9974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497058, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:10:58.703406 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:58.683366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33551 (local address 127.0.0.1:35542)
0812 01:10:58.684160 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:58.684214 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:58.686373 (+ 2159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:58.687226 (+ 853us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:58.687233 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:58.687936 (+ 703us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:10:58.688443 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:58.688466 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:58.690087 (+ 1621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:58.690093 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:58.691700 (+ 1607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:58.691715 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:58.692597 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:58.692604 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:58.692777 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:58.693440 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:10:58.693494 (+ 54us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:10:58.695942 (+ 2448us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:10:58.699623 (+ 3681us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:58.699634 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:58.699643 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:58.700017 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:58.700467 (+ 450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:58.700470 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:58.700473 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:58.700634 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:58.701580 (+ 946us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:10:58.701586 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:10:58.701785 (+ 199us) client_negotiation.cc:769] Sending connection context
0812 01:10:58.701991 (+ 206us) client_negotiation.cc:240] Negotiation successful
0812 01:10:58.702362 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":320,"threads_started":1}
I20260812 01:10:58.703440 10117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:58.684583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35542 (local address 127.4.201.126:33551)
0812 01:10:58.685289 (+ 706us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:58.685301 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:58.685354 (+ 53us) server_negotiation.cc:407] Connection header received
0812 01:10:58.686759 (+ 1405us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:58.686765 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:58.686984 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:58.687148 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:58.688656 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:58.689920 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:58.691827 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:58.692355 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:58.692485 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:58.696173 (+ 3688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:58.696184 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:58.696197 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:58.696236 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:58.699493 (+ 3257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:58.700146 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:58.700154 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:58.700158 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:58.700359 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:58.700735 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:58.700741 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:58.700744 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:58.701427 (+ 683us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:58.701664 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:58.702162 (+ 498us) server_negotiation.cc:299] Negotiation successful
0812 01:10:58.702557 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":83,"server-negotiator.queue_time_us":461,"thread_start_us":301,"threads_started":1}
WARNING: no policy specified for kudu/127.4.201.125@KRBTEST.COM; defaulting to no policy
I20260812 01:10:58.706575 10110 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.201.125" port: 32869 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:10:58.707657 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:58.707294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:32869 (local address 127.0.0.1:34084)
0812 01:10:58.707444 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:58.707557 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.125:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260812 01:10:58.707926 10029 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.201.125:32869: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.125@KRBTEST.COM" created.
I20260812 01:10:58.709462 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:58.709059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:32869 (local address 127.0.0.1:34090)
0812 01:10:58.709203 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:58.709318 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.125:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260812 01:10:58.709679 10110 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.125:32869: Network error: Client connection negotiation failed: client connection to 127.4.201.125:32869: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.125.keytab.
Entry for principal kudu/127.4.201.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.125.keytab.
I20260812 01:10:58.742177 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.125:32869
--webserver_interface=127.4.201.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.125.keytab
--principal=kudu/127.4.201.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:38481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:33551,127.4.201.125:32869,127.4.201.124:44469
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:10:58.759002 10110 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.125" port: 32869 } attempt: 1
I20260812 01:10:58.760146 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:58.759715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:32869 (local address 127.0.0.1:34106)
0812 01:10:58.759896 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:58.760011 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.125:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260812 01:10:58.761111 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:58.760723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:32869 (local address 127.0.0.1:34108)
0812 01:10:58.760863 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:58.760930 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.125:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260812 01:10:58.761427 10110 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.125:32869: Network error: Client connection negotiation failed: client connection to 127.4.201.125:32869: connect: Connection refused (error 111)
I20260812 01:10:58.829675 10110 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.125" port: 32869 } attempt: 2
I20260812 01:10:58.830816 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:58.830377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:32869 (local address 127.0.0.1:34122)
0812 01:10:58.830576 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:58.830672 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.125:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260812 01:10:58.831784 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:58.831421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:32869 (local address 127.0.0.1:34126)
0812 01:10:58.831566 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:58.831651 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.125:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260812 01:10:58.831979 10110 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.125:32869: Network error: Client connection negotiation failed: client connection to 127.4.201.125:32869: connect: Connection refused (error 111)
I20260812 01:10:58.923190 10110 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.125" port: 32869 } attempt: 3
I20260812 01:10:58.924235 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:58.923808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:32869 (local address 127.0.0.1:34138)
0812 01:10:58.924011 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:58.924101 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.125:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260812 01:10:58.925195 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:58.924835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:32869 (local address 127.0.0.1:34146)
0812 01:10:58.924993 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:58.925058 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.125:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260812 01:10:58.925395 10110 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.125:32869: Network error: Client connection negotiation failed: client connection to 127.4.201.125:32869: connect: Connection refused (error 111)
I20260812 01:10:59.068620 10110 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.125" port: 32869 } attempt: 4
I20260812 01:10:59.070041 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.069432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:32869 (local address 127.0.0.1:34152)
0812 01:10:59.069808 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:59.069899 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.125:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209}
I20260812 01:10:59.071133 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.070733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:32869 (local address 127.0.0.1:34154)
0812 01:10:59.070883 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:59.070995 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.125:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260812 01:10:59.071349 10110 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.125:32869: Network error: Client connection negotiation failed: client connection to 127.4.201.125:32869: connect: Connection refused (error 111)
W20260812 01:10:59.076691 10122 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 01:10:59.077009 10122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:59.077103 10122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:59.077241 10122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 01:10:59.084422 10122 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:10:59.084517 10122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:59.084612 10122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:59.084678 10122 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:10:59.084761 10122 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:10:59.094424 10122 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:38481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:33551,127.4.201.125:32869,127.4.201.124:44469
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.125.keytab
--principal=kudu/127.4.201.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.125:32869
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.4.201.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:59.095667 10122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:59.096925 10122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:59.108011 10134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:59.108057 10132 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:59.108224 10130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:59.108904 10122 server_base.cc:1034] running on GCE node
I20260812 01:10:59.109647 10122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:59.110929 10122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:59.112169 10122 hybrid_clock.cc:648] HybridClock initialized: now 1786497059112094 us; error 49 us; skew 500 ppm
I20260812 01:10:59.112462 10122 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 01:10:59 dist-test-slave-bndk krb5kdc[9974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497059, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:10:59.115417 10122 init.cc:377] Logged in from keytab as kudu/127.4.201.125@KRBTEST.COM (short username kudu)
I20260812 01:10:59.116873 10122 webserver.cc:460] Webserver started at http://127.4.201.125:35667/ using document root <none> and password file <none>
I20260812 01:10:59.117596 10122 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:59.117712 10122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:59.118026 10122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:59.120919 10122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-1/data/instance:
uuid: "466f83169c334c41aa2d64bcb018227a"
format_stamp: "Formatted at 2026-08-12 01:10:59 on dist-test-slave-bndk"
server_key: "737d76b1dac3ad451dc3ee443c811d0e"
server_key_iv: "c530c0df0e2cbab2bc8c90b24aa235dc"
server_key_version: "encryptionkey@0"
I20260812 01:10:59.121728 10122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-1/wal/instance:
uuid: "466f83169c334c41aa2d64bcb018227a"
format_stamp: "Formatted at 2026-08-12 01:10:59 on dist-test-slave-bndk"
server_key: "737d76b1dac3ad451dc3ee443c811d0e"
server_key_iv: "c530c0df0e2cbab2bc8c90b24aa235dc"
server_key_version: "encryptionkey@0"
I20260812 01:10:59.126660 10122 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 01:10:59.130053 10143 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:59.131409 10122 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 01:10:59.131558 10122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-1/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-1/wal
uuid: "466f83169c334c41aa2d64bcb018227a"
format_stamp: "Formatted at 2026-08-12 01:10:59 on dist-test-slave-bndk"
server_key: "737d76b1dac3ad451dc3ee443c811d0e"
server_key_iv: "c530c0df0e2cbab2bc8c90b24aa235dc"
server_key_version: "encryptionkey@0"
I20260812 01:10:59.131747 10122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:59.144248 10122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:59.147827 10122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:59.148051 10122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:59.164745 10122 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.125:32869
I20260812 01:10:59.164764 10219 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.125:32869 every 8 connection(s)
I20260812 01:10:59.166183 10122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-1/data/info.pb
I20260812 01:10:59.169766 10220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:59.171044 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 10122
I20260812 01:10:59.171252 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-1/wal/instance
I20260812 01:10:59.171797 4901 external_mini_cluster.cc:1428] Setting key 59575c9bf0e9876f37e9c46e16ab3724
I20260812 01:10:59.178184 10220 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33551 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 01:10:59 dist-test-slave-bndk krb5kdc[9974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497059, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.125@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:10:59.198498 10117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.181145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35558 (local address 127.4.201.126:33551)
0812 01:10:59.181369 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:59.181375 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:59.182505 (+ 1130us) server_negotiation.cc:407] Connection header received
0812 01:10:59.184788 (+ 2283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:59.184792 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:59.184861 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:59.184950 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:59.186805 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.187770 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.189250 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.189669 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.189787 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:59.193067 (+ 3280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:59.193072 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:59.193076 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:59.193110 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:59.195599 (+ 2489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:59.196282 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:59.196288 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:59.196290 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:59.196411 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:59.196805 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:59.196810 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:59.196812 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:59.197103 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:59.197274 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:59.197933 (+ 659us) server_negotiation.cc:299] Negotiation successful
0812 01:10:59.198181 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260812 01:10:59.199518 10223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.181550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33551 (local address 127.0.0.1:35558)
0812 01:10:59.182305 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:59.182353 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:59.184498 (+ 2145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:59.185192 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:59.185202 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:59.185911 (+ 709us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:10:59.186632 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:59.186657 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.187922 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.187926 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:59.189063 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:59.189076 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.189900 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.189907 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:59.190113 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:59.190723 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:10:59.190750 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:10:59.192848 (+ 2098us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:10:59.195731 (+ 2883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:59.195740 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:59.195755 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:59.196167 (+ 412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:59.196521 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:59.196526 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:59.196529 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:59.196698 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:59.197254 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:10:59.197262 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:10:59.197586 (+ 324us) client_negotiation.cc:769] Sending connection context
0812 01:10:59.197828 (+ 242us) client_negotiation.cc:240] Negotiation successful
0812 01:10:59.198304 (+ 476us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":285,"threads_started":1}
I20260812 01:10:59.201385 10220 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.201.125" port: 32869 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.4.201.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.201.124@KRBTEST.COM" created.
Aug 12 01:10:59 dist-test-slave-bndk krb5kdc[9974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497059, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.125@KRBTEST.COM for kudu/127.4.201.125@KRBTEST.COM
I20260812 01:10:59.215893 10223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.202171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:32869 (local address 127.0.0.1:34160)
0812 01:10:59.202349 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:59.202367 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:59.202473 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:59.203561 (+ 1088us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:59.203564 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:59.203941 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:10:59.204080 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:59.204089 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.205478 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.205483 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:59.206393 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:59.206409 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.207567 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.207572 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:59.207721 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:59.208259 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:10:59.208281 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:10:59.210576 (+ 2295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:10:59.213516 (+ 2940us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:59.213521 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:59.213524 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:59.213959 (+ 435us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:59.214284 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:59.214288 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:59.214291 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:59.214458 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:59.215002 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:10:59.215007 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:10:59.215138 (+ 131us) client_negotiation.cc:769] Sending connection context
0812 01:10:59.215275 (+ 137us) client_negotiation.cc:240] Negotiation successful
0812 01:10:59.215542 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260812 01:10:59.215955 10225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.202329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34160 (local address 127.4.201.125:32869)
0812 01:10:59.203080 (+ 751us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:59.203088 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:59.203124 (+ 36us) server_negotiation.cc:407] Connection header received
0812 01:10:59.203179 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:59.203188 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:59.203412 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:59.203555 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:59.204238 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.205360 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.206533 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.207274 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.207381 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:59.210779 (+ 3398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:59.210791 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:59.210804 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:59.210834 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:59.213381 (+ 2547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:59.214070 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:59.214076 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:59.214078 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:59.214187 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:59.214568 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:59.214572 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:59.214574 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:59.214885 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:59.215039 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:59.215387 (+ 348us) server_negotiation.cc:299] Negotiation successful
0812 01:10:59.215654 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":74,"server-negotiator.queue_time_us":554,"thread_start_us":401,"threads_started":1}
I20260812 01:10:59.218343 10220 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.201.124" port: 44469 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:10:59.219528 10223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.219052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:44469 (local address 127.0.0.1:58980)
0812 01:10:59.219222 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:59.219341 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:44469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260812 01:10:59.219794 10149 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.201.124:44469: connect: Connection refused (error 111)
I20260812 01:10:59.221256 10223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.220951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:44469 (local address 127.0.0.1:58990)
0812 01:10:59.221065 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:59.221138 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:44469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260812 01:10:59.221531 10220 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.124:44469: Network error: Client connection negotiation failed: client connection to 127.4.201.124:44469: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.201.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.124.keytab.
Entry for principal kudu/127.4.201.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.124.keytab.
I20260812 01:10:59.242409 4901 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
/tmp/dist-test-taskuEa_sO/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.124:44469
--webserver_interface=127.4.201.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.124.keytab
--principal=kudu/127.4.201.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.201.84:38481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.201.126:33551,127.4.201.125:32869,127.4.201.124:44469
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 01:10:59.270813 10220 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.124" port: 44469 } attempt: 1
I20260812 01:10:59.271910 10223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.271455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:44469 (local address 127.0.0.1:58994)
0812 01:10:59.271663 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:59.271764 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:44469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260812 01:10:59.272908 10223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.272594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:44469 (local address 127.0.0.1:59000)
0812 01:10:59.272727 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:59.272802 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:44469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260812 01:10:59.273160 10220 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.124:44469: Network error: Client connection negotiation failed: client connection to 127.4.201.124:44469: connect: Connection refused (error 111)
I20260812 01:10:59.341365 10220 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.124" port: 44469 } attempt: 2
I20260812 01:10:59.342474 10223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.342056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:44469 (local address 127.0.0.1:59006)
0812 01:10:59.342232 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:59.342320 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:44469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260812 01:10:59.343386 10223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.343056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:44469 (local address 127.0.0.1:59016)
0812 01:10:59.343199 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:59.343268 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:44469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260812 01:10:59.343605 10220 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.124:44469: Network error: Client connection negotiation failed: client connection to 127.4.201.124:44469: connect: Connection refused (error 111)
I20260812 01:10:59.370575 10110 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.125" port: 32869 } attempt: 5
Aug 12 01:10:59 dist-test-slave-bndk krb5kdc[9974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497058, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for kudu/127.4.201.125@KRBTEST.COM
I20260812 01:10:59.383721 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.371247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:32869 (local address 127.0.0.1:34166)
0812 01:10:59.371443 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:59.371468 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:59.371614 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:59.371972 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:59.371978 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:59.372373 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:10:59.372573 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:59.372584 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.373633 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.373638 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:59.374491 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:59.374510 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.375222 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.375228 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:59.375420 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:59.376034 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:10:59.376051 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:10:59.378289 (+ 2238us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:10:59.381389 (+ 3100us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:59.381395 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:59.381399 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:59.381776 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:59.382133 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:59.382139 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:59.382143 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:59.382283 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:59.382786 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:10:59.382791 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:10:59.382934 (+ 143us) client_negotiation.cc:769] Sending connection context
0812 01:10:59.383072 (+ 138us) client_negotiation.cc:240] Negotiation successful
0812 01:10:59.383353 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260812 01:10:59.383713 10225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.371379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34166 (local address 127.4.201.125:32869)
0812 01:10:59.371570 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:59.371576 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:59.371599 (+ 23us) server_negotiation.cc:407] Connection header received
0812 01:10:59.371760 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:59.371764 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:59.371828 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:59.371910 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:59.372724 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.373486 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.374651 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.375080 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.375189 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:59.378484 (+ 3295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:59.378490 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:59.378493 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:59.378527 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:59.381267 (+ 2740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:59.381891 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:59.381897 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:59.381901 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:59.382027 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:59.382387 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:59.382390 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:59.382393 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:59.382672 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:59.382804 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:59.383198 (+ 394us) server_negotiation.cc:299] Negotiation successful
0812 01:10:59.383402 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 01:10:59.384877 10110 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.201.124" port: 44469 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:10:59.386025 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.385657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:44469 (local address 127.0.0.1:59018)
0812 01:10:59.385823 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:59.385897 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:44469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260812 01:10:59.386888 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.386578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:44469 (local address 127.0.0.1:59026)
0812 01:10:59.386717 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:59.386793 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:44469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260812 01:10:59.387075 10110 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.124:44469: Network error: Client connection negotiation failed: client connection to 127.4.201.124:44469: connect: Connection refused (error 111)
I20260812 01:10:59.434790 10220 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.124" port: 44469 } attempt: 3
I20260812 01:10:59.435992 10223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.435485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:44469 (local address 127.0.0.1:59040)
0812 01:10:59.435669 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:59.435771 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:44469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260812 01:10:59.437012 10223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.436586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:44469 (local address 127.0.0.1:59048)
0812 01:10:59.436810 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:59.436891 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:44469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119}
W20260812 01:10:59.437249 10220 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.124:44469: Network error: Client connection negotiation failed: client connection to 127.4.201.124:44469: connect: Connection refused (error 111)
I20260812 01:10:59.438284 10110 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.124" port: 44469 } attempt: 1
I20260812 01:10:59.439185 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.438765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:44469 (local address 127.0.0.1:59050)
0812 01:10:59.438933 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:59.439021 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:44469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 01:10:59.440047 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.439756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:44469 (local address 127.0.0.1:59052)
0812 01:10:59.439887 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:59.439949 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:44469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260812 01:10:59.440243 10110 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.124:44469: Network error: Client connection negotiation failed: client connection to 127.4.201.124:44469: connect: Connection refused (error 111)
I20260812 01:10:59.508430 10110 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.124" port: 44469 } attempt: 2
I20260812 01:10:59.509582 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.509070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:44469 (local address 127.0.0.1:59064)
0812 01:10:59.509318 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:59.509407 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:44469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260812 01:10:59.510505 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.510172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:44469 (local address 127.0.0.1:59070)
0812 01:10:59.510316 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:59.510396 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:44469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260812 01:10:59.510700 10110 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.124:44469: Network error: Client connection negotiation failed: client connection to 127.4.201.124:44469: connect: Connection refused (error 111)
W20260812 01:10:59.577948 10228 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 01:10:59.578272 10228 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:10:59.578375 10228 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:10:59.578490 10228 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260812 01:10:59.580436 10220 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.124" port: 44469 } attempt: 4
I20260812 01:10:59.581521 10223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.581016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:44469 (local address 127.0.0.1:59076)
0812 01:10:59.581265 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:59.581359 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:44469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260812 01:10:59.582428 10223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.582113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:44469 (local address 127.0.0.1:59090)
0812 01:10:59.582255 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:59.582324 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:44469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260812 01:10:59.582636 10220 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.124:44469: Network error: Client connection negotiation failed: client connection to 127.4.201.124:44469: connect: Connection refused (error 111)
W20260812 01:10:59.585752 10228 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:10:59.585850 10228 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 01:10:59.585940 10228 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:10:59.586018 10228 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:10:59.586097 10228 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:10:59.595561 10228 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.201.84:38481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.4.201.126:33551,127.4.201.125:32869,127.4.201.124:44469
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/krb5kdc/kudu_127.4.201.124.keytab
--principal=kudu/127.4.201.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.201.124:44469
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.4.201.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 00:04:17 UTC on ccycloud.quasar-okduwe.root.comops.site
build id 4581749
ASAN enabled
I20260812 01:10:59.596715 10228 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:10:59.598021 10228 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 01:10:59.608947 10234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:59.608995 10236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:10:59.609107 10242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:10:59.609588 10228 server_base.cc:1034] running on GCE node
I20260812 01:10:59.610589 10228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:10:59.611888 10228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:10:59.613111 10228 hybrid_clock.cc:648] HybridClock initialized: now 1786497059613042 us; error 47 us; skew 500 ppm
I20260812 01:10:59.613446 10228 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:10:59.616873 10110 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.124" port: 44469 } attempt: 3
I20260812 01:10:59.617920 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.617441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:44469 (local address 127.0.0.1:59092)
0812 01:10:59.617688 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:59.617770 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:44469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260812 01:10:59.618821 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.618481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:44469 (local address 127.0.0.1:59096)
0812 01:10:59.618657 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:59.618726 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.201.124:44469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
W20260812 01:10:59.619024 10110 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.201.124:44469: Network error: Client connection negotiation failed: client connection to 127.4.201.124:44469: connect: Connection refused (error 111)
Aug 12 01:10:59 dist-test-slave-bndk krb5kdc[9974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497059, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 01:10:59.620806 10228 init.cc:377] Logged in from keytab as kudu/127.4.201.124@KRBTEST.COM (short username kudu)
I20260812 01:10:59.622203 10228 webserver.cc:460] Webserver started at http://127.4.201.124:43677/ using document root <none> and password file <none>
I20260812 01:10:59.622843 10228 fs_manager.cc:359] Metadata directory not provided
I20260812 01:10:59.622932 10228 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:10:59.623199 10228 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:10:59.626046 10228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-2/data/instance:
uuid: "daec3d21913743379fc398e6b7af3ecb"
format_stamp: "Formatted at 2026-08-12 01:10:59 on dist-test-slave-bndk"
server_key: "2f2f598330ec4877b4cbd07cc299f7da"
server_key_iv: "8febd618e8f71f1a044e03822157212f"
server_key_version: "encryptionkey@0"
I20260812 01:10:59.626748 10228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-2/wal/instance:
uuid: "daec3d21913743379fc398e6b7af3ecb"
format_stamp: "Formatted at 2026-08-12 01:10:59 on dist-test-slave-bndk"
server_key: "2f2f598330ec4877b4cbd07cc299f7da"
server_key_iv: "8febd618e8f71f1a044e03822157212f"
server_key_version: "encryptionkey@0"
I20260812 01:10:59.631647 10228 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260812 01:10:59.634990 10259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:10:59.636287 10228 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 01:10:59.636456 10228 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-2/data,/tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-2/wal
uuid: "daec3d21913743379fc398e6b7af3ecb"
format_stamp: "Formatted at 2026-08-12 01:10:59 on dist-test-slave-bndk"
server_key: "2f2f598330ec4877b4cbd07cc299f7da"
server_key_iv: "8febd618e8f71f1a044e03822157212f"
server_key_version: "encryptionkey@0"
I20260812 01:10:59.636658 10228 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:10:59.659710 10228 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 01:10:59.663806 10228 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:10:59.664052 10228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:10:59.682070 10228 rpc_server.cc:307] RPC server started. Bound to: 127.4.201.124:44469
I20260812 01:10:59.682093 10352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.201.124:44469 every 8 connection(s)
I20260812 01:10:59.683315 10228 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-2/data/info.pb
I20260812 01:10:59.686786 10353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:10:59.691179 4901 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu as pid 10228
I20260812 01:10:59.691390 4901 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuEa_sO/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786496689953932-4901-0/minicluster-data/master-2/wal/instance
I20260812 01:10:59.691911 4901 external_mini_cluster.cc:1428] Setting key 050573a91ac6625d9ee1fa56e8b3ddf0
I20260812 01:10:59.694772 10353 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33551 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 01:10:59 dist-test-slave-bndk krb5kdc[9974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497059, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.124@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
Aug 12 01:10:59 dist-test-slave-bndk krb5kdc[9974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497058, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.124@KRBTEST.COM
I20260812 01:10:59.712796 10117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.697597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35570 (local address 127.4.201.126:33551)
0812 01:10:59.697811 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:59.697818 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:59.698413 (+ 595us) server_negotiation.cc:407] Connection header received
0812 01:10:59.698747 (+ 334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:59.698753 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:59.698835 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:59.698949 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:59.700198 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.700922 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.702495 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.702938 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.703033 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:59.706412 (+ 3379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:59.706418 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:59.706421 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:59.706454 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:59.709590 (+ 3136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:59.710377 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:59.710384 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:59.710387 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:59.710558 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:59.711006 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:59.711009 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:59.711011 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:59.711331 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:59.711480 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:59.712244 (+ 764us) server_negotiation.cc:299] Negotiation successful
0812 01:10:59.712478 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 01:10:59.713840 10361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.694352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59112 (local address 127.4.201.124:44469)
0812 01:10:59.695544 (+ 1192us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:59.695560 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:59.695612 (+ 52us) server_negotiation.cc:407] Connection header received
0812 01:10:59.697573 (+ 1961us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:59.697602 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:59.698102 (+ 500us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:59.698468 (+ 366us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:59.699935 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.701268 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.702536 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.703035 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.703229 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:59.707207 (+ 3978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:59.707219 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:59.707235 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:59.707275 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:59.710444 (+ 3169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:59.711240 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:59.711249 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:59.711252 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:59.711412 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:59.711781 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:59.711784 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:59.711786 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:59.712148 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:59.712439 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:59.712774 (+ 335us) server_negotiation.cc:299] Negotiation successful
0812 01:10:59.713013 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":924,"thread_start_us":669,"threads_started":1}
I20260812 01:10:59.713878 10363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.697592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.126:33551 (local address 127.0.0.1:35570)
0812 01:10:59.698288 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:59.698341 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:59.698594 (+ 253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:59.699010 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:59.699015 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:59.699589 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:10:59.700015 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:59.700034 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.701091 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.701097 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:59.702340 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:59.702353 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.703161 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.703169 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:59.703323 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:59.703931 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:10:59.703962 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:10:59.706229 (+ 2267us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:10:59.709711 (+ 3482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:59.709721 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:59.709730 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:59.710257 (+ 527us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:59.710665 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:59.710670 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:59.710673 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:59.710898 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:59.711458 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:10:59.711467 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:10:59.711866 (+ 399us) client_negotiation.cc:769] Sending connection context
0812 01:10:59.712124 (+ 258us) client_negotiation.cc:240] Negotiation successful
0812 01:10:59.712563 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"spinlock_wait_cycles":46848,"thread_start_us":315,"threads_started":1}
I20260812 01:10:59.715360 10353 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.201.125" port: 32869 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 01:10:59 dist-test-slave-bndk krb5kdc[9974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497059, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.124@KRBTEST.COM for kudu/127.4.201.125@KRBTEST.COM
Aug 12 01:10:59 dist-test-slave-bndk krb5kdc[9974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497058, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.126@KRBTEST.COM
I20260812 01:10:59.729087 10363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.716086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.125:32869 (local address 127.0.0.1:34176)
0812 01:10:59.716391 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:59.716409 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:59.716581 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:59.717024 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:59.717028 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:59.717516 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:10:59.717693 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:59.717706 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.718831 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.718835 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:59.720021 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:59.720036 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.720702 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.720706 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:59.720850 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:59.721407 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:10:59.721429 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:10:59.723582 (+ 2153us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:10:59.726833 (+ 3251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:59.726838 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:59.726843 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:59.727204 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:59.727571 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:59.727576 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:59.727580 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:59.727721 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:59.728208 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:10:59.728213 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:10:59.728351 (+ 138us) client_negotiation.cc:769] Sending connection context
0812 01:10:59.728468 (+ 117us) client_negotiation.cc:240] Negotiation successful
0812 01:10:59.728740 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205}
I20260812 01:10:59.729131 10225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.716083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34176 (local address 127.4.201.125:32869)
0812 01:10:59.716263 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:59.716269 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:59.716485 (+ 216us) server_negotiation.cc:407] Connection header received
0812 01:10:59.716768 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:59.716774 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:59.716860 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:59.716961 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:59.717823 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.718685 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.720161 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.720564 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.720683 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:59.723762 (+ 3079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:59.723767 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:59.723770 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:59.723803 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:59.726703 (+ 2900us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:59.727318 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:59.727322 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:59.727324 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:59.727458 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:59.727823 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:59.727826 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:59.727829 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:59.728093 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:59.728222 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:59.728583 (+ 361us) server_negotiation.cc:299] Negotiation successful
0812 01:10:59.728788 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 01:10:59.730290 10353 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.201.124" port: 44469 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:10:59.730785 10117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.716585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35584 (local address 127.4.201.126:33551)
0812 01:10:59.716726 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:59.716731 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:59.716748 (+ 17us) server_negotiation.cc:407] Connection header received
0812 01:10:59.716838 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:59.716843 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:59.716903 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:59.716988 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:59.718262 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.719164 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.720658 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.721207 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.721360 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:59.725666 (+ 4306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:59.725673 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:59.725678 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:59.725716 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:59.728137 (+ 2421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:59.728762 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:59.728766 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:59.728768 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:59.728891 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:59.729271 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:59.729276 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:59.729280 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:59.729620 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:59.729880 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:59.730267 (+ 387us) server_negotiation.cc:299] Negotiation successful
0812 01:10:59.730489 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
Aug 12 01:10:59 dist-test-slave-bndk krb5kdc[9974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497059, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.124@KRBTEST.COM for kudu/127.4.201.124@KRBTEST.COM
Aug 12 01:10:59 dist-test-slave-bndk krb5kdc[9974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497058, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.201.125@KRBTEST.COM
I20260812 01:10:59.744122 10363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.730995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:44469 (local address 127.0.0.1:59116)
0812 01:10:59.731338 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:59.731355 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:59.731455 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:59.731745 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:59.731750 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:59.732182 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:10:59.732335 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:59.732346 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.733686 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.733689 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:59.734793 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:59.734808 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.735578 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.735585 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:59.735754 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:59.736256 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:10:59.736274 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:10:59.738410 (+ 2136us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:10:59.741816 (+ 3406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:59.741821 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:59.741824 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:59.742262 (+ 438us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:59.742611 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:59.742616 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:59.742620 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:59.742751 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:59.743230 (+ 479us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:10:59.743234 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:10:59.743381 (+ 147us) client_negotiation.cc:769] Sending connection context
0812 01:10:59.743495 (+ 114us) client_negotiation.cc:240] Negotiation successful
0812 01:10:59.743749 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230}
I20260812 01:10:59.744211 10361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.731186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59116 (local address 127.4.201.124:44469)
0812 01:10:59.731342 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:59.731347 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:59.731411 (+ 64us) server_negotiation.cc:407] Connection header received
0812 01:10:59.731556 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:59.731561 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:59.731614 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:59.731696 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:59.732530 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.733565 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.734937 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.735406 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.735543 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:59.738609 (+ 3066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:59.738616 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:59.738621 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:59.738658 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:59.741698 (+ 3040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:59.742375 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:59.742381 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:59.742384 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:59.742498 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:59.742847 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:59.742852 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:59.742855 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:59.743123 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:59.743245 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:59.743592 (+ 347us) server_negotiation.cc:299] Negotiation successful
0812 01:10:59.743918 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":105,"server-negotiator.queue_time_us":45}
I20260812 01:10:59.746773 10225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.732385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34182 (local address 127.4.201.125:32869)
0812 01:10:59.732541 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:59.732547 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:59.732561 (+ 14us) server_negotiation.cc:407] Connection header received
0812 01:10:59.732643 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:59.732646 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:59.732694 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:59.732760 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:59.734176 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.735114 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.736405 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.737045 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.737168 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:59.741677 (+ 4509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:59.741682 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:59.741685 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:59.741713 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:59.744190 (+ 2477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:59.744942 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:59.744947 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:59.744951 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:59.745092 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:59.745489 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:59.745495 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:59.745498 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:59.745742 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:59.746001 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:59.746293 (+ 292us) server_negotiation.cc:299] Negotiation successful
0812 01:10:59.746504 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 01:10:59.749235 10353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P daec3d21913743379fc398e6b7af3ecb: Bootstrap starting.
I20260812 01:10:59.751169 4901 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 01:10:59.753033 10353 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P daec3d21913743379fc398e6b7af3ecb: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:59.754288 10353 log.cc:824] T 00000000000000000000000000000000 P daec3d21913743379fc398e6b7af3ecb: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:59.754124 10076 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "afaaa0b24f8d41dfbade786edeb95d0c"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35584
I20260812 01:10:59.756946 10353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P daec3d21913743379fc398e6b7af3ecb: No bootstrap required, opened a new log
I20260812 01:10:59.764312 10353 raft_consensus.cc:348] T 00000000000000000000000000000000 P daec3d21913743379fc398e6b7af3ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaaa0b24f8d41dfbade786edeb95d0c" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33551 } } peers { permanent_uuid: "466f83169c334c41aa2d64bcb018227a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 32869 } } peers { permanent_uuid: "daec3d21913743379fc398e6b7af3ecb" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 44469 } }
I20260812 01:10:59.764714 10353 raft_consensus.cc:729] T 00000000000000000000000000000000 P daec3d21913743379fc398e6b7af3ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daec3d21913743379fc398e6b7af3ecb, State: Initialized, Role: FOLLOWER
I20260812 01:10:59.765229 10353 consensus_queue.cc:260] T 00000000000000000000000000000000 P daec3d21913743379fc398e6b7af3ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaaa0b24f8d41dfbade786edeb95d0c" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33551 } } peers { permanent_uuid: "466f83169c334c41aa2d64bcb018227a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 32869 } } peers { permanent_uuid: "daec3d21913743379fc398e6b7af3ecb" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 44469 } }
I20260812 01:10:59.766280 10367 sys_catalog.cc:455] T 00000000000000000000000000000000 P daec3d21913743379fc398e6b7af3ecb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaaa0b24f8d41dfbade786edeb95d0c" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33551 } } peers { permanent_uuid: "466f83169c334c41aa2d64bcb018227a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 32869 } } peers { permanent_uuid: "daec3d21913743379fc398e6b7af3ecb" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 44469 } } }
I20260812 01:10:59.766700 10367 sys_catalog.cc:458] T 00000000000000000000000000000000 P daec3d21913743379fc398e6b7af3ecb [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:10:59.767560 10353 sys_catalog.cc:564] T 00000000000000000000000000000000 P daec3d21913743379fc398e6b7af3ecb [sys.catalog]: configured and running, proceeding with master startup.
W20260812 01:10:59.776443 10382 catalog_manager.cc:1558] T 00000000000000000000000000000000 P daec3d21913743379fc398e6b7af3ecb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 01:10:59.776559 10382 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 01:10:59.774645 10228 master_runner.cc:186] Error getting master registration for 127.4.201.126:33551: OK, instance_id { permanent_uuid: "afaaa0b24f8d41dfbade786edeb95d0c" instance_seqno: 1786497058660361 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 01:10:59.782258 10228 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:10:59.796237 10110 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.124" port: 44469 } attempt: 4
Aug 12 01:10:59 dist-test-slave-bndk krb5kdc[9974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497058, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.126@KRBTEST.COM for kudu/127.4.201.124@KRBTEST.COM
I20260812 01:10:59.811545 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.796921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:44469 (local address 127.0.0.1:59122)
0812 01:10:59.797126 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:59.797147 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:59.797304 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:59.797679 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:59.797684 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:59.798206 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:10:59.798438 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:59.798455 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.799938 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.799945 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:59.801444 (+ 1499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:59.801462 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.802493 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.802500 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:59.802712 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:59.803399 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:10:59.803423 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:10:59.806138 (+ 2715us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:10:59.809060 (+ 2922us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:59.809066 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:59.809071 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:59.809490 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:59.809843 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:59.809848 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:59.809853 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:59.809995 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:59.810557 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:10:59.810562 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:10:59.810725 (+ 163us) client_negotiation.cc:769] Sending connection context
0812 01:10:59.810839 (+ 114us) client_negotiation.cc:240] Negotiation successful
0812 01:10:59.811132 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260812 01:10:59.811545 10361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.796995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59122 (local address 127.4.201.124:44469)
0812 01:10:59.797183 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:59.797187 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:59.797206 (+ 19us) server_negotiation.cc:407] Connection header received
0812 01:10:59.797441 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:59.797445 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:59.797524 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:59.797634 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:59.798604 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.799757 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.801599 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.802325 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.802444 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:59.806304 (+ 3860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:59.806310 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:59.806313 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:59.806343 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:59.808932 (+ 2589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:59.809613 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:59.809618 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:59.809620 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:59.809739 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:59.810110 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:59.810114 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:59.810116 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:59.810429 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:59.810583 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:59.810975 (+ 392us) server_negotiation.cc:299] Negotiation successful
0812 01:10:59.811180 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 01:10:59.817728 10110 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afaaa0b24f8d41dfbade786edeb95d0c: Bootstrap starting.
I20260812 01:10:59.821897 10110 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P afaaa0b24f8d41dfbade786edeb95d0c: Neither blocks nor log segments found. Creating new log.
I20260812 01:10:59.823253 10110 log.cc:824] T 00000000000000000000000000000000 P afaaa0b24f8d41dfbade786edeb95d0c: Log is configured to *not* fsync() on all Append() calls
I20260812 01:10:59.826659 10110 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afaaa0b24f8d41dfbade786edeb95d0c: No bootstrap required, opened a new log
I20260812 01:10:59.834244 10110 raft_consensus.cc:348] T 00000000000000000000000000000000 P afaaa0b24f8d41dfbade786edeb95d0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaaa0b24f8d41dfbade786edeb95d0c" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33551 } } peers { permanent_uuid: "466f83169c334c41aa2d64bcb018227a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 32869 } } peers { permanent_uuid: "daec3d21913743379fc398e6b7af3ecb" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 44469 } }
I20260812 01:10:59.834692 10110 raft_consensus.cc:729] T 00000000000000000000000000000000 P afaaa0b24f8d41dfbade786edeb95d0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afaaa0b24f8d41dfbade786edeb95d0c, State: Initialized, Role: FOLLOWER
I20260812 01:10:59.835233 10110 consensus_queue.cc:260] T 00000000000000000000000000000000 P afaaa0b24f8d41dfbade786edeb95d0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaaa0b24f8d41dfbade786edeb95d0c" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33551 } } peers { permanent_uuid: "466f83169c334c41aa2d64bcb018227a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 32869 } } peers { permanent_uuid: "daec3d21913743379fc398e6b7af3ecb" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 44469 } }
I20260812 01:10:59.836222 10386 sys_catalog.cc:455] T 00000000000000000000000000000000 P afaaa0b24f8d41dfbade786edeb95d0c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaaa0b24f8d41dfbade786edeb95d0c" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33551 } } peers { permanent_uuid: "466f83169c334c41aa2d64bcb018227a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 32869 } } peers { permanent_uuid: "daec3d21913743379fc398e6b7af3ecb" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 44469 } } }
I20260812 01:10:59.836622 10386 sys_catalog.cc:458] T 00000000000000000000000000000000 P afaaa0b24f8d41dfbade786edeb95d0c [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:10:59.837524 10110 sys_catalog.cc:564] T 00000000000000000000000000000000 P afaaa0b24f8d41dfbade786edeb95d0c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:10:59.837639 10076 raft_consensus.cc:482] T 00000000000000000000000000000000 P afaaa0b24f8d41dfbade786edeb95d0c [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 01:10:59.837826 10076 raft_consensus.cc:3037] T 00000000000000000000000000000000 P afaaa0b24f8d41dfbade786edeb95d0c [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:59.840677 10076 raft_consensus.cc:504] T 00000000000000000000000000000000 P afaaa0b24f8d41dfbade786edeb95d0c [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaaa0b24f8d41dfbade786edeb95d0c" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33551 } } peers { permanent_uuid: "466f83169c334c41aa2d64bcb018227a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 32869 } } peers { permanent_uuid: "daec3d21913743379fc398e6b7af3ecb" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 44469 } }
I20260812 01:10:59.842890 10313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "afaaa0b24f8d41dfbade786edeb95d0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "daec3d21913743379fc398e6b7af3ecb"
I20260812 01:10:59.843390 10313 raft_consensus.cc:3037] T 00000000000000000000000000000000 P daec3d21913743379fc398e6b7af3ecb [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:59.846814 10313 raft_consensus.cc:2454] T 00000000000000000000000000000000 P daec3d21913743379fc398e6b7af3ecb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afaaa0b24f8d41dfbade786edeb95d0c in term 1.
I20260812 01:10:59.847436 10030 leader_election.cc:302] T 00000000000000000000000000000000 P afaaa0b24f8d41dfbade786edeb95d0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: afaaa0b24f8d41dfbade786edeb95d0c, daec3d21913743379fc398e6b7af3ecb; no voters:
I20260812 01:10:59.847824 10076 leader_election.cc:288] T 00000000000000000000000000000000 P afaaa0b24f8d41dfbade786edeb95d0c [CANDIDATE]: Term 1 election: Requested vote from peers 466f83169c334c41aa2d64bcb018227a (127.4.201.125:32869), daec3d21913743379fc398e6b7af3ecb (127.4.201.124:44469)
I20260812 01:10:59.847856 10386 raft_consensus.cc:2781] T 00000000000000000000000000000000 P afaaa0b24f8d41dfbade786edeb95d0c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:10:59.859731 10386 raft_consensus.cc:686] T 00000000000000000000000000000000 P afaaa0b24f8d41dfbade786edeb95d0c [term 1 LEADER]: Becoming Leader. State: Replica: afaaa0b24f8d41dfbade786edeb95d0c, State: Running, Role: LEADER
I20260812 01:10:59.860898 10386 consensus_queue.cc:237] T 00000000000000000000000000000000 P afaaa0b24f8d41dfbade786edeb95d0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaaa0b24f8d41dfbade786edeb95d0c" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33551 } } peers { permanent_uuid: "466f83169c334c41aa2d64bcb018227a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 32869 } } peers { permanent_uuid: "daec3d21913743379fc398e6b7af3ecb" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 44469 } }
I20260812 01:10:59.873199 10399 sys_catalog.cc:455] T 00000000000000000000000000000000 P afaaa0b24f8d41dfbade786edeb95d0c [sys.catalog]: SysCatalogTable state changed. Reason: New leader afaaa0b24f8d41dfbade786edeb95d0c. Latest consensus state: current_term: 1 leader_uuid: "afaaa0b24f8d41dfbade786edeb95d0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaaa0b24f8d41dfbade786edeb95d0c" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33551 } } peers { permanent_uuid: "466f83169c334c41aa2d64bcb018227a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 32869 } } peers { permanent_uuid: "daec3d21913743379fc398e6b7af3ecb" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 44469 } } }
I20260812 01:10:59.873867 10399 sys_catalog.cc:458] T 00000000000000000000000000000000 P afaaa0b24f8d41dfbade786edeb95d0c [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:59.881815 10220 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.201.124" port: 44469 } attempt: 5
I20260812 01:10:59.877511 9993 master_runner.cc:186] Error getting master registration for 127.4.201.125:32869: OK, instance_id { permanent_uuid: "466f83169c334c41aa2d64bcb018227a" instance_seqno: 1786497059159927 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 01:10:59.887985 9993 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 12 01:10:59 dist-test-slave-bndk krb5kdc[9974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786497059, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.201.125@KRBTEST.COM for kudu/127.4.201.124@KRBTEST.COM
I20260812 01:10:59.898813 10223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.882354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.201.124:44469 (local address 127.0.0.1:59130)
0812 01:10:59.882705 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0812 01:10:59.882725 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 01:10:59.882831 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 01:10:59.883675 (+ 844us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 01:10:59.883680 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 01:10:59.884202 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0812 01:10:59.884410 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:59.884423 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.885823 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.885828 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:59.887187 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 01:10:59.887202 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.888327 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.888333 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 01:10:59.888558 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:59.889188 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 01:10:59.889212 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 01:10:59.892030 (+ 2818us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 01:10:59.896017 (+ 3987us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:59.896022 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:59.896026 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:59.896512 (+ 486us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:59.896957 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 01:10:59.896962 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 01:10:59.896966 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 01:10:59.897119 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 01:10:59.897850 (+ 731us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 01:10:59.897855 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 01:10:59.898035 (+ 180us) client_negotiation.cc:769] Sending connection context
0812 01:10:59.898190 (+ 155us) client_negotiation.cc:240] Negotiation successful
0812 01:10:59.898473 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228}
I20260812 01:10:59.899680 10361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.883054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59130 (local address 127.4.201.124:44469)
0812 01:10:59.883231 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:59.883236 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:59.883253 (+ 17us) server_negotiation.cc:407] Connection header received
0812 01:10:59.883311 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:59.883315 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:59.883389 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:59.883480 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:59.884598 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.885663 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.887360 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.887993 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.888117 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:59.892242 (+ 4125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:59.892250 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:59.892255 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:59.892295 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:59.895843 (+ 3548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:59.896653 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:59.896658 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:59.896661 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:59.896816 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:59.897263 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:59.897268 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:59.897271 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:59.897625 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:59.897783 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:59.899162 (+ 1379us) server_negotiation.cc:299] Negotiation successful
0812 01:10:59.899377 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260812 01:10:59.900440 10033 tablet.cc:2369] T 00000000000000000000000000000000 P afaaa0b24f8d41dfbade786edeb95d0c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:10:59.906649 10220 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 466f83169c334c41aa2d64bcb018227a: Bootstrap starting.
I20260812 01:10:59.910769 10220 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 466f83169c334c41aa2d64bcb018227a: Neither blocks nor log segments found. Creating new log.
W20260812 01:10:59.916268 10272 tablet.cc:2369] T 00000000000000000000000000000000 P daec3d21913743379fc398e6b7af3ecb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:10:59.918467 10220 log.cc:824] T 00000000000000000000000000000000 P 466f83169c334c41aa2d64bcb018227a: Log is configured to *not* fsync() on all Append() calls
W20260812 01:10:59.922847 10411 catalog_manager.cc:1558] T 00000000000000000000000000000000 P afaaa0b24f8d41dfbade786edeb95d0c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 01:10:59.923029 10411 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 01:10:59.923656 10117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.889491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35600 (local address 127.4.201.126:33551)
0812 01:10:59.889676 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:59.889681 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:59.890938 (+ 1257us) server_negotiation.cc:407] Connection header received
0812 01:10:59.891377 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:59.891382 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:59.891466 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:59.891534 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:59.895600 (+ 4066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.905479 (+ 9879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.908421 (+ 2942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.909131 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.909257 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:59.915378 (+ 6121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:59.915386 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:59.915391 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:59.915435 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:59.919152 (+ 3717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:59.920536 (+ 1384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:59.920542 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:59.920546 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:59.920755 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:59.921482 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:59.921488 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:59.921492 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:59.921857 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:59.922133 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:59.923047 (+ 914us) server_negotiation.cc:299] Negotiation successful
0812 01:10:59.923285 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 01:10:59.923898 10415 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 01:10:59.925936 10415 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 01:10:59.933269 10220 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 466f83169c334c41aa2d64bcb018227a: No bootstrap required, opened a new log
I20260812 01:10:59.936069 10225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.891080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34184 (local address 127.4.201.125:32869)
0812 01:10:59.891247 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:59.891253 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:59.915827 (+ 24574us) server_negotiation.cc:407] Connection header received
0812 01:10:59.916051 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:59.916057 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:59.916129 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:59.916191 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:59.918921 (+ 2730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.919962 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.925173 (+ 5211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.925872 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.925968 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:59.929136 (+ 3168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:59.929143 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:59.929147 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:59.929187 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:59.932799 (+ 3612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:59.933606 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:59.933612 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:59.933616 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:59.933783 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:59.934248 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:59.934253 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:59.934256 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:59.934633 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:59.934863 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:59.935490 (+ 627us) server_negotiation.cc:299] Negotiation successful
0812 01:10:59.935708 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 01:10:59.944872 10313 raft_consensus.cc:1261] T 00000000000000000000000000000000 P daec3d21913743379fc398e6b7af3ecb [term 1 FOLLOWER]: Refusing update from remote peer afaaa0b24f8d41dfbade786edeb95d0c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:10:59.944998 10361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:10:59.892691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59138 (local address 127.4.201.124:44469)
0812 01:10:59.911071 (+ 18380us) server_negotiation.cc:206] Beginning negotiation
0812 01:10:59.911077 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:10:59.928150 (+ 17073us) server_negotiation.cc:407] Connection header received
0812 01:10:59.928716 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:10:59.928721 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:10:59.928807 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:10:59.928884 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:10:59.930626 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.931652 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.933499 (+ 1847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:10:59.934117 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:10:59.934212 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:10:59.938560 (+ 4348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 01:10:59.938566 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 01:10:59.938569 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 01:10:59.938600 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 01:10:59.941798 (+ 3198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:59.942600 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:59.942621 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:59.942625 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:59.942769 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 01:10:59.943202 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 01:10:59.943207 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 01:10:59.943210 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 01:10:59.943545 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 01:10:59.943781 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0812 01:10:59.944380 (+ 599us) server_negotiation.cc:299] Negotiation successful
0812 01:10:59.944602 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18261,"thread_start_us":34746,"threads_started":1}
I20260812 01:10:59.945843 10399 consensus_queue.cc:1035] T 00000000000000000000000000000000 P afaaa0b24f8d41dfbade786edeb95d0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "daec3d21913743379fc398e6b7af3ecb" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 44469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:10:59.951503 10220 raft_consensus.cc:348] T 00000000000000000000000000000000 P 466f83169c334c41aa2d64bcb018227a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaaa0b24f8d41dfbade786edeb95d0c" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33551 } } peers { permanent_uuid: "466f83169c334c41aa2d64bcb018227a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 32869 } } peers { permanent_uuid: "daec3d21913743379fc398e6b7af3ecb" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 44469 } }
I20260812 01:10:59.951884 10220 raft_consensus.cc:729] T 00000000000000000000000000000000 P 466f83169c334c41aa2d64bcb018227a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 466f83169c334c41aa2d64bcb018227a, State: Initialized, Role: FOLLOWER
I20260812 01:10:59.952376 10220 consensus_queue.cc:260] T 00000000000000000000000000000000 P 466f83169c334c41aa2d64bcb018227a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaaa0b24f8d41dfbade786edeb95d0c" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33551 } } peers { permanent_uuid: "466f83169c334c41aa2d64bcb018227a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 32869 } } peers { permanent_uuid: "daec3d21913743379fc398e6b7af3ecb" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 44469 } }
I20260812 01:10:59.953264 10367 sys_catalog.cc:455] T 00000000000000000000000000000000 P daec3d21913743379fc398e6b7af3ecb [sys.catalog]: SysCatalogTable state changed. Reason: New leader afaaa0b24f8d41dfbade786edeb95d0c. Latest consensus state: current_term: 1 leader_uuid: "afaaa0b24f8d41dfbade786edeb95d0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaaa0b24f8d41dfbade786edeb95d0c" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33551 } } peers { permanent_uuid: "466f83169c334c41aa2d64bcb018227a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 32869 } } peers { permanent_uuid: "daec3d21913743379fc398e6b7af3ecb" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 44469 } } }
I20260812 01:10:59.953588 10367 sys_catalog.cc:458] T 00000000000000000000000000000000 P daec3d21913743379fc398e6b7af3ecb [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:10:59.961148 10367 sys_catalog.cc:455] T 00000000000000000000000000000000 P daec3d21913743379fc398e6b7af3ecb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "afaaa0b24f8d41dfbade786edeb95d0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaaa0b24f8d41dfbade786edeb95d0c" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33551 } } peers { permanent_uuid: "466f83169c334c41aa2d64bcb018227a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 32869 } } peers { permanent_uuid: "daec3d21913743379fc398e6b7af3ecb" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 44469 } } }
I20260812 01:10:59.961414 10367 sys_catalog.cc:458] T 00000000000000000000000000000000 P daec3d21913743379fc398e6b7af3ecb [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:10:59.965348 10429 mvcc.cc:205] Tried to move back new op lower bound from 7317491957523750912 to 7317491957200777216. Current Snapshot: MvccSnapshot[applied={T|T < 7317491957523750912}]
I20260812 01:10:59.965927 10436 sys_catalog.cc:455] T 00000000000000000000000000000000 P 466f83169c334c41aa2d64bcb018227a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaaa0b24f8d41dfbade786edeb95d0c" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33551 } } peers { permanent_uuid: "466f83169c334c41aa2d64bcb018227a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 32869 } } peers { permanent_uuid: "daec3d21913743379fc398e6b7af3ecb" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 44469 } } }
I20260812 01:10:59.966789 10436 sys_catalog.cc:458] T 00000000000000000000000000000000 P 466f83169c334c41aa2d64bcb018227a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:10:59.968767 10220 sys_catalog.cc:564] T 00000000000000000000000000000000 P 466f83169c334c41aa2d64bcb018227a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:10:59.969360 10182 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 466f83169c334c41aa2d64bcb018227a [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:10:59.971593 10399 sys_catalog.cc:455] T 00000000000000000000000000000000 P afaaa0b24f8d41dfbade786edeb95d0c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "afaaa0b24f8d41dfbade786edeb95d0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaaa0b24f8d41dfbade786edeb95d0c" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33551 } } peers { permanent_uuid: "466f83169c334c41aa2d64bcb018227a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 32869 } } peers { permanent_uuid: "daec3d21913743379fc398e6b7af3ecb" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 44469 } } }
I20260812 01:10:59.971863 10399 sys_catalog.cc:458] T 00000000000000000000000000000000 P afaaa0b24f8d41dfbade786edeb95d0c [sys.catalog]: This master's current role is: LEADER
I20260812 01:10:59.971930 10184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "afaaa0b24f8d41dfbade786edeb95d0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "466f83169c334c41aa2d64bcb018227a"
I20260812 01:10:59.972412 10415 catalog_manager.cc:1347] Generated new cluster ID: 07697be9155148a49681c42996741f84
I20260812 01:10:59.972506 10415 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 01:10:59.973424 10182 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 466f83169c334c41aa2d64bcb018227a [term 1 FOLLOWER]: Refusing update from remote peer afaaa0b24f8d41dfbade786edeb95d0c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:10:59.975840 10184 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 466f83169c334c41aa2d64bcb018227a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afaaa0b24f8d41dfbade786edeb95d0c in term 1.
I20260812 01:10:59.976807 10386 consensus_queue.cc:1035] T 00000000000000000000000000000000 P afaaa0b24f8d41dfbade786edeb95d0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "466f83169c334c41aa2d64bcb018227a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 32869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:11:00.016525 10415 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 01:11:00.018553 10415 catalog_manager.cc:1504] Loading token signing keys...
I20260812 01:11:00.034096 10447 sys_catalog.cc:455] T 00000000000000000000000000000000 P 466f83169c334c41aa2d64bcb018227a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "afaaa0b24f8d41dfbade786edeb95d0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaaa0b24f8d41dfbade786edeb95d0c" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33551 } } peers { permanent_uuid: "466f83169c334c41aa2d64bcb018227a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 32869 } } peers { permanent_uuid: "daec3d21913743379fc398e6b7af3ecb" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 44469 } } }
I20260812 01:11:00.034632 10447 sys_catalog.cc:458] T 00000000000000000000000000000000 P 466f83169c334c41aa2d64bcb018227a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:11:00.035036 10436 sys_catalog.cc:455] T 00000000000000000000000000000000 P 466f83169c334c41aa2d64bcb018227a [sys.catalog]: SysCatalogTable state changed. Reason: New leader afaaa0b24f8d41dfbade786edeb95d0c. Latest consensus state: current_term: 1 leader_uuid: "afaaa0b24f8d41dfbade786edeb95d0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaaa0b24f8d41dfbade786edeb95d0c" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33551 } } peers { permanent_uuid: "466f83169c334c41aa2d64bcb018227a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 32869 } } peers { permanent_uuid: "daec3d21913743379fc398e6b7af3ecb" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 44469 } } }
I20260812 01:11:00.035343 10436 sys_catalog.cc:458] T 00000000000000000000000000000000 P 466f83169c334c41aa2d64bcb018227a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:11:00.036036 10415 catalog_manager.cc:5868] T 00000000000000000000000000000000 P afaaa0b24f8d41dfbade786edeb95d0c: Generated new TSK 0
I20260812 01:11:00.037004 10415 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 01:11:00.037479 10386 sys_catalog.cc:455] T 00000000000000000000000000000000 P afaaa0b24f8d41dfbade786edeb95d0c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "afaaa0b24f8d41dfbade786edeb95d0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaaa0b24f8d41dfbade786edeb95d0c" member_type: VOTER last_known_addr { host: "127.4.201.126" port: 33551 } } peers { permanent_uuid: "466f83169c334c41aa2d64bcb018227a" member_type: VOTER last_known_addr { host: "127.4.201.125" port: 32869 } } peers { permanent_uuid: "daec3d21913743379fc398e6b7af3ecb" member_type: VOTER last_known_addr { host: "127.4.201.124" port: 44469 } } }
I20260812 01:11:00.037768 10386 sys_catalog.cc:458] T 00000000000000000000000000000000 P afaaa0b24f8d41dfbade786edeb95d0c [sys.catalog]: This master's current role is: LEADER
W20260812 01:11:00.190127 10225 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:11:00.167374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34186 (local address 127.4.201.125:32869)
0812 01:11:00.167609 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0812 01:11:00.167616 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:11:00.188043 (+ 20427us) server_negotiation.cc:407] Connection header received
0812 01:11:00.188336 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:11:00.188343 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:11:00.188436 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:11:00.188512 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:11:00.189906 (+ 1394us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34186: BlockingRecv error: recv got EOF from 127.0.0.1:34186 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260812 01:11:00.192222 10117 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:11:00.167023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35606 (local address 127.4.201.126:33551)
0812 01:11:00.167231 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0812 01:11:00.167238 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:11:00.190236 (+ 22998us) server_negotiation.cc:407] Connection header received
0812 01:11:00.190682 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:11:00.190687 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:11:00.190770 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:11:00.190843 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:11:00.191985 (+ 1142us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35606: BlockingRecv error: recv got EOF from 127.0.0.1:35606 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260812 01:11:00.192605 10361 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:11:00.173755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59146 (local address 127.4.201.124:44469)
0812 01:11:00.173912 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 01:11:00.173918 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:11:00.190911 (+ 16993us) server_negotiation.cc:407] Connection header received
0812 01:11:00.191385 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:11:00.191391 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:11:00.191477 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:11:00.191548 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:11:00.192392 (+ 844us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59146: BlockingRecv error: recv got EOF from 127.0.0.1:59146 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 01:11:00.206485 10470 catalog_manager.cc:1259] Loaded cluster ID: 07697be9155148a49681c42996741f84
I20260812 01:11:00.206594 10470 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 466f83169c334c41aa2d64bcb018227a: loading cluster ID for follower catalog manager: success
I20260812 01:11:00.210685 10470 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 466f83169c334c41aa2d64bcb018227a: acquiring CA information for follower catalog manager: success
I20260812 01:11:00.213340 10470 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 466f83169c334c41aa2d64bcb018227a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 01:11:00.274256 10225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:11:00.255215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34200 (local address 127.4.201.125:32869)
0812 01:11:00.255412 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 01:11:00.255418 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:11:00.266105 (+ 10687us) server_negotiation.cc:407] Connection header received
0812 01:11:00.266695 (+ 590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:11:00.266703 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:11:00.266924 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:11:00.267073 (+ 149us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:11:00.267908 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:11:00.269094 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:11:00.271174 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:11:00.271878 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:11:00.271974 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:11:00.272729 (+ 755us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:11:00.273444 (+ 715us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:11:00.273580 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0812 01:11:00.273826 (+ 246us) server_negotiation.cc:299] Negotiation successful
0812 01:11:00.273917 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260812 01:11:00.317597 10361 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:11:00.308216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59154 (local address 127.4.201.124:44469)
0812 01:11:00.308432 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0812 01:11:00.308438 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:11:00.315250 (+ 6812us) server_negotiation.cc:407] Connection header received
0812 01:11:00.315832 (+ 582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:11:00.315839 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:11:00.315970 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:11:00.316053 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:11:00.317306 (+ 1253us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59154: BlockingRecv error: recv got EOF from 127.0.0.1:59154 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 01:11:00.366145 10225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:11:00.351519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34208 (local address 127.4.201.125:32869)
0812 01:11:00.351764 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0812 01:11:00.351770 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:11:00.359197 (+ 7427us) server_negotiation.cc:407] Connection header received
0812 01:11:00.359735 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:11:00.359742 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:11:00.359847 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:11:00.359920 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:11:00.360668 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:11:00.361857 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:11:00.363815 (+ 1958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:11:00.364508 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:11:00.364614 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:11:00.365256 (+ 642us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:11:00.365422 (+ 166us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:11:00.365487 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 01:11:00.365729 (+ 242us) server_negotiation.cc:299] Negotiation successful
0812 01:11:00.365818 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260812 01:11:00.413707 10361 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:11:00.403926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59162 (local address 127.4.201.124:44469)
0812 01:11:00.404145 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0812 01:11:00.404152 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:11:00.411533 (+ 7381us) server_negotiation.cc:407] Connection header received
0812 01:11:00.412090 (+ 557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:11:00.412097 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:11:00.412211 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:11:00.412314 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:11:00.413454 (+ 1140us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59162: BlockingRecv error: recv got EOF from 127.0.0.1:59162 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
I20260812 01:11:00.436278 10225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:11:00.428797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34220 (local address 127.4.201.125:32869)
0812 01:11:00.429001 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 01:11:00.429007 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:11:00.429607 (+ 600us) server_negotiation.cc:407] Connection header received
0812 01:11:00.429815 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:11:00.429821 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:11:00.429923 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:11:00.430024 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:11:00.430550 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:11:00.431782 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:11:00.433772 (+ 1990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:11:00.434466 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:11:00.434591 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:11:00.435181 (+ 590us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:11:00.435322 (+ 141us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:11:00.435430 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 01:11:00.435788 (+ 358us) server_negotiation.cc:299] Negotiation successful
0812 01:11:00.435930 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
W20260812 01:11:00.451249 10361 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:11:00.443780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59174 (local address 127.4.201.124:44469)
0812 01:11:00.443970 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 01:11:00.443976 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:11:00.449735 (+ 5759us) server_negotiation.cc:407] Connection header received
0812 01:11:00.449944 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:11:00.449950 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:11:00.450043 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:11:00.450140 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:11:00.451006 (+ 866us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59174: BlockingRecv error: recv got EOF from 127.0.0.1:59174 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 01:11:00.465027 10225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:11:00.458331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34236 (local address 127.4.201.125:32869)
0812 01:11:00.458568 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0812 01:11:00.458574 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:11:00.459086 (+ 512us) server_negotiation.cc:407] Connection header received
0812 01:11:00.459256 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:11:00.459261 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:11:00.459365 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:11:00.459463 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:11:00.459889 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:11:00.460986 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:11:00.462934 (+ 1948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:11:00.463605 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:11:00.463723 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:11:00.464216 (+ 493us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:11:00.464398 (+ 182us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:11:00.464481 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 01:11:00.464660 (+ 179us) server_negotiation.cc:299] Negotiation successful
0812 01:11:00.464743 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
W20260812 01:11:00.475162 10361 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:11:00.472819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59190 (local address 127.4.201.124:44469)
0812 01:11:00.473109 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0812 01:11:00.473115 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:11:00.473654 (+ 539us) server_negotiation.cc:407] Connection header received
0812 01:11:00.473839 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:11:00.473844 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:11:00.473938 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:11:00.474042 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:11:00.474932 (+ 890us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59190: BlockingRecv error: recv got EOF from 127.0.0.1:59190 (error 108)
Metrics: {"server-negotiator.queue_time_us":165}
I20260812 01:11:00.493722 10225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:11:00.486466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34244 (local address 127.4.201.125:32869)
0812 01:11:00.486658 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 01:11:00.486665 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:11:00.487159 (+ 494us) server_negotiation.cc:407] Connection header received
0812 01:11:00.487484 (+ 325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:11:00.487490 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:11:00.487590 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:11:00.487660 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:11:00.488330 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:11:00.489595 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:11:00.491492 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:11:00.492221 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:11:00.492379 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:11:00.492844 (+ 465us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:11:00.492987 (+ 143us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:11:00.493092 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 01:11:00.493276 (+ 184us) server_negotiation.cc:299] Negotiation successful
0812 01:11:00.493382 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260812 01:11:00.505673 10361 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:11:00.503440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59192 (local address 127.4.201.124:44469)
0812 01:11:00.503627 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 01:11:00.503633 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:11:00.504147 (+ 514us) server_negotiation.cc:407] Connection header received
0812 01:11:00.504314 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:11:00.504320 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:11:00.504426 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:11:00.504532 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:11:00.505417 (+ 885us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59192: BlockingRecv error: recv got EOF from 127.0.0.1:59192 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 01:11:00.531988 10225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:11:00.524888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34250 (local address 127.4.201.125:32869)
0812 01:11:00.525065 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 01:11:00.525071 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:11:00.525611 (+ 540us) server_negotiation.cc:407] Connection header received
0812 01:11:00.525801 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:11:00.525808 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:11:00.525903 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:11:00.526006 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:11:00.526492 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:11:00.527716 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:11:00.529693 (+ 1977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:11:00.530365 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:11:00.530506 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:11:00.531196 (+ 690us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:11:00.531374 (+ 178us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:11:00.531489 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 01:11:00.531616 (+ 127us) server_negotiation.cc:299] Negotiation successful
0812 01:11:00.531699 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
W20260812 01:11:00.549088 10361 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:11:00.546895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59200 (local address 127.4.201.124:44469)
0812 01:11:00.547071 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 01:11:00.547077 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:11:00.547584 (+ 507us) server_negotiation.cc:407] Connection header received
0812 01:11:00.547744 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:11:00.547750 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:11:00.547851 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:11:00.547962 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:11:00.548833 (+ 871us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59200: BlockingRecv error: recv got EOF from 127.0.0.1:59200 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 01:11:00.596267 10225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:11:00.590204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34266 (local address 127.4.201.125:32869)
0812 01:11:00.590511 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0812 01:11:00.590517 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:11:00.590875 (+ 358us) server_negotiation.cc:407] Connection header received
0812 01:11:00.591101 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:11:00.591105 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:11:00.591175 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:11:00.591261 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:11:00.591809 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:11:00.592583 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:11:00.594530 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:11:00.594970 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:11:00.595071 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:11:00.595550 (+ 479us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:11:00.595653 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:11:00.595714 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 01:11:00.595881 (+ 167us) server_negotiation.cc:299] Negotiation successful
0812 01:11:00.595946 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
W20260812 01:11:00.603926 10361 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:11:00.601974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59204 (local address 127.4.201.124:44469)
0812 01:11:00.602199 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0812 01:11:00.602205 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:11:00.602562 (+ 357us) server_negotiation.cc:407] Connection header received
0812 01:11:00.602728 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:11:00.602732 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:11:00.602803 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:11:00.602880 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:11:00.603711 (+ 831us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59204: BlockingRecv error: recv got EOF from 127.0.0.1:59204 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 01:11:00.677280 10225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:11:00.671660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34280 (local address 127.4.201.125:32869)
0812 01:11:00.671822 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 01:11:00.671827 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 01:11:00.672309 (+ 482us) server_negotiation.cc:407] Connection header received
0812 01:11:00.672460 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:11:00.672466 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:11:00.672556 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:11:00.672650 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:11:00.673113 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:11:00.674254 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:11:00.675536 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:11:00.676190 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:11:00.676309 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:11:00.676609 (+ 300us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:11:00.676732 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:11:00.676812 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 01:11:00.676895 (+ 83us) server_negotiation.cc:299] Negotiation successful
0812 01:11:00.676973 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
W20260812 01:11:00.686195 10361 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 01:11:00.684267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59206 (local address 127.4.201.124:44469)
0812 01:11:00.684436 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 01:11:00.684442 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:11:00.684840 (+ 398us) server_negotiation.cc:407] Connection header received
0812 01:11:00.685017 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:11:00.685021 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:11:00.685111 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:11:00.685193 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 01:11:00.685988 (+ 795us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59206: BlockingRecv error: recv got EOF from 127.0.0.1:59206 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 01:11:00.778604 10382 catalog_manager.cc:1259] Loaded cluster ID: 07697be9155148a49681c42996741f84
I20260812 01:11:00.778702 10382 catalog_manager.cc:1552] T 00000000000000000000000000000000 P daec3d21913743379fc398e6b7af3ecb: loading cluster ID for follower catalog manager: success
I20260812 01:11:00.781388 10382 catalog_manager.cc:1574] T 00000000000000000000000000000000 P daec3d21913743379fc398e6b7af3ecb: acquiring CA information for follower catalog manager: success
I20260812 01:11:00.783123 10382 catalog_manager.cc:1602] T 00000000000000000000000000000000 P daec3d21913743379fc398e6b7af3ecb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 01:11:00.823130 10225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:11:00.817961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34296 (local address 127.4.201.125:32869)
0812 01:11:00.818182 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0812 01:11:00.818189 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 01:11:00.818580 (+ 391us) server_negotiation.cc:407] Connection header received
0812 01:11:00.818784 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:11:00.818788 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:11:00.818860 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:11:00.818941 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:11:00.819363 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:11:00.820073 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:11:00.821450 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:11:00.821869 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:11:00.821995 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:11:00.822426 (+ 431us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:11:00.822554 (+ 128us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:11:00.822635 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 01:11:00.822791 (+ 156us) server_negotiation.cc:299] Negotiation successful
0812 01:11:00.822875 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 01:11:00.833287 10361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:11:00.828319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59214 (local address 127.4.201.124:44469)
0812 01:11:00.828560 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0812 01:11:00.828566 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:11:00.828712 (+ 146us) server_negotiation.cc:407] Connection header received
0812 01:11:00.828850 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:11:00.828854 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:11:00.829007 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:11:00.829104 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:11:00.829448 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:11:00.830097 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:11:00.831322 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:11:00.831749 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:11:00.831844 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:11:00.832244 (+ 400us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:11:00.832780 (+ 536us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:11:00.832889 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 01:11:00.832926 (+ 37us) server_negotiation.cc:299] Negotiation successful
0812 01:11:00.832991 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260812 01:11:00.848884 10361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:11:00.838445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59230 (local address 127.4.201.124:44469)
0812 01:11:00.838624 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 01:11:00.838630 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:11:00.842962 (+ 4332us) server_negotiation.cc:407] Connection header received
0812 01:11:00.843165 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:11:00.843170 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:11:00.843266 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:11:00.843376 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:11:00.844049 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:11:00.844756 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:11:00.846561 (+ 1805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:11:00.847105 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:11:00.847219 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:11:00.847801 (+ 582us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:11:00.847931 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:11:00.848031 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 01:11:00.848540 (+ 509us) server_negotiation.cc:299] Negotiation successful
0812 01:11:00.848618 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 01:11:00.848937 10225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:11:00.838442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34304 (local address 127.4.201.125:32869)
0812 01:11:00.838647 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 01:11:00.838653 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:11:00.843035 (+ 4382us) server_negotiation.cc:407] Connection header received
0812 01:11:00.843354 (+ 319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:11:00.843361 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:11:00.843451 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:11:00.843515 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:11:00.844217 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:11:00.845208 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:11:00.847208 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:11:00.847687 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:11:00.847812 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:11:00.848251 (+ 439us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:11:00.848363 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:11:00.848456 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 01:11:00.848594 (+ 138us) server_negotiation.cc:299] Negotiation successful
0812 01:11:00.848670 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260812 01:11:00.849205 10628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 01:11:00.838335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35620 (local address 127.4.201.126:33551)
0812 01:11:00.842174 (+ 3839us) server_negotiation.cc:206] Beginning negotiation
0812 01:11:00.842180 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 01:11:00.842684 (+ 504us) server_negotiation.cc:407] Connection header received
0812 01:11:00.842811 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 01:11:00.842815 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 01:11:00.843001 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 01:11:00.843172 (+ 171us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 01:11:00.843684 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:11:00.844677 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:11:00.846880 (+ 2203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 01:11:00.847480 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 01:11:00.847602 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 01:11:00.848112 (+ 510us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 01:11:00.848569 (+ 457us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 01:11:00.848661 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 01:11:00.848848 (+ 187us) server_negotiation.cc:299] Negotiation successful
0812 01:11:00.848930 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3721,"thread_start_us":3624,"threads_started":1}
I20260812 01:11:00.853097 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 9993
I20260812 01:11:00.854164 10104 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:11:00.961578 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 9993
I20260812 01:11:00.990428 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 10122
I20260812 01:11:00.991576 10212 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:11:01.096580 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 10122
I20260812 01:11:01.124495 4901 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu pid 10228
I20260812 01:11:01.125653 10347 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:11:01.231326 4901 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuEa_sO/build/asan/bin/kudu with pid 10228
2026-08-12T01:11:01Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (4572 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (9644 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (371231 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST